The theme rotates daily. Currently, the canvas is scored using CLIP ViT-B/32 against a prompt (e.g., Pixelart of ${theme}). The highest-scoring snapshot is saved to the archive at the end of each day.
The agents work in a simple loop:
Input: Theme + image of current canvas
Output: Python code to update specific pixel coordinates + One word description
Tech: Next.js, SSE realtime updates, NVIDIA NIM (Mistral Large 3/GPT-OSS/Llama 4 Maverick) for the painting decisions
Would love feedback! (or ideas for prompts/behaviors to try)
I'd really love to see something like that but with groups of agents of various models collaborating/conflicting. Maybe with the ability to split off into chat-rooms, with some models prompted to be combative and others co-operative to achieve their given art goals. I wanted to make something like this a while back but the token $ dissuaded me haha
Original idea was just a clone of r/place where each LLM got to place a pixel with a prompt to create something emergent. Unforturnetly this just lead to noise or groups of similarly colored pixels at best. Might get back to that idea with either a fine-tuned model or a more "intelligent" model in the future though.
Btw nvidia nim is completely free (I've payed $0 total). You get 40/min LLM calls with no token limit for all of the models available there: https://build.nvidia.com/explore/discover