r/LocalLLaMA
· Communities
Colony | A simulation of an LLM within a colony of agents
Heres an educational resource to learn about LLM attention mechanism using very simple analogies with agents. The agents live inside a conway game of life style board and each agent has a role in the self-attention-block mechanism. Watching it its fun. If you are not a math person, you can check it out here. Cheers sub