r/MachineLearning July 24, 2026 · Communities

I built a compiler that turns computation graphs into the weights of a vanilla transformer — no training anywhere [P]

I've been chasing the question of what algorithms a transformer can actually express -- separate from what it can learn. So I built a compiler: define a computation graph in ordinary Python, and it produces the weights of a transformer that executes the graph. The result is a standard Phi-3-architecture checkpoint that