Reiner Pope – Chip design from the bottom up
Working up from basic logic gates to why GPUs, TPUs, FPGAs, and the human brain each look the way they do.
Latest
The mistake of conflating intelligence and power
f this is your definition of intelligence is the ability to achieve your goals across a wide variety of domains, then Stalin was the most intelligent…
RLVR might be disproportionately bad at science
the verification loop for theories can be on the order of decades and centuries, and even then we know today as the better theory can often…
Eric Jang – Building AlphaGo from scratch
AlphaGo is still the cleanest worked example of the primitives of intelligence: search, learning from experience, and self-play.
David Reich – Why the Bronze Age was an inflection point in human evolution
"Instead of being quiescent, natural selection is everywhere."
Reiner Pope – The math behind how LLMs are trained and served
It's shocking how much you can deduce about what the labs are doing from a handful of equations and a blackboard
More open questions about AI
Hodge podge of things I was thinking about this weekend.
Blog prize for the big questions about AI
The not-so-secret point of this whole contest is so that I can hire a researcher
Jensen Huang – TPU competition, why we should sell chips to China, & Nvidia’s supply chain moat
“If our next several years are a trillion dollars in scale, we have the supply chain to do it"
Michael Nielsen – How science actually progresses
The true story of Einstein, Newton, and Darwin