X · @teortaxesTex
· X / Twitter
RT Lilian Weng: A super long overdue (3+ years?) post on scaling laws. Compute is expensive. Scaling laws are a way to help us reason about the optima…
RT Lilian WengA super long overdue (3+ years?) post on scaling laws.Compute is expensive. Scaling laws are a way to help us reason about the optimal compute allocation between data and model size before committing to a large run. The post covers what scaling laws predict, how compute-optimal allocation works, why Kapla