X · @natolambert
· X / Twitter
The real comparison to Moore's law for AI isn't scaling laws, but rather the intelligence efficiency that we gain year-over-year using models to get b…
The real comparison to Moore's law for AI isn't scaling laws, but rather the intelligence efficiency that we gain year-over-year using models to get better at training models. If we gain 2x per year on efficiency of training (ie lowering inference cost at fixed performance), in 5 years a given performance level will be