X · @teortaxesTex
· X / Twitter
RT Artur Chakhvadze: Btw, some of the most important numbers in the local AI context (that nobody talks about) https://gwern.net/doc/cs/hardware/2014-…
RT Artur ChakhvadzeBtw, some of the most important numbers in the local AI context (that nobody talks about)https://gwern.net/doc/cs/hardware/2014-horowitz-2.pdfArtur Chakhvadze: This means that with local models we either have to admit defeat and use AR decoding (which sucks for energy efficiency, since DRAM reads con