r/LocalLLaMA
· Communities
Could an AI with a knowledge cutoff before Attention Is All You Need independently invent the Transformer architecture?
If you took today’s most capable reasoning model, but trained it only on knowledge available before 2017—before Attention Is All You Need—could it independently discover the Transformer architecture? submitted by /u/BaconSky [link] [comments]