THE DECODER
· Tech Media
Ex-OpenAI researcher bets $100 billion will flow into training data because scaling alone won't cut it
Former OpenAI employee Andrew Ho and Cambridge researcher Adam Hunt see a growing problem with large language models. Instead of becoming more versatile, the models are becoming more specialized, excelling at coding and math while stagnating or even regressing in other areas. Ho is leaving OpenAI to start a company foc