Ex-OpenAI researcher bets $100 billion will flow into training data because scaling alone won't cut it

Summary

Former OpenAI employee Andrew Ho and Cambridge researcher Adam Hunt see a growing problem with large language models. Instead of becoming more versatile, the models are becoming more specialized, excelling at coding and math while stagnating or even regressing in other areas. Ho is leaving OpenAI to start a company focused on specialized training data and predicts that AI labs will need to spend more than $100 billion on targeted data collection. The article Ex-OpenAI researcher bets $100 billion will flow into training data because scaling alone won't cut it appeared first on The Decoder .

News Radar provides aggregated summaries. Full content and copyright remain with the original publisher.