AI Text Data Training and Other Scaling Problems and Limits
by Brian Wang from NextBigFuture.com on (#6S8G1)
Unnamed OpenAI researchers told The Information that Orion (aka GPT 5), the next OpenAI full-fledged model release, is showing a smaller performance jump than the one seen between GPT-3 and GPT-4 in recent years. On certain tasks, the Orion model is not reliably better than its predecessor according to unnamed OpenAI researchers. eX-OpenAI co-founder Ilya ...