All the Fundamental Concepts for AGI are Here
by Brian Wang from NextBigFuture.com on (#6Y26A)
Bob McGrew, OpenAI's former Head of Research, led OpenAI from the GPT-3 breakthrough to today's reasoning models. Three main pillars of AGI-Transformers are scaled pre-training, post-training and reasoning-and that the fundamentals that will shape the next decade-plus are already in place. He thinks 2025 will be defined by reasoning while pre-training hits diminishing returns. AI ...