Will AI Keep Pretaining Scaling? XAI Grok 3.5 Will Tell Us
by Brian Wang from NextBigFuture.com on (#6Y7ZY)
Epoch AI's estimates AI compute has risen by 4x per year over the last 15 years, while AI algorithmic improvements have divided the compute needed by about 3 each year. This means that over time, the effective compute is growing by about 12x per year, with about 40% of this gain coming from algorithmic improvements. ...