The 100 trillion-parameter models of the near future can't be built in one place Microsoft believes the next generation of AI models will use hundreds of trillions of parameters. To train them, it's not just building bigger, more efficient datacenters - it's started connecting distant facilities using high-speed networks spanning hundreds or thousands of miles....
Articles
1