Tesla just presented a highly technical talk about Dojo's networking protocol at the Hot Chips conference. The Tesla networking protocol is twice as fast as the industry standard NVLink used in Nvidia supercomputers. Tesla Dojo is cost competitive to Nvidia. Tesla is nearing the end of Dojo Version 1. They are working on Dojo Version ... Read more

This weekend, the xAI team brought the Colossus 100k H100 training cluster online. From start to finish, it was done in 122 days. Colossus is the most powerful AI training system in the world. Moreover, it will double in size to 200k (50k H200s) in a few months. This weekend, the @xAI team brought our ... Read more