Elon and SpaceX Have Made AI Training 10 Times Faster
by Brian Wang from NextBigFuture.com on (#75XXF)
Elon is saying SpaceX built its own super-optimized AI training software from scratch in the C programming language. It is 10 times faster than Google JAX framework. It's designed to run on a massive cluster of 220,000 cutting-edge NVIDIA GB300 GPUs connected by ultra-fast 800G networks. They use pipeline parallelism and get as close to ...