Tesla Dojo AI Training Supercomputer
by Brian Wang from NextBigFuture.com on (#62W9M)
Tesla Dojo team presented at the Hot Chip 34 conference. Tesla has made sure that the IO (input output), memory, software, power, cooling and all other aspects of the system are perfectly scalable. This will enable them to just build and add tiles to scale to the Exaflop level and beyond. About 120 compute tiles ...