Alibaba Cloud reveals its datacenter design and homebrew network used for LLM training
15,000 GPUs per DC, in hosts packing eight apiece, plus nine NICs - helped by switches with custom heat sinks Exclusive Alibaba Cloud has revealed the design of an Ethernet-based network it created specifically to carry traffic for training large language models - and has used in production for eight months....