ByteDance trains massive AI model in bid to rival Anthropic
by Zijing Wu, Financial Times from Ars Technica - All content on (#77HC2)
ByteDance is training an AI model that could approach the size of Anthropic's most cutting-edge Mythos system, as Chinese companies continue to narrow the gap with the top US labs.
The Chinese tech giant is at an early stage of training a model with as many as 10 trillion parameters-three times larger than Moonshot's Kimi K3, the biggest Chinese model released to date, according to three people with knowledge of the matter.
The ByteDance model is being pre-trained-a stage that typically takes three to six months-before it is fine-tuned and released if all goes well, one of the people said. The exact model size would only be determined at a later stage.