SambaNova: New AI Chip Runs 5 Trillion Parameter Models
by staff from High-Performance Computing News Analysis | insideHPC on (#6EWK2)
Specialty AI chip maker SambaNova Systems today announced the SN40L processor, which the company said will power SambaNova's full stack large language model (LLM) platform, the SambaNova Suite. Manufactured by TSMC, the SN40L can serve a 5 trillion parameter model, with 256k+ sequence length possible on a single system node, according to the company.
The post SambaNova: New AI Chip Runs 5 Trillion Parameter Models appeared first on High-Performance Computing News Analysis | insideHPC.