OpenAI and Broadcom announce chip designed for LLM inference at scale
by Samuel Axon from Ars Technica - All content on (#76HT5)
OpenAI, the company behind ChatGPT and Codex and the models those tools use, and Broadcom, an established silicon supplier, have announced a new chip, called Jalapeno, designed specifically for large language model inference in data centers.
The companies intend to deploy the chip at large data centers and claim this is just the first generation in a long-term project that will see chips refined over time.