OpenAI says its Jalapeño chip can power faster AI responses than the competition
OpenAI says its new AI chip, Jalapeno, completes tasks more efficiently and returns responses faster than other AI systems, according to a blog post published on Tuesday. During a briefing with reporters, OpenAI hardware vice president Richard Ho said Jalapeno offers the "best of both worlds" with lower latency and higher throughput, as AI systems typically "have to make a trade-off between the two."
First introduced in June, Jalapeno is an Application-Specific Integrated Circuit (ASIC) made in partnership with Broadcom. It's designed for AI inference - the process of running a trained AI model to complete a task or deploy an agent.
To mea ...