Last year we rolled out the Firefox AI Runtime, the engine that quietly powers features such as PDF.js generated alt text and, more recently, our smart tab grouping. The system worked, but not quite at the speed we wanted. This post explains how we accelerated inference by replacing the default onnxruntimeweb that powers Transformers.js with [...]The post Speeding up Firefox Local AI Runtime appeared first on The Mozilla Blog.