Nvidia Boosts AI Performance With TensorRT
by from Tomshardware on (#6FMW4)
Nvidia has released TensorRT support for large language models, including Stable Diffusion, boosting performance by up to 70% in our testing. In other workloads, Nvidia touts up to a 4X improvement in throughput.