Nvidia’s TiDAR experiment could speed up AI token generation using hybrid diffusion decoder — new research boasts big throughput gains, but limitations remain
by from Latest from Tom's Hardware on (#71VN4)
Nvidia has released a paper describing TiDAR, a decoding method that merges two historically separate approaches to accelerating language model inference.