AMD ZenDNN 5.0.1 Released To Help With EPYC Inferencing For Recommender Systems & LLMs

Released last year shortly after the EPYC 9005 "Turin" processor launch was ZenDNN 5.0 for Zen 5 optimized CPU inferencing with the likes of PyTorch and TensorFlow. ZenDNN 5.0 delivers up to a 400% performance uplift according to AMD engineers. Out today is ZenDNN 5.0.1 with further optimizations, particularly around recommendation engines and large language models (LLMs)...