Huawei releases new tool to get Chinese firms around crushing HBM export blacklist — new UCM software claims up to 22x throughput gain and 90% latency reduction for traditional cache hierarchies

Huawei's newest software tool, called the Unified Cache Manager, seeks to optimize utilization across the traditional cache hierarchy for AI inference, allowing China's AI firms to be more competitive without the need for exotic HBM memory that is near-impossible to obtain in the country.