Article 6YZVK Nvidia-backed startup invents Ethernet memory pool to help power AI — claims it can add up to 18TB of DDR5 capacity for large-scale inference workloads and reduce per-token generation costs by u

Nvidia-backed startup invents Ethernet memory pool to help power AI — claims it can add up to 18TB of DDR5 capacity for large-scale inference workloads and reduce per-token generation costs by u

by
ashilov@gmail.com (Anton Shilov)
from Latest from Tom's Hardware on (#6YZVK)
Enfabrica is piloting its Emfasys Ethernet-connected DDR5 memory pool that adds up to 18TB of CXL-attached memory to any AI server to ease memory bottlenecks in large-scale inference workloads.
External Content
Source RSS or Atom Feed
Feed Location https://www.tomshardware.com/feeds/all
Feed Title Latest from Tom's Hardware
Feed Link https://www.tomshardware.com/
Reply 0 comments