Article 2HXRV Accelerating Apache Spark with RDMA

Accelerating Apache Spark with RDMA

by
Rich Brueckner
from High-Performance Computing News Analysis | insideHPC on (#2HXRV)
yuval-150x150.jpg

Yuval Degani from Mellanox presented this talk at the OpenFabrics Workshop. "In this talk, we present a Java-based, RDMA network layer for Apache Spark. The implementation optimized both the RPC and the Shuffle mechanisms for RDMA. Initial benchmarking shows up to 25% improvement for Spark Applications."

The post Accelerating Apache Spark with RDMA appeared first on insideHPC.

External Content
Source RSS or Atom Feed
Feed Location http://insidehpc.com/feed/
Feed Title High-Performance Computing News Analysis | insideHPC
Feed Link https://insidehpc.com/
Reply 0 comments