Bringing HPC Algorithms to Big Data Platforms

Nikolay Malitsky from Brookhaven National Laboratory presented this talk at the Spark Summit East conference. "This talk will present a MPI-based extension of the Spark platform developed in the context of light source facilities. The background and rationale of this extension are described in the paper "Bringing the HPC reconstruction algorithms to Big Data platforms." which highlighted a gap between two modern driving forces of the scientific discovery process: HPC and Big Data technologies. As a result, it proposed to extend the Spark platform with inter-worker communication for supporting scientific-oriented parallel applications."

The post Bringing HPC Algorithms to Big Data Platforms appeared first on insideHPC.