Article 7Y63 Video: Understanding Hadoop Performance on Lustre

Video: Understanding Hadoop Performance on Lustre

by
Rich Brueckner
from High-Performance Computing News Analysis | insideHPC on (#7Y63)
Hadoop-Cluster-150x150.png

"In this talk, Seagate presents details on its efforts and achievements around improving Hadoop performance on Lustre including a summary on why and how HDFS and Lustre are different and how those differences affect Hadoop performance on Lustre compared to HDFS, Hadoop ecosystem benchmarks and best practices on HDFS and Lustre, Seagate's open-source efforts to enhance performance of Lustre within "diskless" compute nodes involving core Hadoop source code modification (and the unexpected results), and general takeaways ways on running Hadoop on Lustre more rapidly."

The post Video: Understanding Hadoop Performance on Lustre appeared first on insideHPC.

External Content
Source RSS or Atom Feed
Feed Location http://insidehpc.com/feed/
Feed Title High-Performance Computing News Analysis | insideHPC
Feed Link https://insidehpc.com/
Reply 0 comments