Video: Storage Aware Job Scheduling

"In any HPC environment, storage is an integral and often unaccounted performance component of the infrastructure alongside compute. The health and performance of the overall infrastructure can be highly dependent on storage. Storage related performance issues can lead to adverse effects on overall job throughput, often resulting in business impact. In a reactive manner, the issue is often addressed by throttling the job flow. A more elegant and proactive approach would be to establish a feedback loop between storage and compute with the assistance of a job scheduler. This talk will explore the need for such a feedback loop, its benefits, and potential implementation scenarios for embarrassingly parallel HPC workloads."

The post Video: Storage Aware Job Scheduling appeared first on insideHPC.