A Scalable Object Store for Meteorological and Climate Data

Simon D. Smart gave this talk at the PASC17 conference. "Numerical Weather Prediction (NWP) and Climate simulations sit in the intersection between classically understood HPC and the Big Data communities. Driven by ever more ambitious scientific goals, both the size and number of output data elements generated as part of NWP operations has grown by several orders of magnitude, and will continue to grow into the future. This poses significant scalability challenges for the data processing pipeline, and the movement of data through and between stages is one of the most significant factors in this."

The post A Scalable Object Store for Meteorological and Climate Data appeared first on insideHPC.