High-Performance Computing News Analysis | insideHPC

"Industrial Applications of High-Performance Computing: Best Global Practices offers a global overview of HPC for industrial applications, along with a discussion of software challenges, business models, access models (e.g., cloud computing), public-private partnerships, simulation and modeling, visualization, big data analysis, and governmental and industrial influence."The post NCSA’s Merle Giles Publishes New Book on Industrial HPC appeared first on insideHPC.

"Andreas Dilger from Intel presents an overview on the features currently under development for the upcoming Lustre 2.8 and 2.9 releases. This includes Layout Enhancement, Progressive File Layouts, Data-on-MDT, and improved single-client metadata and IO performance. In addition, several Lustre-specific ZFS improvements are also under development that will be available in this timeframe."The post Video: Lustre 2.8 and Beyond appeared first on insideHPC.

NCI in Australia has signed a $2M deal with Fujitsu to work with storage and data management company NetApp to supply and install all-flash storage arrays with a raw storage capacity of 11 petabytes, bringing NCI’s total raw storage capacity from 33 petabytes to 44 petabytes.The post NCI Boosts Storage to 44 Petabytes with Fujitsu & NetApp appeared first on insideHPC.

"With the current Lustre Performance Monitoring Tool (LMT) no longer in active development, and the current version incompatible with DNE based Lustre 2.5 deployments, there is a critical need for a new set of tools delivering the same basic Lustre performance metrics with the added ability to work compatibly with contemporary releases of Lustre."The post Video: New and Improved Lustre Performance Monitoring Tool appeared first on insideHPC.

The Open Compute Project, initiated by Facebook as a way to increase computing power while lowering associated costs with hyper-scale computing, has gained a significant industry following. Several vendors have released, or will soon release, servers based on Open Compute specifications.The post Open Computing: Vendor Landscape appeared first on insideHPC.

“The Cray-Seagate partnership is helping expand the boundaries of what’s possible in large-scale, data-intensive computing, far beyond what we could have imagined just 10 years ago. This continued innovation using the Lustre open file system is helping assist data-intense applications critical to advancements in important industries around the world.”The post Seagate Powers 120 Petabytes of HPC Storage with Cray appeared first on insideHPC.

We had a great time covering the Lustre User Group meeting in Denver last week. In this special feature, we added a blues music track to the OpenSFS slideshow from the event. Enjoy!The post Special Feature: Slideshow from #LUG2015 appeared first on insideHPC.

"The combination of the ephemeral nature of the cloud and directly addressable archives such as S3 suggest novel methods for using the Lustre HSM interface. Persistent data sets in the cloud need to be managed independently from a ephemeral filesystem and compute resources. Managing datasets in the cloud could, for example, involves importing data from Amazon's S3 back into a freshly-created Lustre filesystem, performing I/O intensive computations, and then persisting the datasets back to S3 before terminating the filesystem and compute resources. Alternatives for archive formats will also be discussed. AWS S3 will be used for concrete examples, but the general methods should be applicable to other cloud environments as well."The post Video: Lustre HSM in the Cloud appeared first on insideHPC.

Today's large-scale compute clusters take a lot of preparation for shipping. "Logistics planning for the KAUST shipment started months in advance, and it took 12 Cray personnel almost five days to prepare and pack the system. The KAUST shipment consisted of 184 boxes, weighed 127 tons, and filled an entire Boeing 747 airplane — plus part of another. Ten semi-trucks were required to transport Shaheen II from Cray’s manufacturing facility in Chippewa Falls, Wisconsin, to the airport in Chicago."The post Video: Preparing the Cray XC40 for Shipment to KAUST appeared first on insideHPC.

The SGI UV system is uniquely suited for bioinformatics and genomics by providing the computational capabilities and global shared memory architecture needed for even the most demanding sequencing and analytic tasks, including post sequencing and other data intensive workflows.The post Key Benefits of SGI UV 2000 Architecture for Life Sciences appeared first on insideHPC.

"Large scale HPC IO is usually done either with a file per process or to a single shared file. Single shared file IO does not scale well in Lustre compared to file per process. This presentation from Cray's Patrick Farrell will give details, examine the reasons for this, and explore existing and potential solutions. Group locks and a new feature, lock ahead, will be discussed in the context of strided IO."The post Video: Shared File Performance in Lustre – Challenges and Solutions appeared first on insideHPC.

Dr. Lewey Anton brings us the scoop on who’s jumping ship and moving on up in high performance computing.The post HPC People on the Move – April Edition appeared first on insideHPC.

In this video from LUG 2015 in Denver, Robert Triendl from DDN presents: Application-optimized Lustre Solutions for Big-Data Workflows.The post Video: Application-optimized Lustre Solutions for Big-Data Workflows appeared first on insideHPC.

The ISC High Performance Conference is seeking Student Volunteers. The event takes place July 12-16 in Frankfurt, Germany.The post Appy Now: ISC High Performance Conference Needs Student Volunteers appeared first on insideHPC.

In this special guest feature from Scientific Computing World, Stan Ahalt from the National Consortium for Data Science discusses how and why the organization came into being.The post NCDS Takes Action on Big Data appeared first on insideHPC.

Today RSC Group announced the installation of a MVS-10P MP Petastream supercomputer at the Joint Supercomputer Center of the Russian Academy of Sciences (JSCC RAS). As is the first project in the Commonwealth of Independent States based on the latest Intel Xeon Phi 7120D coprocessors, the supercomputer weighs in at #20 of the Top50 list of the most powerful computing systems in Russia and CIS.The post RSC PetaStream Powers Russian Academy of Sciences appeared first on insideHPC.

"Pleiades, one of the world's most powerful supercomputers, represents NASA's state-of-the-art technology for meeting the agency's supercomputing requirements, enabling NASA scientists and engineers to conduct modeling and simulation for NASA missions. Powered by Lustre, this distributed-memory SGI ICE cluster is connected with InfiniBand in a dual-plane hypercube technology."The post Video: Defending the Planet with Lustre appeared first on insideHPC.

As datasets and simulations continue to increase in size and complexity, interactivity with the data should be maintained. It is important to understand how SIMD parallelism can be used when evaluating large fault tree expressions on a large volume of input.The post Fault Trees appeared first on insideHPC.

In this video from LUG 2015 in Denver, Peter Bojanic from Seagate presents: Seagate Lustre Update. "Seagate powers four of the five 1 TB/sec filesystems in the world today."The post Video: Seagate Lustre Update appeared first on insideHPC.

Today the Oak Ridge Leadership Computing Facility (OLCF) announced a significant step forward in the delivery of Summit, the next-generation supercomputer IBM will deliver in 2017 to greatly advance the nation's energy and science agenda. Following a formal call for proposals and a review process, ORNL revealed 13 science application readiness projects selected as part of the Center for Accelerated Application Readiness (CAAR) program.The post OLCF Moves Forward on Application Readiness for Summit Supercomputer appeared first on insideHPC.

Universities and hospitals like TGen and NMTRC are seeing an entirely new reality in patient care leveraging HPC clusters. Here are some success stories on on advances in personalized medicine.The post Success Stories in Personalized Medicine appeared first on insideHPC.

articleIn this podcast, Michael Grabe from the University of California - San Francisco describes how scientists designed completely from scratch a protein molecule that behaves like a slice of life.The post Podcast: Supercomputing Synthetic Transporter Proteins appeared first on insideHPC.

"A little over a year ago LANL’s HPC Division purchased and fielded our first general purpose InfiniBand-based Lustre parallel file system. This new Lustre deployment, being the first of several similar planned deployments, gave us the opportunity to design a new storage backbone from the ground up and to gain in depth experience with and insight into Lustre technology in order to facilitate the installment and configuration of future systems."The post Video: There and Back Again – The Battle of Lustre at LANL appeared first on insideHPC.

"The second generation of SDSC’s Data Oasis Lustre storage is coming online to support Comet, a new XSEDE cluster targeted at the long tail of science. The servers have been designed with Lustre on ZFS in mind, and also update the network to use bonded 40GbE interfaces. The raw storage totals 7.7 PB and are again based on commodity hardware provided by Aeon Computing, maintaining our focus on cost."The post Video: SDSC’s Data Oasis Gen II: ZFS, 40GbE, and Replication appeared first on insideHPC.

Today the University of Oxford unveiled its new Arcus Phase B cluster. Integrated by OCF in the UK, the 5000 core Lenovo cluster will support research across all four Divisions at the University; Mathematical, Physical and Life Sciences; Medical Sciences; Social Sciences; and Humanities.The post OCF Deploys Lenovo Arcus Cluster at University of Oxford appeared first on insideHPC.

In this video from LUG 2015 in Denver, Jason Goodman from Cray presents: Cray’s Storage History and Outlook – Lustre+. "As a leader in open systems and parallel file systems, Cray builds on open source Lustre to unlock any industry-standard x86 Linux compute cluster using InfiniBand or 10/40 GbE utilizing proven Cray storage architectures."The post Video: Cray’s Storage History and Outlook – Lustre+ appeared first on insideHPC.

In this video from LUG 2015, Charlie Carroll from Cray presents an OpenSFS update. "An important new trend is Lustre file system usage in the enterprise environment. Through community input and new or existing working groups, OpenSFS is moving to support this trend as required by the community."The post Video: OpenSFS Update appeared first on insideHPC.

Recently, insideHPC featured an interview with IBM's Jay Muelhoefer on the topic of software defined infrastructure. To learn more about the storage sign of that coin, we caught up with Jim Gutowski and Scott Fadden from IBM.The post Interview: Software Defined Storage for Bridging HPC and Big Data Analytics appeared first on insideHPC.

Full paper submissions for SC15 Technical Papers are due by Friday, April 17.The post Final SC15 Technical Papers due Friday, April 17 appeared first on insideHPC.

Lustre Development UpdateThe post Video: Lustre Development Update from LUG 2015 appeared first on insideHPC.

The clock is ticking down for teams to submit their applications for the SC15 Student Cluster Competition. The deadline to apply for a spot in this year’s competition is Friday, April 17.The post Hurry! Enter SC15 Student Cluster Competition by April 17 appeared first on insideHPC.

In this video from LUG 2015, Hugo Falter presents an EOFS Update. "The EOFS (European Open File System) was founded in 2010 too promote the establishment and adoption of open source parallel file systems, sustain and enhance its quality, capabilities and functionality and ensure that specific requirements of European organizations, institutions and companies are upheld."The post Video: EOFS Update from LUG 2015 appeared first on insideHPC.

Today Teracala announced that San Diego State University is using a Terascala-powered HPC storage solution to study the DNA of viruses and bacteria.The post Terascala Powers Bioinformatics at SDSU appeared first on insideHPC.

The Open Compute Project is a way for organization to increase computing power while lowering associated costs with hyper-scale computing. This article is the 4th in a series from insideHPC that showcases the benefits of open computing to specific industries.The post Open Computing Benefits Many Industry Segments appeared first on insideHPC.

In this video, Steve Simms from Indiana University kicks off LUG 2015 with a talk on Lustre 101. "Lustre is a mature and stable file system that through its developers has consistently been able to respond to the needs of organizations that require high performance throughput and expanding capacity."The post Video: Steve Simms Teaches Lustre 101 at LUG 2015 appeared first on insideHPC.

In this podcast, the Radio Free HPC team looks at the 180 Aurora supercomputer coming to Argonne in 2018. "As the third of three Coral supercomputer procurements, the deal will comprise an 8.5 Petaflop “Theta” system based on Knights Landing in 2016 and a much larger 180 Petaflop “Aurora” supercomputer in 2018. Intel will be the prime contractor on the deal, with sub-contractor Cray building the actual supercomputers."The post Radio Free HPC Looks at the Aurora Supercomputer Coming to Argonne in 2018 appeared first on insideHPC.

Intel has been banned by the US Government from selling any more Xeon processors for use in the world's fastest supercomputer, the Tiahane-2 'Milky Way' machine at the Guangzhou Supercomputer Centre in China.The post Feds Restrict Intel Processors in China appeared first on insideHPC.

According to the latest edition of the local Top50 list of the most powerful supercomputers in Russia and CIS region, RSC has increased its share by 80%.The post RSC Leads Russian Supercomputer Market appeared first on insideHPC.

"The selection of Intel to deliver the Aurora supercomputer is validation of our unique position to lead a new era in HPC,” said Raj Hazra, vice president, Data Center Group and general manager, Technical Computing Group at Intel. “Intel’s HPC scalable system framework enables balanced, scalable and efficient systems while extending the ecosystem’s decades of software investment to future generations. We look forward to the numerous scientific discoveries and the far-reaching impacts on society that Aurora will enable.”The post Video: How Aurora Will Usher in a New Era for HPC appeared first on insideHPC.

In this Tech Shift podcast, Michael Papka and Susan Coghlan from Argonne National Laboratory discuss the 180 Petaflop Aurora supercomputer scheduled for deployment in 2018.The post Podcast: Michael Papka and Susan Coghlan on the 180 Petaflop Aurora Supercomputer appeared first on insideHPC.

"Pharmacokinetic (PK) and Pharmacodynamic(PD) parameters determine the develop-ability of a drug candidate and estimation of them are time consuming and there is an urgent need for time efficient approaches. In the present talk, we showcase the parallel implementation of Grid search method on Xeon Phi using stepwise optimization techniques as a promising approach for the robust estimation of PK-PD parameters. The solution described herein, is of great importance in decision making in Pharmaceutical Industry."The post Parallel Implementation of PK-PD Parameter Estimation on Intel Xeon Phi appeared first on insideHPC.

A number of challenges exist for both the wider adoption of technologies that can impede personalized medicine workflows and the implementation of such systems. Learn more on how companies like Dell and Intel are delivering complete integrated genomic processing infrastructure.The post HPC Helps Solve Challenges of Personalized Medicine appeared first on insideHPC.

Today the Ohio Supercomputer Center unveiled their new 144 Teraflop Ruby supercomputer. Powered by Intel Xeon Phi, the 144 Teraflop HP system is named after Cleveland-born activist Ruby Dee.The post New OSC Supercomputer Named After Civil Rights Activist Ruby Dee appeared first on insideHPC.

This morning Intel and the U.S. Department of Energy announced a $200 million supercomputing investment coming to Argonne National Laboratory. As the third of three Coral supercomputer procurements, the deal will comprise an 8.5 Petaflop "Theta" system based on Knights Landing in 2016 and a much larger 180 Petaflop "Aurora" supercomputer in 2018. Intel will be the prime contractor on the deal, with sub-contractor Cray building the actual supercomputers.The post A Closer Look at Intel’s Coral Supercomputers Coming to Argonne appeared first on insideHPC.

Today Intel announced that the company will deliver two next-generation supercomputers to Argonne National Laboratory. "The contract is part of the DOE’s multimillion dollar initiative to build state-of-the-art supercomputers at Argonne, Lawrence Livermore and Oak Ridge National Laboratories that will be five to seven times more powerful than today’s top supercomputers."The post Intel to Deliver Nation’s Most Powerful Supercomputer at Argonne appeared first on insideHPC.