High-Performance Computing News Analysis | insideHPC

Tim Pugh from the Australian Bureau of Meteorology gave this talk at the DDN User Group in Denver. "The Bureau of Meteorology, Australia’s national weather, climate and water agency, relies on DDN’s GRIDScaler Enterprise NAS storage appliance to handle its massive volumes of research data to deliver reliable forecasts, warnings, monitoring and advice spanning the Australian region and Antarctic territory."The post Video: Australian Bureau of Meteorology moves to a new Data Production Service appeared first on insideHPC.

In this video from AWS Reinvent, Anthony Liguori from Amazon presents: Nitro Hypervisor - the Evolution of Amazon EC2 Virtualization. "The new Nitro hypervisor for Amazon EC2, introduced with the launch of C5 instances, is a component that primarily provides CPU and memory isolation for C5 instances. VPC networking, and EBS storage resources are implemented by dedicated hardware components that are part of all current generation EC2 instance families. It is built on core Linux Kernel-based Virtual Machine (KVM) technology, but does not include general purpose operating system components.The post Video: Introducing the Nitro Hypervisor – the Evolution of Amazon EC2 Virtualization appeared first on insideHPC.

Computational scientists now have the opportunity to apply for the upcoming Argonne Training Program on Extreme-Scale Computing (ATPESC). The event takes place from July 29-August 10, 2018 in greater Chicago. "With the challenges posed by the architecture and software environments of today’s most powerful supercomputers, and even greater complexity on the horizon from next-generation and exascale systems, there is a critical need for specialized, in-depth training for the computational scientists poised to facilitate breakthrough science and engineering using these amazing resources."The post Apply now for Argonne Training Program on Extreme-Scale Computing 2018 appeared first on insideHPC.

In this video from SC17, Sunita Chandrasekaran from OpenACC.org and Stan Posey from NVIDIA describe how OpenACC eases GPU programming for HPC. "At SC17, OpenACC.org announced milestones highlighting OpenACC’s broad adoption in weather and climate models that simulate the Earth’s atmosphere, including one of this year’s Gordon Bell finalist. Additionally, the organization announced their hackathon momentum and the new OpenACC 2.6 specification."The post Video: OpenACC Eases GPU Programming for HPC at SC17 appeared first on insideHPC.

Hyperion Research recently announced the newest recipients of the HPC Innovation Excellence Awards. "High performance computing contributes enormously to scientific progress, economic competitiveness, national security and the quality of human life," said Bob Sorensen, Hyperion Research vice president of research and technology. "The winners of these awards have been judged to be among the world's best at exploiting HPC to achieve important real-world innovations."The post Hyperion Research Announces HPC Innovation Excellence Award Winners appeared first on insideHPC.

In this video, Akira Sano provides a tour of the Supermicro booth at SC17 in Denver. "Supermicro offers the best selection of leading HPC optimized servers in the industry as evidenced by the recent selection of our twin architecture by the NASA Center for Climate Simulation (NCCS)."The post Supermicro Booth Tour Showcases HPC Innovation at SC17 appeared first on insideHPC.

New York University is seeking an HPC Specialist in our Job of the Week. "The HPC Specialist will provide technical leadership in design, development, installation and maintenance of hardware and software for the central High-Performance Computing systems and/or research computing services at New York University."The post Job of the Week: HPC Specialist at New York University appeared first on insideHPC.

In this video from the Intel HPC Developer Conference in Denver, Michael Strickland describes how Intel FPGAs are powering new levels of performance and datacenter efficiency with FPGAs. "Altera and Intel offers a broad range of FPGA devices - from the high performaning Stratix series to the flexible MAX 10 - so you can find a device that best meets your business needs."The post Intel Steps up to HPC & the Enterprise with FPGAs appeared first on insideHPC.

Dr. Stephan Schenk from BASF gave this talk at the DDN User Group at SC17. "With 1.75 petaflops, our supercomputer QURIOSITY offers around 10 times the computing power that BASF currently has dedicated to scientific computing. In the ranking of the 500 largest computing systems in the world, the BASF supercomputer is currently number 71.”The post Video: A Petascale HPC System at BASF appeared first on insideHPC.

The European HPC Summit Week 2018 conference has released their Call for Workshops. The event takes place place May 28 - June 1 in Ljubljana, Slovenia. "This call for workshops is addressed to all possible participants interested in including a session or workshop in the EHPCSW18. The procedure is to send an expression of interest to have a session/workshop and agree on a joint programme for this week. If you are an HPC project, initiative or company and you want to include a workshop or session in the European HPC Summit Week, please send the document attached before December 18, 2017."The post Call for Workshops: European HPC Summit Week 2018 appeared first on insideHPC.

In this video from SC17 in Denver, Michael Klemm from the OpenMP ARB describes how the OpenMP programming community is moving forward to new levels of scalable performance. The OpenMP Architecture Review Board (ARB) is seeking feedback on the newly released Technical Report 6.The post OpenMP ARB Releases New Technical Report and Asks for Feedback appeared first on insideHPC.

A valuable feature of Intel Advisor is its Roofline Analysis Chart, which provides an intuitive and powerful visualization of actual performance measured against hardware-imposed performance ceilings. Intel Advisor's vector parallelism optimization analysis and memory-versus-compute roofline analysis, working together, offer a powerful tool for visualizing an application’s complete current and potential performance profile on a given platform.The post A New Way to Visualize Performance Optimization Tradeoffs appeared first on insideHPC.

In this video, Jay Breakstone and Sumit Puri from Liqid describe the company's innovative composable infrastructure technology for HPC. "Liqid Grid enables once-static infrastructure to scale on demand to effectively manage the explosion of data associated with cloud, enterprise, HPC and AI, as well as other emerging, high-value, data-intensive applications."The post Liqid steps up with Composable Infrastructure for HPC at SC17 appeared first on insideHPC.

At SC17 in Denver, Cavium showcased a wide variety of ThunderX2 Arm-based server platforms for high performance computing. "ThunderX2 server SoC integrates fully out-of-order, high-performance custom cores supporting single and dual-socket configurations. It is optimized to drive high computational performance delivering outstanding memory bandwidth and memory capacity. The new line of ThunderX2 processors includes multiple SKUs for both scale up and scale out applications and is fully compliant with Armv8-A architecture specifications as well as the Arm Server Base System Architecture and Arm Server Base Boot Requirements standards."The post Cavium Showcases ThunderX2 Arm-based Server Platforms for HPC appeared first on insideHPC.

In this video from SC17, Molly Presley from Quantum describes how the company's high performance storage systems power HPC. "So why have an autonomous car at a Supercomputing show? The answer is Big Data. The Autonomous Stuff vehicle in this video is actually a rolling software development platform equipped with sensors that generate a whopping 30 Terabytes of data per day. Now just imagine if there were millions of vehicles on the road generating this kind of data. Only HPC could deal with that problem at scale. Companies like Quantum are stepping up to help solve this big data problem, both in the vehicle, on the edge, and in the datacenter."The post Quantum Drives High Performance Storage at SC17 appeared first on insideHPC.

The IEEE Cluster 2018 conference has issued it Call for Papers. The event takes place September 10-14, 2018 in Belfast UK. "Following the successes of previous IEEE Cluster conferences, for IEEE Cluster 2018, which will be held September 10-14, 2018 in Belfast UK, we again solicit high-quality original work that advances the state-of-the-art in clusters and closely related fields. All papers will be rigorously peer-reviewed for their originality, technical depth and correctness, potential impact, relevance to the conference, and quality of presentation."The post Call for Papers: IEEE Cluster 2018 in Belfast appeared first on insideHPC.

In this video from the Intel HPC Developer Conference, Erik Lindahl from Stockholm University describes the challenges of cryo-EM, a technique that fires beams of electrons at proteins that have been frozen in solution, to deduce the biomolecules’ structure. "Structural biology is going through a revolution where cryo-EM now determine 3D structures from 100,000s of noisy images, but it relies on very large computations. I will present our work with Intel to accelerate the RELION program with x86 SIMD, TBB, and MKL to provide outstanding performance."The post Accelerating Cryo-EM with Intel Technologies appeared first on insideHPC.

The 9th Irish Supercomputer List was released today. For the first time, Ireland has four computers ranked on the Top500 and Ireland is now ranked number one globally in terms of number of Top500 supercomputers per capita.The post Ireland Reaches #1 in TOP500 Supercomputers per capita appeared first on insideHPC.

In this video from SC17, Ken King describes how new Power9 compute nodes will power the next generation of the world's most powerful Coral supercomputers at ORNL and LLNL. "We’re pleased to announce that we are delivering on our project, with our next-generation IBM Power Systems with NVIDIA Volta GPUs being deployed at Oak Ridge and Lawrence Livermore National Labs."The post IBM Readies Power9 Coral Supercomputers at SC17 appeared first on insideHPC.

The popularity of “better than human” classification on tasks that people do well (such as recognizing faces, Internet image search, self-driving cars, etcetera) has reached a mass audience. "What has been lacking is coverage that machine learning is also fantastic at performing tasks that humans tend to do poorly."The post AI and HPC: Inferencing, Platforms & Infrastructure appeared first on insideHPC.

In this video, Jeff Kuehn from LANL, Pavel Shamis from ARM, and Gilad Shainer from Mellanox describe progress on the new UCF consortium, a collaboration between industry, laboratories, and academia to create an open-source production grade communication framework for data centric and high-performance applications.The post UCX and UCF Projects for Exascale Move Forward at SC17 appeared first on insideHPC.

Researchers are using HPC systems at the Barcelona Supercomputing Center to predict potential threats to air traffic posed by Antarctic volcanoes. "Antarctic volcanoes might pose a higher threat than previously considered. A research focused on the potential impacts of ash dispersal and fallout from Deception Island highlights how ash clouds entrapped in circumpolar upper-level winds have the potential to reach lower latitudes and disrupt Austral hemisphere air traffic. The study has been published today in the Nature group journal, Scientific Reports."The post Video: BSC Simulations Predict Air Traffic Disruption from Antarctic Volcanic Ash appeared first on insideHPC.

In this video, Gilad Shainer from Mellanox describes the company's advanced interconnect technologies that were on display at SC17 in Denver. "Mellanox is leading industry innovation by providing the highest throughput and lowest latency HDR 200Gb/s InfiniBand and Ethernet solutions available today, with a clear roadmap for tomorrow."The post Video: Mellanox Takes HPC Interconnects to the Next Level at SC17 appeared first on insideHPC.

Today HPE announced a collaboration with the Faculty of Mathematics at the University of Cambridge to accelerate new discoveries in the mathematical sciences. This includes partnering with Stephen Hawking’s Centre for Theoretical Cosmology (COSMOS) to understand the origins and structure of the universe. Leveraging the HPE Superdome Flex in-memory computing platform, the COSMOS group will search for clues hiding in massive data sets—spanning 14 billion years of information—that could unlock the secrets of the early universe and black holes.The post HPE Superdome Flex to power Stephen Hawking’s COSMOS Research Group appeared first on insideHPC.

In this video from SC17 in Denver, Brian Gold from Pure Storage describes how the company's innovative FlashBlade Systems speed up I/O for AI & HPC workloads. "From scientific research and movie rendering to artificial intelligence, applications push the limits on thousands of GPU cores or thousands of CPU servers. Parallel compute demands parallel storage. FlashBlade is the industry’s first all-flash storage purpose-built for modern analytics – architected from the ground-up to deliver a powerful cloud-era data platform that’s fast, big, and simple."The post Video: Pure Storage Speeds I/O for AI & HPC Workloads at SC17 appeared first on insideHPC.

To meet some of the biggest HPC software challenges, representatives from more than 25 academic, research, and commercial organizations formed a community project at the end of 2015: OpenHPC. This is the third article in a four-part series that explores going beyond OpenHPC with Intel HPC Orchestrator. Download the full insideHPC Special Report.The post Exploring the OpenHPC Solution for HPC appeared first on insideHPC.

In this podcast, the Radio Free HPC team goes over the results of the SC17 Student Cluster Competition. This year, Nanyang Technological University from Singapore took the Top Prize. "In this competition, student teams design and build small clusters, with hardware and software vendor partners, learn designated scientific applications, apply optimization techniques for their chosen architectures, and compete in a non-stop, 48-hour challenge, at the SC conference."The post Radio Free HPC wraps up the SC17 Student Cluster Competition appeared first on insideHPC.

Today Nuance Communications announced that they are working together to bring the power of machine learning to radiologists and data scientists working across the entire healthcare system. "We stand on the edge of a new age in radiology, where artificial intelligence and machine learning will become a necessity in every radiologist's essential toolkit,” said Dr. Luciano Prevedello, Division Chief of Medical Imaging Informatics at The Ohio State University Wexner Medical Center. “It is critical for the state of AI adoption and its potential to improve patient outcomes and operations that AI-based tools are more than just available – they must be valuable, validated and valued by the institution of radiology.”The post NVIDIA and Nuance to Advance AI for Radiology appeared first on insideHPC.

Argonne National Laboratory is collaborating with HPE to provide system software expertise and a development ecosystem for a future high-performance computing system based on 64-bit ARM processors. "Argonne is working with HPE to evaluate early versions of chipmaker Cavium ARM ThunderX2 64-bit processors for the ARM ecosystem. Argonne is interested in evaluating the ARM ecosystem as a cost-effective and power-effective alternative to x86 architectures based on Intel CPUs, which currently dominate the high-performance computing market."The post Argonne to Install Comanche System to Explore ARM Technology for HPC appeared first on insideHPC.

In this video from SC17, Josh Mora describes how the new AMD EPYC Processors deliver huge memory bandwidth and application performance for HPC. "EPYC strikes the perfect balance of cores/threads, memory, I/O bandwidth and security to deliver excellent performance for many High Performance Computing (HPC) workloads. AMD’s state-of-the-art GPUs combined with EPYC provide excellent solutions for your most demanding HPC applications."The post AMD steps up with EPYC Processors for HPC at SC17 appeared first on insideHPC.

In this video, Bill Mannel gives a booth tour that highlights some of the amazing HPC innovations on display in the HPE booth at SC17. "HPE’s first ARM-based HPC system brings more choice and flexibility to HPC customers. The Apollo 70, using Cavium’s 64-bit ARMv8-A ThunderX2 Server Processor, is purpose-built for memory intensive HPC workloads and delivers up to 33 percent more memory bandwidth than today’s industry standard servers."The post Video: HPE Showcases Innovation for HPC at SC17 appeared first on insideHPC.

In this video, researchers from Lawrence Livermore National Laboratory describe Sierra, LLNL’s next-generation supercomputer. "The IBM-built advanced technology high-performance system is projected to provide four to six times the sustained performance and be at least seven times more powerful than LLNL’s current most advanced system, Sequoia, with a 125 petaFLOP/s peak. At approximately 11 megawatts, Sierra will also be about five times more power efficient than Sequoia."The post Video: Introducing the 125 Petaflop Sierra Supercomputer appeared first on insideHPC.

In this video from the International Workshop on Advanced Computing and Analysis Techniques in Physics Research, Dr. Colin P. Williams from D-Wave Systems presents: Quantum Computing for the Real World Today. His focus for the talk centers around using quantum computing for machine learning. "We expect that quantum computing will lead to breakthroughs in science, engineering, modeling and simulation, healthcare, financial analysis, optimization, logistics, and national defense applications."The post Video: Quantum Computing for the Real World Today appeared first on insideHPC.

Penguin Computing has announced plans to deploy more than 11,500 cores of the latest Intel Xeon Scalable processor in their Penguin Computing On-Demand HPC cloud. “The latest Intel Xeon Scalable processor expansion will provide an ideal compute environment for MPI workloads that can leverage thousands of cores for computation. We have significant customer demand for POD HPC cloud in applicable areas like high-resolution weather forecasting and computational fluid dynamics, including solutions from software partners like ANSYS, Flow Science and CD-adapco.”The post Intel Xeon Scalable Processors come to Penguin on Demand HPC Cloud appeared first on insideHPC.

In this video from SC17 in Denver, Dan Reed moderates a panel discussion on HPC Software for Energy Efficiency. "This panel will explore what HPC software capabilities were most helpful over the past years in improving HPC system energy efficiency? It will then look forward; asking in what layers of the software stack should a priority be put on introducing energy-awareness; e.g., runtime, scheduling, applications? What is needed moving forward? Who is responsible for that forward momentum?"The post SC17 Panel: Energy Efficiency Gains From Software appeared first on insideHPC.

Case Western Reserve University in Cleveland is seeking an IT Engineer in our Job of the Week. "The IT Engineer will serve as lead architect to manage, develop and design high-level systems. The position shares responsibility for the research computing services provided to the university community, which leverages the university's investment in cyberinfrastructure. This includes identifying appropriate computational platforms (locally and externally) for research projects and diagnosing and resolving issues in the configuration, installation, tuning, and management of very large distributed and tightly coupled computer systems, based on the Linux OS."The post Job of the Week: IT Engineer at Case Western Reserve University appeared first on insideHPC.

Today Excelero announced that SciNet, Canada's largest supercomputer center, has deployed Excelero's NVMesh server SAN for the highly efficient, cost-effective storage behind a new supercomputer at the University of Toronto. "For SciNet, NVMesh is an extremely cost-effective method of achieving unheard-of burst buffer bandwidth," said Dr. Daniel Gruner, chief technical officer, SciNet High Performance Computing Consortium. "By adding commodity flash drives and NVMesh software to compute nodes, and to a low-latency network fabric that was already provided for the supercomputer itself, NVMesh provides redundancy without impacting target CPUs. This enables standard servers to go beyond their usual role in acting as block targets – the servers now can also act as file servers."The post Excelero NVMesh powers Canada’s new SciNet Petascale Storage Facility appeared first on insideHPC.

In this video from SC17 in Denver, Steve Branton from Asetek describes the company's wide array of liquid cooling solutions for HPC. At the Asetek booth, the company displayed liquid cooling from recently announced OEMs and channel partners in addition to cooling solutions for the latest Intel, Nvidia and IBM CPUs, accelerators and GPUs. “We are seeing higher wattage HPC nodes that require liquid cooling as they cannot be cooled with air. Wattage density is only going to get higher with the inclusion of machine learning and AI across the HPC spectrum.”The post Asetek Rides the Wave of Liquid Cooling for HPC at SC17 appeared first on insideHPC.

Last week at SC17, Univa announced its Univa Grid Engine distributed resource management system is powering the Wellcome Centre for Human Genetics’ (WHG) high performance computing environment. WHG is a research institute within the Nuffield Department of Medicine at the University of Oxford. The Centre is an international leader in genetics, genomics, statistics and structural biology with more than 400 researchers and 70 administrative and support personnel. WHG’s mission is to advance the understanding of genetically-related conditions through a broad range of multi-disciplinary research.The post Univa Grid Engine Powers University of Oxford Human Genetics Centre appeared first on insideHPC.

In this video from the Altair Tiki Bar at SC17, Bill Nitzberg describes the company's open sources solutions for HPC system management. "PBS Professional automates job scheduling, management, monitoring and reporting, and is the trusted solution for complex Top500 systems as well as smaller cluster owners."The post Video: Altair Serves Up HPC with PBS Pro at SC17 appeared first on insideHPC.

In this special guest feature from Scientific Computing World, David Yip, HPC and Storage Business Development at OCF, provides his take on the place of GPU technology in HPC. "Using GPUs in the HPC datacenter in place of CPUs can dramatically increase the power requirements needed, but if your computational performance goes through the roof, then I’d argue it’s a trade-off worth making."The post For HPC and Deep Learning, GPUs are here to stay appeared first on insideHPC.

Green Revolution Cooling has announced plans to deliver a custom GPU-based cluster to the Texas Advanced Computing Center (TACC). Our goal is to make HPC more affordable. Offering lower cost, energy dense servers that take full advantage of our highly efficient CarnotJet cooling system is a huge benefit to our customers,” said Larry Stone, VP of Engineering at GRC “we are seeing a growing number of people opt for servers designed for immersion, over traditional big brand OEM hardware.”The post GRC Builds GPU-Based Immersion Cluster for TACC appeared first on insideHPC.

In this video, Geoff Lyon from CoolIT Systems describes the company's innovative liquid-cooling solutions for HPC. "Liquid cooling in the data center continues to grow in adoption and delivers more compelling ROIs. Our collaboration with OEM partners such as Dell EMC, HPE, Intel and STULZ provides further evidence that the future of the data center is destined for liquid cooling,” said Geoff Lyon, CEO and CTO at CoolIT Systems.The post CoolIT Systems Showcases OEM & Enterprise Data Center Liquid Cooling Solutions at SC17 appeared first on insideHPC.

Last week at SC17, ThinkParQ announced immediate availability of the BeeGFS version 7.0 release candidate. While previous versions of BeeGFS are already running on systems of all kinds and sizes around the globe (including burst buffers, hyper-converged setups and of course dedicated high-performance enterprise storage), this new major release introduces several features that were desired by the BeeGFS community.The post New BeeGFS 7.0 Delivers All-Flash Performance at Spinning Disk Price appeared first on insideHPC.

"Traditional methods of moving data are expensive and very time-consuming. These processes often negate the value-add that the cloud offers. Moving all of your data to the cloud is not necessary in order to use cloud compute for an individual application’s workload. In fact, you don’t need to move large data sets at all. Cloud caching filers can often take on the data required to run each job, putting the data migration portion all onto this caching appliance."The post Moving HPC Workloads to the Cloud with Avere Systems at SC17 appeared first on insideHPC.

"InfiniBand being the preferred interconnect for new HPC systems shows the increasing demand for the performance it can deliver. Its place at #1 and #4 are excellent examples of that performance,” said Bill Lee, IBTA Marketing Working Group Co-Chair. “Besides of delivering world-leading performance and scalability, InfiniBand guarantees backward and forward compatibility, ensuring users highest return on investment and future proofing their data centers.”The post InfiniBand Accelerates 77 Percent of New HPC Systems on the TOP500 appeared first on insideHPC.

"Are you operating a small to medium sized HPC Center? Interested in how others are managing their resources with open source tools and low risk/low overhead hardware? Questions about academic service centers and cost recovery models? Or just want to talk shop with other admins and center managers? This the the session for you! Come visit with Steve and Gowtham, they’re in the trenches with you, always on the lookout for innovative and interest ways of managing resources and sharing their experiences along the way. We’re open to discussing anything HPC for the rest of us!"The post Video: Share your know-how with “HPC for the Rest of Us” appeared first on insideHPC.

Today DDN announced that the Oakforest-PACS system JCAHPC in Japan, which uses DDN’s Infinite Memory Engine (IME), has been named the first annual IO500 winner. "The goal of the IO500 is to create a suite of I/O benchmarks that allow comparison of storage systems and is similar in concept to the Top500 for computing systems. Storage systems are ranked according to the combination of a set of I/O benchmarks that are designed to represent a mix of applications and real-world workloads."The post JCAHPC in Japan Wins Inaugural IO500 Award with help from DDN appeared first on insideHPC.

Last week at SC17, Nallatech showcased their FPGA solutions for high-performance computing, low latency network acceleration, and data analytics. "FPGAs are being deployed in volume across a range of on-premise platforms and cloud infrastructure to achieve a step-change in application performance and energy-efficiency above and beyond what can be achieved using conventional processor technologies” said Craig Petrie, VP Business Development of FPGA Solutions at Nallatech. “We’re excited to be showcasing our new OpenCL-programmable ‘520’ product range featuring Intel Stratix-10 FPGAs. These server-qualified accelerator products have been engineered to cost-effectively solve demanding co-processing and real-time data ingest and enrichment applications."The post Nallatech Showcases Next Generation FPGA Accelerators at SC17 appeared first on insideHPC.

Last week at SC17, SkyScale announced its partnership with Rescale, the foremost cloud simulation and HPC solution provider, and availability of NVIDIA Tesla V100 GPU accelerators on its GPU as a Service cloud platform. Enhancing SkyScale’s dedicated, cloud-based ultra-fast multi-GPU platforms for deep learning and HPC applications, the Tesla V100 offers the performance of 100 CPUs in a single GPU—enabling data scientists, researchers, and engineers to tackle the most difficult deep learning and HPC challenges.The post SkyScale HPC Cloud steps up with Volta GPUs appeared first on insideHPC.