High-Performance Computing News Analysis | insideHPC

Félix-Antoine Fortin from Compute Canada gave this talk at FOSDEM 2020. "Magic Castle uses the open-source software Terraform and HashiCorp Language (HCL) to define the virtual machines, volumes, and networks that are required to replicate a virtual HPC infrastructure. In this talk, we will give a live demonstration of the creation of a cluster."The post Compute Canada’s Magic Castle: Terraforming the Cloud for HPC appeared first on insideHPC.

The Royal Society Publishing has recently released a special compendium of articles based on a recent scientific discussion meeting with HPC Industry thought leaders. "This issue contains contributions from those who develop and implement numerical algorithms and software libraries – numerical analysts, computer scientists, and high-performance computing researchers - with those who use them in some of today's most challenging applications."The post Compendium of articles published on Numerical Algorithms for HPC Science appeared first on insideHPC.

A novel program at Stanford is finding a second life for used HPC clusters, providing much-needed computational resources for research while giving undergraduate students a chance to learn valuable career skills. To learn more, we caught up with Dellarontay Readus from the Stanford High Performance Computing Center (HPCC).The post Stanford Student Program Gives Supercomputers a Second Life appeared first on insideHPC.

The iRODS Consortium has welcomed KU Leuven as its newest Consortium member. As one of Europe’s oldest universities, Belgium’s KU Leuven boasts a long tradition of ground-breaking research and high quality education. With a new Research Data Management program, the university aims to accelerate science and innovation by enabling scientists to more effectively and efficiently find, access, share, and reuse data. "With a strong history of supporting the management and reuse of scientific data at universities in Europe and around the world, iRODS is well positioned to provide a framework for KU Leuven’s ambitious research data management initiative,” said Jason Coposky, Executive Director, iRODS Consortium. “We are pleased to welcome KU Leuven to the iRODS Consortium and look forward to working with them to guide the development of future capabilities that will benefit their researchers and the broader user community.”The post KU Leuven in Belgium joins iRODS Consortium appeared first on insideHPC.

Felix Abecassis and Jonathan Calmels from NVIDIA gave this talk at FOSDEM 2020. "We will present the challenges in doing distributed deep learning training at scale on shared heterogeneous infrastructure. At NVIDIA, we use containers extensively in our GPU clusters for both HPC and deep learning applications. We love containers for how they simplify software packaging and enable reproducibility without sacrificing performance."The post Distributed HPC Applications with Unprivileged Containers appeared first on insideHPC.

In this TACC podcast, researchers describe how they are using XSEDE supercomputers to run some of the highest resolution simulations ever of galaxy clusters. One really cool thing about simulations is that we know what's going on everywhere inside the simulated box," Butsky said. "We can make some synthetic observations and compare them to what we actually see in absorption spectra and then connect the dots and match the spectra that's observed and try to understand what's really going on in this simulated box."The post Podcast: Simulating Galaxy Clusters with XSEDE Supercomputers appeared first on insideHPC.

D.E. Shaw Research is seeking Systems Administrators for Servers, Clusters and Supercomputers in our Job of the Week. "Our research effort is aimed at achieving major scientific advances in the field of biochemistry and fundamentally transforming the process of drug discovery. Exceptional sysadmins sought to manage systems, storage, and network infrastructure for a New York–based interdisciplinary research group."The post Job of the Week: Systems Administrator at D.E. Shaw Research appeared first on insideHPC.

Immersive cooling vendor GRC has announced a new business collaboration with Avaso, an IT solutions provider with global service delivery and warranty capabilities. Through this collaboration, Avaso will provide installation and maintenance services, as well as offer extended warranty coverage for GRC's ICEraQ, ICEtank, HASHtank, and HASHraQ liquid immersion-cooling systems to customers in 150+ countries. In addition to servicing GRC’s systems, the service extends to the OEM immersed servers as well, enabling a single point of contact for maintenance and warranty related events.The post Avaso to Deliver Worldwide Support for GRC Immersive Cooling appeared first on insideHPC.

Studies have found that men tend to drastically outnumber women at technology conferences, limiting female viewpoints, minimizing women’s contributions to leadership, and exhibiting fewer female role models. At CENIC’s 2020 Conference: The Right Connection, more than one-third of the speakers will be female. "Diversity is good for technology, and CENIC is committed to supporting programs that increase diversity, inclusion, and equity for underrepresented populations in the field of computer networking."The post CENIC 2020 Conference to showcase Growing Contributions of Women in Computer Networking appeared first on insideHPC.

Today Sylabs announced the release of SingularityPRO 3.5, a popular container platform for HPC, supercomputing, and AI. "SingularityPRO 3.5, released January 21st, 2020, brings exciting new features to the long-term professionally supported version of the container platform. Based on the open source 3.5.2 release, SingularityPRO will receive security and bug fixes for 3 years, making it an ideal solution for the business-driven needs of enterprise customers containerizing their compute workloads."The post Sylabs releases SingularityPRO 3.5 appeared first on insideHPC.

In this video, Exascale Computing Project Director Doug Kothe describes how disciplined and tailored project management led to very impressive results in what was likely the most comprehensive independent review of the project to date. "ECP’s products will be robust, production ready, and functional right out of the box; and ECP is driving the sharing of information through regular training not only with ECP participants but also the broader US high-performance computing community to lower barriers to using exascale systems and accelerated architectures in general."The post Interview: Exascale Computing Project Update for 2020 appeared first on insideHPC.

In this podcast, the Radio Free HPC looks at the new ECMWF supercomputer. "This new system will give them roughly 5x more compute power than their current system. The new box is an Atos BullSequana XH2000 fueled by high-end AMD 7742 Epyc processors, which will be the most powerful weather computer in the world. During the conversation we look at the history of ECMWF vendors, discuss the implications on weather forecasts given the power of this new system and the computational difficulties inherent in weather prediction."The post Podcast: AMD to Power New ECMWF Supercomputer for Weather Forecasting appeared first on insideHPC.

Today Eni dedicated its new HPC5 system, the most powerful industrial supercomputer in the world. "HPC5 by Dell Technologies is made up of 1,820 Dell EMC PowerEdge C4140 servers, each with two Intel Gold 6252 24-core processors and four NVIDIA V100 GPU accelerators. The servers are connected through an InfiniBand Mellanox HDR ultra-high-performance network with a speed of 200 Gbit/s and a full non-blocking topology that ensures efficient and direct connection among every server. HPC5 also comes with a high-performance 15-petabyte storage system (200 GB/s aggregate read/write speeds)."The post Eni unveils HPC5 Supercomputer from Dell Technologies appeared first on insideHPC.

Today the Big Compute Conference announced sponsors and speakers for its inaugural event, held February 11-12, 2020 in San Francisco. The two-day conference will feature business leaders and scientists describing how they are transforming their industries with access to unlimited cloud compute. "Big Compute 20 brings together thought leaders in aerospace, automotive, AI, biotech, medical, academic, technology, and chemical industries. In addition to inspiring talks, the event will feature workshops, networking, panels and a hackathon sprint, all focused on the freedom to think big."The post Big Compute 20 Conference Announces Speaker Lineup appeared first on insideHPC.

An international team has completed the most comprehensive study of whole cancer genomes to date, significantly improving our fundamental understanding of cancer and signposting new directions for its diagnosis and treatment. The Barcelona Supercomputing Centre has been involved from the initial stages of this project, and has contributed with the analysis of data, with the design of specific computing solutions for cancer genomics, as well as in the answering of specific questions related to with the biology of tumors.The post BSC Powers Pan-Cancer Project appeared first on insideHPC.

"As researchers seek scalable, high performance methods for storing data, Ceph is a powerful technology that needs to be at the top of their list. Ceph is an open-source software-defined storage platform. While it’s not often in the spotlight, it’s working hard behind the scenes, playing a crucial role in enabling ambitious, world-renowned projects such as CERN’s particle physics research, Immunity Bio’s cancer research, The Human Brain Project, MeerKat radio telescope, and more."The post How Ceph powers exciting research with Open Source appeared first on insideHPC.

Researchers from Rice University have introduced a data-driven framework that formulates extreme weather prediction as a pattern recognition problem, employing state-of-the-art deep learning techniques. "In this paper, we show that with deep learning you can do analog forecasting with very complicated weather data — there's a lot of promise in this approach."The post Deep Learning for Predicting Severe Weather appeared first on insideHPC.

Today Atos announced the completion of its acquisition of Maven Wave, a U.S.-based cloud and technology consulting firm specialized in delivering digital transformation solutions for large enterprises. With this acquisition, Atos reinforces its global leadership in cloud-solutions for applications, data analytics and machine learning in hybrid and multi-cloud platforms. "Together, Maven Wave and Atos create the strongest Google Cloud services portfolio offered anywhere, providing customers proven expertise and knowledge in executing their digital transformation and delivering outstanding experiences to their customers,” commented Maven Wave Founders Brian Farrar, Jason Lee and Jeff Lee.The post Atos completes acquisition of Maven Wave appeared first on insideHPC.

Today Samsung Electronics launched 'Flashbolt,' its third-generation High Bandwidth Memory 2E (HBM2E). The new 16-gigabyte (GB) HBM2E is uniquely suited to maximize HPC systems and help system manufacturers to advance their supercomputers, AI-driven data analytics and state-of-the-art graphics systems in a timely manner. "With the introduction of the highest performing DRAM available today, we are taking a critical step to enhance our role as the leading innovator in the fast-growing premium memory market," said Cheol Choi, executive vice president of Memory Sales & Marketing at Samsung Electronics.The post Samsung Launches Flashbolt High Bandwidth 2E Memory appeared first on insideHPC.

Terrell Russell from iRODS gave this talk at SC19. "The Integrated Rule-Oriented Data System (iRODS) is open source data management software used by research organizations and government agencies worldwide. iRODS is released as a production-level distribution aimed at deployment in mission critical environments. It virtualizes data storage resources, so users can take control of their data, regardless of where and on what device the data is stored."The post Beyond Discoverability: Metadata to Drive Your Data Management appeared first on insideHPC.

Arm's HPC User Group (A-HUG) is transitioning to a fully-fledged community-led organization to better support the Arm ecosystem. The first annual meeting of the community-lead A-HUG will be held March 12-13 in Porto, Portugal. "The A-HUG event will include a hands-on training event and excellent talks covering the broad landscape of early systems & experience, near-term expectations for new hardware, and long term trends for architectures."The post Arm HPC User Group to Host First Annual Meeting in Portugal appeared first on insideHPC.

"Researchers, scientists, and developers are advancing science by accelerating their high performance computing applications on NVIDIA GPUs using specialized libraries, directives, and language-based programming models. From computational science to AI, CUDA-X HPC, OpenACC, and CUDA are GPU-accelerating applications to deliver groundbreaking scientific discoveries. And popular languages like C, C++, Fortran, and Python are being used to develop, optimize, and deploy these applications."The post How NVIDIA Enables Scientific Research for HPC Developers appeared first on insideHPC.

The Deep Learning on Supercomputers workshop has issued its Call for Papers. The event takes place June 25 as part of ISC 2020 in Frankfurt, Germany. "The workshop provides a forum for practitioners working on any and all aspects of DL for scientific research in the High Performance Computing context to present their latest research results and development, deployment, and application experiences. The general theme of this workshop series is the intersection of DL and HPC, while the theme of this particular workshop is centered around the applications of deep learning methods in scientific research: novel uses of deep learning methods, e.g., convolutional neural networks (CNN), recurrent neural networks (RNN), generative adversarial network (GAN), and reinforcement learning (RL), for both natural and social science research, and innovative applications of deep learning in traditional numerical simulation."The post Call for Papers: Deep Learning on Supercomputers workshop appeared first on insideHPC.

Today semiconductor company Tachyum announced today that its Prodigy Processor AI/HPC Reference Design will be used in a supercomputer at an unnamed customer site in 2021. According to the company, the Prodigy processor slated for 2021 delivery "handily outperforms the fastest processors while consuming one-tenth the electrical power, and it is one-third the cost and outperforms GPUs and TPUs on neural net training and inference workloads."The post Tachyum Processor to power 2021 AI/HPC Supercomputer appeared first on insideHPC.

Today Fujitsu announced that it has received an order for an Arm-based supercomputer system from Nagoya University's Information Technology Center. "For the first time in the world, this system will adopt 2,304 nodes of the Fujitsu Supercomputer PRIMEHPC FX1000, which utilizes the technology of the supercomputer Fugaku developed jointly with RIKEN. The sum of the theoretical computational performance of the entire system is 15.88 petaflops, making it one of the highest performing systems in Japan."The post Fujitsu to Deploy Arm-based Supercomputer at Nagoya University appeared first on insideHPC.

In this Let’s Talk Exascale podcast, researchers from the NWChemEx project team describe how they are readying the popular code for Exascale. The NWChemEx team’s most significant success so far has been to scale coupled-cluster calculations to a much larger number of processors. “In NWChem we had the global arrays as a toolkit to be able to build parallel applications.”The post Podcast: Rewriting NWChem for Exascale appeared first on insideHPC.

Researchers at the DIII-D National Fusion Facility achieved a scientific first this month when they used machine learning calculations to automatically prevent fusion plasma disruptions in real time, while simultaneously optimizing the plasma for peak performance. The new experiments are the first of what they expect to be a wave of research in which machine learning–augmented controls could broaden the understanding of fusion plasmas. The work may also help deliver reliable, peak performance operation of future fusion reactors.The post DIII-D Researchers Use Machine Learning to Steer Fusion Plasmas appeared first on insideHPC.

Frank McQuillan from Pivotal gave this talk at FOSDEM 2020. "In this session we will present an efficient way to train many deep learning model configurations at the same time with Greenplum, a free and open source massively parallel database based on PostgreSQL. The implementation involves distributing data to the workers that have GPUs available and hopping model state between those workers, without sacrificing reproducibility or accuracy."The post Efficient Model Selection for Deep Neural Networks on Massively Parallel Processing Databases appeared first on insideHPC.

A new AI reference architecture from vScaler describes how to simplify the configuration and management of software and storage in a cost-effective and easy to use environment. "vScaler – an optimized cloud platform built with AI and Deep Learning workloads in mind – provides you with a production ready environment with integrated Deep Learning application stacks, RDMA accelerated fabric and optimized NVMe storage, eliminating the administrative burden of setting up these complex AI environments manually."The post vScaler Launches AI Reference Architecture appeared first on insideHPC.

In this special guest feature, Molly Presley from the Active Archive Alliance reflects on how the unstructured data storage industry has evolved and the implications for active archives. "We now have software that allows us to extract data from the archive for things like analytics, artificial intelligence, and machine learning, so it adds more value and usability to archived data. And, many of the applications and processes can now be automated through APIs and CLIs to make it easy to automate common tasks and integrate with upstream applications."The post Reflecting on 10 Years of Active Archive appeared first on insideHPC.

Today Altair announced that the 2020 Altair Enlighten Awards is now open for submissions. Presented jointly with the Center for Automotive Research (CAR), the 8th Annual Enlighten Awards were created to acknowledge the world’s best initiatives to reduce vehicle weight and meet emissions targets, inspiring breakthrough innovations to push the industry towards a more sustainable future. "At Altair, when we contemplate the perils of global warming and climate change, we think ‘what can we do to help?’ We believe passionately that our solutions help customers fundamentally rethink and redesign vehicles to reduce weight without reducing performance,” said James Scapa, Altair’s chief executive officer and founder.The post Call for Submissions: 8th Annual Altair Enlighten Awards appeared first on insideHPC.

Tohoku University Medical Megabank Organisation (ToMMo) has demonstrated the world’s first quantum cryptography transmission of whole-genome sequence data in collaboration with Toshiba. The transmission exceeded several hundred gigabytes demonstrating that quantum encryption technology is now capable of large-capacity data transmission, opening up practical applications in genomic medicine and research.The post Researchers transmit genome sequence using quantum cryptography appeared first on insideHPC.

The International Advanced Research Workshop on HPC will return to Cetraro, Italy this summer with a focus on state of the art, emerging disruptive innovations and future scenarios. "The main aim of this workshop is to present and debate advanced topics, open questions, current and future developments, and challenging applications related to advanced high-performance distributed computing and data systems, encompassing implementations ranging from traditional clusters to warehouse-scale data centers, and with architectures including hybrid, multicore, distributed, cloud models, and systems targeted for AI applications."The post International Advanced Research Workshop on HPC Returns to Cetraro June 29 – July 3 appeared first on insideHPC.

A researcher from Queen’s University Belfast has developed an innovative new algorithm that will help make artificial intelligence (AI) fairer and less biased when processing data. "Employing AI techniques directly on raw data results in biased insights, which influence public policy and this could amplify existing disparities. The uptake of fairer AI methods is critical, especially in the public sector, when it comes to such scenarios.”The post New Algorithm to make AI less biased appeared first on insideHPC.

Huihuo Zheng from Argonne National Laboratory gave this talk at ATPESC 2019. "The Argonne Training Program on Extreme-Scale Computing (ATPESC) provides intensive, two weeks of training on the key skills, approaches, and tools to design, implement, and execute computational science and engineering applications on current high-end computing systems and the leadership-class computing systems of the future."The post Video: Data Parallel Deep Learning appeared first on insideHPC.

In this podcast, Anshu Dubey of Argonne National Laboratory describes the Earth and Space Science application portfolio in the Exascale Computing Project (ECP). “By and large, these applications are solving partial differential equations, and so there is that generality,” Dubey said. “Most times, the range of scales is so huge that you cannot resolve every scale, so then you have to do something called subgrid models, which can be very boutique.”The post Podcast: Earth and Space Science for Exascale appeared first on insideHPC.

The Technical University of Denmark (DTU) is seeking a in our PhD scholarship in GPU processing for Super Resolution Ultrasound Imaging in our Job of the Week. "This PhD projects develops real time processing of the acquired data using GPUs. The research is conducted in a truly multi-disciplinary environment consisting of the four academic partners specializing in advanced ultrasound imaging, silicon CMUT probes, animal experiments, and clinical investigations, and the main purpose is to translate the SURE method from a research idea to the clinic."The post Job of the Week: PhD scholarship in GPU processing for Super Resolution Ultrasound Imaging appeared first on insideHPC.

Computer scientists at the University of Waterloo have found a novel approach that significantly improves the storage efficiency and output speed of computer systems. “Since the invention of computers, networks that connect storage servers in any system were rigid and inflexible. FLAIR leverages a new cutting-edge networking technology to build a smart network layer that can find the fastest way to fulfil information retrieval requests. Our evaluation shows that this approach can fulfil requests up to 2.5 times faster, compared to classical designs.”The post New FLAIR Protocol to Speed Computer Networks appeared first on insideHPC.

In this special guest feature, David Fellinger from the iRODS Consortium writes that the secure federation capabilities of iRODS has changed the way that we think of data locality. "Data discovery is one of the primary features of iRODS. A researcher can specify search terms retained in an index that allows other researchers to discover that research work."The post Building a Federated Research Collaborative appeared first on insideHPC.

Today WekaIO announced it closed its 2019 fiscal year with record velocity in revenues. The company grew revenue by 600% compared to 2018 with growth fueled by increasing adoption of NVMe-native storage systems to enable I/O-intensive applications in Artificial Intelligence (AI), life sciences, and financial analysis. “We are the only tier-1, enterprise-grade storage solution capable of delivering epic performance at any scale on premises and on the public cloud, and we will continue to fuel our momentum by hiring for key positions and identifying strategic partnerships.”The post WekaIO picks up steam in the HPC Market appeared first on insideHPC.

Hugh Blemings from the OpenPOWER Foundation gave this talk at the Linux.Conf.au conference. "This session will explain the importance of open hardware and software at all levels of the compute environment - embedded/IoT to desktop to hyperscale systems. From here a brief introduction to OpenPOWER and the OpenPOWER Foundation as well as an update on the ecosystem, the status of the hardware and software stacks in question as well as an overview of some of the OpenPOWER hardware out there."The post Video: Open and High Performance Computing appeared first on insideHPC.

The Exascale Computing Project has published a new report to foster and advance software productivity and sustainability for extreme-scale computational science. The report introduces work by the IDEAS-ECP project, explaining its approach, outcomes, and impact of work in partnership with the ECP and broader computational science community. The DOE Exascale Computing Project (ECP) provides a […]The post ECP Report: Advancing Scientific Productivity through Better Scientific Software appeared first on insideHPC.

Today HPE announced that ALCF will deploy the new Cray ClusterStor E1000 as its parallel storage solution. The new collaboration supports ALCF’s scientific research in areas such as earthquake seismic activity, aerospace turbulence and shock-waves, physical genomics and more. "Our recent introduction of the Cray ClusterStor E1000 is delivering ALCF unmatched scalability and performance to meet next-generation HPC storage needs to support emerging, data-intensive workloads."The post Argonne to Deploy Cray ClusterStor E1000 Storage System for Exascale appeared first on insideHPC.

Today Quantum Computing Inc. announced its Mukai quantum application development platform. Focused on developing novel quantum applications, the Company is leveraging their collective expertise in finance, computing, security, mathematics, and physics to develop commercial applications for the financial, security, and government sectors. "Mukai enables developers to create and deploy practical applications that solve very hard problems today,” said Mike Booth, QCI’s Chief Technology Officer. “We believe this will bring immediate value to potential clients, while also providing a clear path to emerging quantum hardware. As Mukai provides an abstraction layer to the actual computing hardware, a client’s investment in application development today should pay off in two ways, without having to take the hardware platform into consideration.”The post Quantum Computing Inc. Releases Mukai Quantum Development Platform appeared first on insideHPC.

In this podcast, the Radio Free HPC team discuss whether ZFS is ever going to meet its potential. "Henry weighs in on the evolution of ZFS and how his opinion of ZFS has changed over the last decade or so. Both Shahin and Henry feel ZFS is unique and highly useful and that maybe Linus isn’t up on current ZFS capabilities."The post Podcast: The Trouble with ZFS appeared first on insideHPC.

Chelsea Harris from the University of Michigan gave this talk at the CSGF 2019. "I am developing a FLASH hydrodynamics module, SparkJoy, to perform these simulations at high order. These projects are part of a DOE INCITE project to explore progenitor effects on CC SNe and of the DOE SciDAC program "Towards Exascale Astrophysics of Mergers and Supernovae."The post Video: Making Supernovae with Jets appeared first on insideHPC.

Indiana University has launched a Quantum Science and Engineering Center. The new center will investigate possibilities created by the strange properties of quantum theory, particularly the phenomenon known as quantum entanglement. Within the past two decades or so, scientists have realized that entanglement can revolutionize technologies in fields such as cryptography, computing, and the creation of new materials and sensors. These recent developments hold such promise that some refer to them as the start of the "second quantum revolution."The post Indiana University Launches Quantum Science and Engineering Center appeared first on insideHPC.

The HPC Saudi Conference has issued its Call for Papers. Taking place March 17-19 in Riyadh, HPC Saudi enables participants from academia, industry, and government come together to share ideas and experiences, and discuss cooperation and collaboration, to advance the cutting edge in HPC, nationally and beyond. "This is the 10th HPC Saudi event and this year it will focus on the themes related to the convergence of HPC with big data, artificial intelligence (AI), and IoT. A particular focus is to explore the future HPC technologies in the era of ubiquitous smart computing, such as big data analytics leveraging edge, fog, cloud, and distributed computing for low-latency smart sensing and actor applications."The post Call for Papers: HPC Saudi Conference appeared first on insideHPC.

Today Qumulo announced its 2020 data storage predictions. Qumulo’s predictions are guided by the enterprise’s realization that legacy scale-out and scale-up NAS storage solutions were not designed to handle today’s unstructured data volumes, distributed geographies and diverse file types. In 2020, enterprise organizations will focus on their data-driven businesses, rather than on managing their storage.The post Top Data Storage Predictions for 2020 appeared first on insideHPC.

Today Univa announced the general availability of Navops Launch 2.0, its flagship cloud-automation platform, designed to help enterprises simplify the migration of HPC and AI workloads to their choice of cloud. "With 9 out of 10 enterprises transitioning HPC workloads to the cloud, customers need proven solutions that simplify the migration of on-premise workloads to their choice of cloud," said Rob Lalonde, Vice President and General Manager, Cloud, Univa."The post Univa Releases Navops Launch 2.0 for Migrating HPC & AI Workloads to the Cloud appeared first on insideHPC.