High-Performance Computing News Analysis | insideHPC

Intel recently released BigDL. It’s an open source, highly optimized, distributed, deep learning framework for Apache Spark*. It makes Hadoop/Spark into a unified platform for data storage, data processing and mining, feature engineering, traditional machine learning, and deep learning workloads, resulting in better economy of scale, higher resource utilization, ease of use/development, and better TCO.The post Deep Learning Open Source Framework Optimized on Apache Spark* appeared first on insideHPC.

In this video, Steve Conway from Hyperion Research provides a summary of the ISC High Performance Conference in Frankfurt, Germany. "The ISC High Performance conference attracted 3,505 attendees from over 60 countries, as well as 162 companies and research organizations to unveil their latest technologies and services at the event. With this feat, ISC High Performance has officially reached a new milestone in its 33-year conference history."The post Video Highlights from ISC 2018 appeared first on insideHPC.

Princeton’s new flagship TIGER supercomputer is now up and running at their High-Performance Computing Research Center (HPCRC). As a hybrid system, TIGER is built from a combination of Intel Skylake chips and NVIDIA Pascal P100 GPUs, adding up to a peak performance of 2.67 Petaflops peak performance. "Computation has become an indispensable tool in accomplishing that mission,” Dominick said. “With the newest addition to our High-Performance Computing suite, Princeton continues to equip its faculty with the most advanced computational tools available. The TIGER cluster, and the remarkable staff that support it, are symbolic of the University’s commitment to sustained excellence.”The post TIGER Supercomputer Spins Up at Princeton appeared first on insideHPC.

Robert Triendl from DDN gave this talk at ISC 2018. "With their new Whamcloud Business Unit, DDN has already brought key Lustre developers on board to accelerate their high performance computing solutions. The acquisition also enables DDN to expand Lustre’s leading position from HPC and Exascale into high growth markets such as analytics, AI and hybrid cloud."The post Video: Whamcloud is Back – Lustre Today and Future appeared first on insideHPC.

Ian Colle from AWS gave this talk at the Univa Breakfast Briefing at ISC 2018. "To demonstrate the unique ability to run very large enterprise HPC clusters and workloads, Univa leveraged AWS to deploy 1,015,022 cores in a single Univa Grid Engine cluster to showcase the advantages of running large-scale electronic design automation (EDA) workloads in the cloud. The cluster was built in approximately 2.5 hours using Navops Launch automation and comprised more than 55,000 AWS instances in 3 availability zones, 16 different instance types and leveraged AWS Spot Fleet technology to maximize the rate at which Amazon EC2 hosts were launched while enabling capacity and costs to be managed according to policy."The post What would you do with a Million cores? appeared first on insideHPC.

We are pleased to report that Mike Bernhardt has joined the membership of the HPC User Forum Steering Committee. Established in 1999, the HPC User Forum has a mission to promote the health of the global HPC industry and address issues of common concern to users. "As an industry veteran, Mike has the experience and connections to help move the HPC User Forum into the Exascale era," said Rich Brueckner, President of insideHPC. "Mike is one of the nicest people in the business and I think this is a real step forward for the Steering Committee."The post Mike Bernhardt Joins HPC User Forum Steering Committee appeared first on insideHPC.

Storage networks are constantly evolving. From traditional Fibre Channel to IP-based storage networks, each technology has its place in the data center. IP-based storage solutions have two main network topologies to choose from based on the technology and administration requirements. Dedicated storage network topology, shared leaf-spine network, software defined storage, and iSCSI SAN are all supported. Hybrid network architectures are common, but add to the complexity.The post Network Switch Configuration with Dell EMC Ready Nodes appeared first on insideHPC.

The Center for Institutional Research Computing at Washington State University seeks exceptional applicants for the position of High-Performance Computing Systems Administrator. This position will play a vital role in the administration of HPC clusters used by the research community at Washington State University.The post Job of the Week: HPC System Administrator at CIRC in Washington appeared first on insideHPC.

Researchers at Newcastle University are benefitting from a new HPC machine, called Rocket. "Workloads are driving an ever-growing set of data intensive challenges that can only be met with accelerated infrastructure,” said Werner Hofer, Dean of Research & Innovation at Newcastle University. ”Rocket provides the significant memory and fast processing we need for bulky, complex numerical computation. My post-doctoral researcher was able to process half a million CPU hours’ worth of calculations which was not at all possible with our previous processing power.”The post New Rocket Supercomputer Powers HPC at Newcastle University appeared first on insideHPC.

In this video from PASC18 in Basel, Dr. Lukasz Miroslaw from Microsoft describes how the company is helping customers move HPC & Big Compute workloads to the Cloud. "High performance computing, artificial intelligence, and other advanced workloads are increasingly important to companies across all industries. But rapid changes in technology and workloads make it challenging for HPC teams to provide the resources their users need. Microsoft Azure provides one cloud for every HPC workload so that users can get the resources they need when they need them and only pay for what’s used."The post Microsoft Powers the Move to the HPC Cloud at PASC18 appeared first on insideHPC.

"IIT Bombay selected Cray as a partner in extending support in quality education and research programs because of the compelling price/performance and capability that Cray systems deliver,” said John Howarth, vice president of storage at Cray. “The combination of the Cray XC supercomputer and the Cray ClusterStor storage solution enables IIT Bombay to pursue the advanced research that is critical to their strategic discoveries.”The post IIT Bombay deploys Cray XC50 Supercomputer appeared first on insideHPC.

Duncan Poole from NVIDIA gave this talk at the Univa Breakfast Briefing at ISC 2018. "The rise of AI workloads on GPU-enabled systems like RAIDEN in Japan introduces a corresponding and compelling demand for Univa Grid Engine. Aside from being the de facto standard for enterprise-class deployments of shared computational infrastructures for managed HPC and AI workloads, Univa Grid Engine delivers industry-leading integrations with NVIDIA GPUs and Docker containers."The post NVIDIA GPUs Power HPC & AI Workloads in Cloud with Univa appeared first on insideHPC.

In this video from ISC 2018, CoolIT Systems’ Patrick McGinn describes the company's latest energy efficient data center liquid cooling solutions. "As the leading liquid cooling integration partner for OEM server manufacturers, CoolIT showcased liquid-enabled servers from Intel, Dell EMC and HPE. Combined with the broadest range of Coolant Distribution Units, CoolIT and their OEM partners are delivering the most complete and robust liquid cooling solutions to the HPC market."The post Video: CoolIT Systems Enables Liquid Cooled OEM Solutions for HPC and AI Data Centers appeared first on insideHPC.

Today Atos announced the latest version of its Atos Quantum Learning Machine, the "first commercially available and ready-to-use quantum system," capable of simulating up to 41 quantum bits (Qubits). "It also incorporates world-firsts in terms of simulating ‘quantum noise’ in order to make the simulation even more realistic. These advances – combined with our work to develop a quantum accelerator within five years – place Atos and its customers in an ideal position to take advantage of future digital revolutions.”The post Atos Announces New Quantum Simulator with 41 Qubits appeared first on insideHPC.

"Chromodynamics helps us understand our universe. The strong interaction is one of the four forces describing complex phenomena in the evolution of the universe from the quark gluon plasma formed just after the Big Bang at the birth of the cosmos to the formation of neutron stars. The bulk of visible matter in the universe is due to the strong interaction and understanding its properties requires the solution of quantum chromodynamics (QCD)."The post The Colourful Theory: Visible and Invisible Matter in the Universe appeared first on insideHPC.

The is the final entry in a five-part insideHPC series that takes an in-depth look at how machine learning, deep learning and AI are being used in the energy industry. Read on for help determining where and how to adopt machine learning technology in your business.The post Determining Where & How to Adopt Machine Learning Technology appeared first on insideHPC.

In this TACC podcast, Gregg Beckham from NREL and Lee Woodcock from the University of South Florida describe how they are using supercomputers to engineer an enzyme that breaks down plastic. "We used computer simulations to understand how a polymeric ligand like PET would be able to bind to the enzyme," said study co-author Gregg Beckham, a Senior Research Fellow and Group Leader at the US National Renewable Energy Laboratory (NREL). "We also conducted experimental work to show that indeed, the PETase can break down water or soda bottles, industrially relevant PET films, and another plastic, polyethylene furanoate."The post Podcast: Supercomputing New Enzymes for Breaking Down Plastics appeared first on insideHPC.

CFD solution company Numeca International is expanding HPC offerings to run in the cloud and on demand. With help from Advania and the UberCloud, this capability will make it easer for Numeca customers to tackle complex calculations and improve their flexibility to test them on demand, all while providing them with an HPC environment that accelerates their computing capacity. "Until recently it was my firm belief that cloud computing for engineering applications was one of the next big challenges we had to solve," says Professor Charles Hirsch, President and founder of NUMECA International, and a world-renowned expert on Computational Fluid Dynamics. "But when we came across UberCloud's new application HPC container technology and containerized all our CFD software packages, we were surprised about the ease of use and access to any computing system on demand. We were also impressed by the flexibility of Advania to be able to respond to our immediate and future needs, by providing an HPC structure fit to our client's demands.”The post Numeca Migrates CFD to the UberCloud with Advania appeared first on insideHPC.

Alice-Agnes Gabriel gave this talk at the PASC18 conference. "Earthquakes are highly non-linear multiscale problems, encapsulating geometry and rheology of faults within the Earth’s crust torn apart by propagating shear fracture and emanating seismic wave radiation. This talk will focus on using physics-based scenarios, modern numerical methods and hardware specific optimizations to shed light on the dynamics, and severity, of earthquake behavior."The post Unravelling Earthquake Dynamics through Extreme-Scale Multiphysics Simulations appeared first on insideHPC.

Today Green Revolution Cooling announced the company has started doing business as GRC. This rebranding reflects the company’s maturity in delivering data center infrastructure technologies that reduce complexity and save money. Concurrent with this rebranding, the company is also announcing the expansion of its product portfolio to align with the needs of the customer segments it serves.The post Green Revolution Cooling Changes Name to GRC appeared first on insideHPC.

In this video from the Dell EMC HPC Community Meeting, Tim Carroll from Microsoft describes how the company is working with Dell EMC to move AI and HPC workloads to the Cloud. "The performance and scalability of a world-class supercomputing center is now available to everyone, on demand in the cloud. Run your Windows and Linux HPC applications using high performance A8 and A9 compute instances on Azure, and take advantage of a backend network with MPI latency under 3 microseconds and non-blocking 32 Gbps throughput."The post How Microsoft is Moving Forward with HPC in the Cloud appeared first on insideHPC.

Last week at ISC 2018, Cray announced that the new GENCI supercomputer in France is powered by Cray ClusterStor storage systems integrated by Atos. Named after the Nobel Prize-winning French couple, the 9 Petaflop Joliot-Curie system is made up of a BullSequana X1000 system from Atos, which includes Intel Xeon Scalable processors, Intel Xeon Phi processors, and the Cray ClusterStor storage system."The post Cray ClusterStor Powers Joliot-Curie Supercomputer in France appeared first on insideHPC.

In this video from ISC 2018, founding members of the Mousquetaire-Group announce their plans to develop an innovative supercomputer architecture based around modular computing. To be partially funded by the European Commission, the Mousquetaires will build the machine solely with European technologies, including the processor.The post Mousquetaire-Group Announces European Exascale Initiative appeared first on insideHPC.

"The best software tools are fast, reliable and secure, while delivering an open architecture that provides access to best-in-class technology across the whole ecosystem,” said Dr. Bill Nitzberg, CTO for Altair PBS Works. “Altair PBS Professional v18 truly delivers on this vision with a deep set of new features that improve performance, increase utilization, ease administration, and also supports the most promising new solutions in the HPC ecosystem - containers, cloud bursting, the ARM platform, etc. This is a great release.”The post PBS Professional V18 Steps Up with Support for ARM, Containers and more for HPC appeared first on insideHPC.

In this time-lapse video, engineers at the Jülich Supercomputing Centre begin building the new JUWELS supercomputer. "When it comes to developing innovative supercomputer architectures, Europe is about to take the lead. A striking example of this is the new supercomputer that is due to start user operation at the Jülich Supercomputing Centre in the next few days."The post Time-Lapse Video: Building the New JUWELS Supercomputer in Germany appeared first on insideHPC.

The SISSA and ICTP academic centers in Italy are offering an amazing opportunity for Fellowships for the Master in High Performance Computing. SISSA and ICTP host one of the largest HPC facilities in Italy, and this is your chance to boost your career in computational science. "Our aim is to prepare within 12 months of master HPC specialists, which is a fast growing job in either academy and industry settings."The post Job of the Week: Fellowships for the “Master in HPC” Program in Italy appeared first on insideHPC.

Argonne has selected 10 data science and machine learning projects for its Aurora Early Science Program (ESP). Set to be the nation’s first exascale system upon its expected 2021 arrival, Aurora will be capable of performing a quintillion calculations per second. "The Aurora ESP continues the ALCF tradition of delivering science on day one while helping to lay the path for hundreds of future users,” says Tim Williams, Deputy Director of Argonne’s Computational Science Division. “It’s an exciting opportunity for researchers, who get to be among the first people in the world to run code on an exascale system.”The post Aurora Early Science Program Selects Scientific Computing Projects for Exascale appeared first on insideHPC.

This week at ISC 2018, AMD demonstrated its next generation of CPU and GPU technologies, including a first look at: 7nm AMD Radeon Vega GPU products, 12nm 2nd Generation AMD Ryzen Threadripper processors with up to 32 cores, and unprecedented customer adoption of Ryzen and Radeon products in premium OEM devices.The post AMD Takes the gloves off at ISC 2018 appeared first on insideHPC.

The need for high reliability cooling without reducing the rack density to handle high wattage nodes is no easy task. "Asetek’s direct-to-chip liquid cooling provides a distributed cooling architecture to address the full range of heat rejection scenarios. It is based on low pressure, redundant pumps and sealed liquid path cooling within each server node."The post Managed Implementation of Liquid Cooling appeared first on insideHPC.

Object detection and image search is seen as the next big thing when it comes to the search sector. And it’s easy to see why. A new white paper from NVIDIA explores how Bing deployed NVIDIA GPUs and technology to speed up object detection and visual search capabilities.The post Bing Uses NVIDIA GPUs, Tech to Enhance Object Detection and Image Search appeared first on insideHPC.

In this video from ISC 2018, Binay Ackalloor moderates a panel that explores the convergence of AI and HPC. "The next generation of supercomputers will provide scientists and researchers with powerful new tools to accelerate scientific discoveries and drive innovations. Intel is on the forefront of the convergence of artificial intelligence (AI), analytics, simulation and modeling and other HPC workloads that will drive the industry toward the next era in supercomputing."The post Panel Discussion: The Convergence of AI and HPC appeared first on insideHPC.

Dell EMC Microsoft Storage Spaces Direct Ready Nodes are built on Dell EMC PowerEdge servers, which provide the storage density and compute power to maximize the benefits of Storage Spaces Direct. "They leverage the advanced feature sets in Windows Server 2016 Datacenter Edition to deploy a scalable hyper-converged infrastructure solution with Hyper-V and Storage Spaces Direct. And for Microsoft server environments, S2D scales to 16 nodes in a cluster, and is a kernel-loadable module, (with no RDMA iWarp or RoCE needed) which is a low risk approach to implementing an S2D cluster."The post Networking Dell EMC Microsoft Storage Spaces Direct Ready Nodes appeared first on insideHPC.

In this video from ISC 2018, Binay Ackalloor from Intel describes how the company is powering the convergence of AI and HPC. "Artificial intelligence promises to transform more than just the way we do business – it will touch every corner of society. From using image recognition to enhance public security, to giving automated services a human touch with natural language processing, Intel Xeon processors are the foundation of today’s AI and tomorrow’s transformation."The post How Intel is Powering the Convergence of HPC & AI appeared first on insideHPC.

Today Rescale announced new hybrid cloud innovations to enable organizations to extend their fixed on-premise high performance computing systems to the cloud. The majority of the HPC market is highly invested in on-premise infrastructure. However, leading organizations are benefiting from the flexibility, scalability and rapid innovation of the cloud.The post Rescale announces new hybrid innovations to its HPC cloud platform appeared first on insideHPC.

In this video from ISC 2018, Joe Yaworski from Intel describes how the newly announced Intel® Omni-Path fabric, Intel® OPA200 interconnect will speed up HPC and AI applications. "Intel shared at ISC its next-generation Omni-Path Architecture (Intel® OPA200), coming in 2019, which will provide data rate speeds up to 200 Gb/s, doubling the performance of the previous generation. This next-generation fabric will be interoperable and compatible with the current generation of Intel® OPA. Intel® OPA200’s high-performance capabilities and low-latency at scale will provide system architects the ability to scale to tens of thousands of nodes while benefiting from improved total cost of ownership."The post Announcing the next generation of Intel® Omni-Path fabric, Intel® OPA200 appeared first on insideHPC.

Today Atos announced that the company has successfully deployed Tera 1000, the most powerful European general-purpose supercomputer with a computing power of 25 petaflops and a very competitive power consumption of only 4 megawatts. "This spot in the top-500 ranking reflects the successful collaboration between Atos and the CEA, and is one of the best examples of Atos' technological excellence in high-performance computing."The post Atos Powers Tera 1000 Supercomputer appeared first on insideHPC.

Today Penguin Computing announced the availability of the Accelion managed data access platform, a complete, managed file transfer and remote access solution that gives global, cross-functional teams the ability to work with vast amounts of geographically dispersed data and do so with greater speed, security, reliability and accessibility while unifying operations and accelerating collaboration. "For the first time, Penguin Computing customers have the ability to work with remote data at record-setting speeds and mount remote storage and treat it as if it were local, even over high latency network connections. Because data movement is transparent to the application layer, this means that, in many cases, the customer may not need to make any workflow changes between working with local data and working with remote data. This can result in reduced delays in both processing time and time-to-insight."The post Penguin Computing Showcases Accelion managed data access platform appeared first on insideHPC.

In this video from ISC 2018, Jim Jeffers from Intel describes the new Intel Select Solution for Professional Visualization, an easily-deployed, Intel-optimized system reference architecture that is purpose-built to meet the demands of today’s most complex data explosion challenges. ""Visualization is a key component in advanced computing that allows systems to deliver greater insights with faster turnaround when using large-scale data sets."The post Announcing the new Intel Select Solution for Professional Visualization appeared first on insideHPC.

Today NEC Deutschland GmbH and Quobyte announced the deployment of a complete storage solution at HLRS in Germany. The HLRS facility is one of the top 20 supercomputing sites in the world and is amongst the top three in Germany. The facility is used by researchers and industry groups who typically run HPC workloads focused on Computational Fluid Dynamics (CFD), Physics, Transport and Climate, Structural Mechanics, Chemistry, Bioinformatics, and Electrical Engineering.The post NEC and Quobyte Power HPC Storage at HLRS in Germany appeared first on insideHPC.

This is the fourth entry in a five-part insideHPC series that takes an in-depth look at how machine learning, deep learning and AI are being used in the energy industry. Read on to learn more about computing environments options for energy exploration and monitoring.The post Computing Environments Options for Energy Exploration and Monitoring appeared first on insideHPC.

Today Cray rolled out the new Cray Urika-CS AI and Analytics software suite for the Cray CS series and new Cray Accel AI reference configurations to help IT and AI teams. "Today’s organizations are faced with a daunting task: to quickly implement and integrate new applications that take advantage of the latest advancements in Artificial Intelligence,” said Mike Leone, senior analyst at ESG. “Successful AI application deployments require that teams overcome numerous hurdles, including infrastructure complexity and a constantly evolving technology landscape. There's an increasing demand for a simplified way to make AI workflows more efficient and sustainable by leveraging a purpose-built system that simultaneously addresses the integration, performance, and support challenges brought on by AI.”The post Cray AI Workflow Software Suite to Jump-Start AI Deployments appeared first on insideHPC.

Today AMD announced that the National Institute for Nuclear Physics (INFN) in Italy has picked the AMD EPYC 7351 processor to power its high-performance computing cluster. INFN, a leading European research institution, conducts theoretical and experimental research in the fields of subnuclear, nuclear, and astroparticle physics while offering access to its exceptional processing resources across Europe. "As a tier one provider of clustered compute and storage for the largest currently ongoing experiments in physics, INFN delivers access to the massive amount of processing required for advanced research in nuclear physics."The post AMD Epyc Powers HPC at National Institute for Nuclear Physics in Italy appeared first on insideHPC.

To demonstrate the unique ability to run very large enterprise HPC clusters and workloads, Univa leveraged AWS to deploy 1,015,022 cores in a single Univa Grid Engine cluster to showcase the advantages of running large-scale electronic design automation (EDA) workloads in the cloud. The cluster was built in approximately 2.5 hours using Navops Launch automation and comprised more than 55,000 AWS instances in 3 availability zones, 16 different instance types and leveraged AWS Spot Fleet technology to maximize the rate at which Amazon EC2 hosts were launched while enabling capacity and costs to be managed according to policy.The post Univa Deploys Million-core Grid Engine Cluster on AWS appeared first on insideHPC.

Today CoolIT Systems announced the deployment of a new liquid cooled HPC system at Dell EMC HPC and AI Innovation Lab in Round Rock, Texas. "By providing the opportunity to witness liquid cooling in action, Dell EMC allows customers to assess configuration options and performance capabilities before taking the next step to implementation,” said Patrick McGinn, VP Product Marketing & Business Development at CoolIT Systems. “CoolIT is proud to enable PowerEdge servers with liquid cooling to support higher wattage processors for increased performance, energy efficiency and rack-level density in today’s modern data centers.”The post Dell EMC HPC and AI Innovation Lab Moves to Liquid Cooling with CoolIT Systems appeared first on insideHPC.

In this video, Steve Conway from Hyperion Research describes the HPC technology areas that have the greatest potential for growth. "Hyperion Research helps organizations make effective decisions and seize growth opportunities by providing research and recommendations in both high performance computing and emerging technology areas."The post Video: What HPC technology areas have the greatest potential for growth? appeared first on insideHPC.

Leaders, early career women, and researchers in HPC will gather again this year to participate in the Women in High Performance Computing (WHPC) events at ISC High Performance Computing. Networking and training events take place on June 27 and 28th. "Women in HPC continues to focus on addressing the growing deficit between the talent requirements in the HPC sector and the available workforce. Our goal is to help the HPC community improve on their inclusion of women and enhance our collective experiences in HPC careers,” says Dr. Toni Collis, Chair and co-founder of WHPC and Chief Business Development Officer at Appentra Solutions. “We welcome women and their allies to join us. Diversity improves ‘team IQ’ and innovation and is an important facet of ensuring HPC delivers on its potential.”The post Women in HPC Group to host events at ISC 2018 appeared first on insideHPC.

It’s a fascinating time for High Performance Computing. The convergence of AI, analytics, and simulation and modeling is transforming systems and users. "So, there’s a lot to talk about it at ISC 2018, including announcements from Intel on next-generation Intel® Omni-Path Architecture and Intel® Select Solutions for Professional Visualization, to Machine Learning Day with Pradeep Dubey, and demos, presentations, and panel discussions in Intel’s Collaboration Hub."The post See How the Convergence of HPC and AI is Changing Supercomputing at ISC 2018 appeared first on insideHPC.

Today Lenovo announced that the company is now ranked as the leading vendor on the TOP500 list of the world's fastest supercomputers. 117 of the 500 most powerful supercomputers included in the TOP500 are Lenovo installations, meaning nearly one out of every four systems (23.4 percent) on the prestigious list is a Lenovo solution. "Last year, we set a goal to become the world’s largest provider of TOP500 computing systems by 2020. We have reached that goal two years ahead of our original plan,” said Kirk Skaugen, President of Lenovo Data Center Group.The post Lenovo is now #1 vendor of TOP500 Supercomputers appeared first on insideHPC.

Today NVIDIA is highlighting news that the world’s top AI supercomputers on the TOP500 are all powered by the company's Tensor Core GPUs. The new "AI supercomputers" on the list include Summit and Sierra in the USA and the ABCI machine in Japan. "The new TOP500 list clearly shows that GPUs are the path forward for supercomputing in an era when Moore’s Law has ended,” said Ian Buck, vice president and general manager of accelerated computing at NVIDIA.The post NVIDIA Tensor Core GPUs Accelerate World’s Fastest Supercomputers appeared first on insideHPC.