High-Performance Computing News Analysis | insideHPC

"Using the publicly available software packages in the High-Performance Big Data (HiBD) project, we will provide case studies of the new designs for several Hadoop/Spark/Memcached components and their associated benefits. Through these case studies, we will also examine the interplay between high performance interconnects, storage systems (HDD and SSD), and multi-core platforms to achieve the best solutions for these components."The post Video: Accelerating Big Data Processing with Hadoop, Spark and Memcached appeared first on insideHPC.

EPFL launches Denab: a scalable HPC architecture for researchers and students. "Working with ClusterVision and Intel has proved to be a wise and productive decision for EPFL as we continue to grow our computational capabilities to support our many researchers and students."The post EPFL Unleashes Deneb, a Scalable HPC Architecture for Researchers and Students appeared first on insideHPC.

The main motivation for Multipath RDMA is to support three types of features: Failovers and High Availability Support, Bandwidth Aggregation, and L3 datacenter support.The post Video: Multipath RDMA appeared first on insideHPC.

In this special guest feature, Tom Wilkie from Scientific Computing World reports how the launch of its HPC innovation centre in Stuttgart yesterday shows the company’s commitment to HPC.The post Lenovo Steps Up to HPC appeared first on insideHPC.

"The CMS detector at the Large Hadron Collider at CERN underwent a replacement of its data acquisition network to be able to process the increased data rate expected in the coming years. We will present the architecture of the system and discuss the design of its layers which are based on Infiniband as well as 10 and 40 GBit/s Ethernet."The post High Throughput Data Acquisition at the CMS experiment at CERN appeared first on insideHPC.

Researchers using the JUQUEEN supercomputer have computed the small mass difference between protons and neutrons. The fact that the neutron is slightly more massive than the proton is the reason why atomic nuclei have exactly those properties that make our world and ultimately our existence possible. The fact that the neutron is slightly more massive […]The post Supercomputing the Mass Difference of Neutron and Protons appeared first on insideHPC.

I'm on my way home from a series of Springtime HPC conferences with boatload of new videos and interviews on the latest in high performance computing. Here are some notable items that may have not made it to the front page.The post HPC News Roundup for March 27, 2015 appeared first on insideHPC.

"The drive toward exascale computing, a renewed emphasis on data-centric processing, energy efficiency concerns, and the limitations of memory and I/O performance are all working to reshape High Performance Computing platforms. Many-core accelerators, flash storage, 3D memory, integrated networking, and optical interconnects are just some of the technologies propelling these future architectures. In concert with those developments, the HPC vendor landscape has been churning in response to broader market forces, and these events are going to drive some interesting changes in the coming year."The post HPC Market Update from Intersect360 Research appeared first on insideHPC.

In this video from the 2015 HPC Advisory Council Switzerland Conference, Oded Paz presents: Special Training Session for HPC Systems Managers and Users: EDR InfiniBand, Multicast Operations (setup flow and diagnostic tools), Traffic Load Balancing, InfiniBand Quality Of Service, System Debugging, and open Q&A.The post Video: Special Training Session for HPC Systems Managers and Users appeared first on insideHPC.

Solving Navier-Sokes equations are popular because they describe the physics of in a number of areas of interest to scientists and engineers. By solving these equations, the flow velocity can be calculated, and then other quantities of interest, such as pressure or temperature may be determined.The post Optimizing Navier-Stokes Equations appeared first on insideHPC.

"The DDN Infinite Memory Engine (IME) unleashes a new I/O provisioning paradigm. This breakthrough, software defined storage application introduces a whole new new tier of transparent, extendable, non-volatile memory (NVM), that provides game-changing latency reduction and greater bandwidth and IOPS performance for the next generation of performance hungry scientific, analytic and big data applications – all while offering significantly greater economic and operational efficiency than today’s traditional disk-based and all flash array storage approaches that are currently used to scale performance."The post Video: Application Experiences on DDN’s IME Burst Buffer appeared first on insideHPC.

"The use of GPUs to accelerate applications is mainstream nowadays, but their adoption in cur- rent clusters presents several drawbacks. In this talk we present the last developments of the rCUDA remote GPU virtualization framework, which is the only one supporting the most recent CUDA version, in addition to leverage the InfiniBand fabric for the sake of performance."The post Video: Increasing Cluster Throughput while Reducing Energy Consumption for GPU Workloads appeared first on insideHPC.

The PDT team – a proprietary quantitative investment manager – is seeking a highly-talented senior HPC engineer. The Senior GRID Engineer will be a primary point of contact for the research teams using the GRID and will interface closely with the entire UNIX engineering group, senior software developers, vendors and the in-house monitoring team.The post Job of the Week: Senior HPC GRID Engineer at PDT Partners appeared first on insideHPC.

"As we see Moore’s Law alive and well, more and more parallelism is introduced into all computing platforms and on all levels of integration and programming to achieve higher performance and energy efficiency. We will discuss Multi- and Many-Core solutions for highly parallel workloads with general purpose and energy efficient technologies. We will also touch on the challenges and opportunities for parallel programming models, methodologies and software tools to achieve highly efficient and highly productive parallel applications. At the end we will a brief look towards Exascale computing."The post HPC and Software Modernization appeared first on insideHPC.

Today Lenovo announced the opening of the company’s first global HPC innovation center, offering a permanent R&D and application benchmarking site as well as a new ecosystem of partners that will collaborate on projects to bring the commercial benefits of HPC to a broader spectrum of clients and workloads.The post Lenovo Opens HPC Innovation Center in Stuttgart, Readies SuperMUC Phase 2 appeared first on insideHPC.

In the late 1980s, genomic sequencing began to shift from wet lab work to a computationally intensive science; by end of the 1990s this trend was in full swing. The application of computer science and high performance computing (HPC) to these biological problems became the normal mode of operation for many molecular biologists.The post Going from the Lab to the Data Center appeared first on insideHPC.

"We introduce a high-performance cost-effective network topology called Slim Fly that approaches the theoretically optimal network diameter. Slim Fly is based on graphs that approximate the solution to the degree-diameter problem. We analyze Slim Fly and compare it to both traditional and state-of-the-art networks. Our analysis shows that Slim Fly has significant advantages over other topologies in latency, bandwidth, resiliency, cost, and power consumption."The post Video: Slim Fly – A Cost Effective Low-Diameter Network Topology appeared first on insideHPC.

In an NSF-funded study, a Clemson University team found that universities with locally available supercomputers were more efficient in producing research in critical fields than universities that lacked supercomputers.The post How Supercomputers Give Universities a Competitive Edge appeared first on insideHPC.

In this video from the 2015 OFS Developer’s Workshop, Guy Ailee from Intel presents: Internet of Things & What it Means to Fabrics.The post Internet of Things & What it Means to Fabrics appeared first on insideHPC.

"This talk will focus on programming models and their designs for upcoming exascale systems with millions of processors and accelerators. Current status and future trends of MPI and PGAS (UPC and OpenSHMEM) programming models will be presented. We will discuss challenges in designing runtime environments for these programming models by taking into account support for multi-core, high-performance networks, GPGPUs, Intel MIC, scalable collectives (multi-core-aware, topology-aware, and power-aware), non-blocking collectives using Offload framework, one-sided RMA operations, schemes and architectures for fault-tolerance/fault-resilience.”The post Video: High-Performance and Scalable Designs of Programming Models for Exascale Systems appeared first on insideHPC.

The Open Compute Project, initiated by Facebook as a way to increase computing power while lowering associated costs with hyper-scale computing, has gained a significant industry following. This guide to Open Computing is design to help organizations optimize their HPC environment to achieve higher performance at a lower operating cost.The post insideHPC Guide to Open Computing appeared first on insideHPC.

"The architecture of the ClusterStor product line builds on 25 years of experience with storage systems, Seagate (formerly Xyratex) and Lustre on a parallel open source high performance storage system that is commonly used for scalable computing."The post Video: Lustre Based Enterprise Storage – Tuning Clients for Optimal Performance appeared first on insideHPC.

In this video from the 2015 OFS Developer’s Workshop, Tom Talpey from Microsoft presents: Microsoft Update on RDMA.The post Microsoft Update on RDMA appeared first on insideHPC.

Europe is notorious for its high energy costs. In the first of three articles on energy efficiency in high-performance computing, Tom Wilkie from Scientific Computing World asks if that’s why so much of the initiative appears to be coming from Europe.The post Is Europe Leading the Energy Efficiency Race? appeared first on insideHPC.

"The Swiss National Supercomputing Centre (CSCS) offers a range of computing and storage services to Swiss and international research communities. These services are provisioned by an array of solutions including leading edge Cray XC40 and hybrid XC30 systems, commodity clusters, files systems such as Lustre and site-wide GPFS storage as well as centre-wide Ethernet and InfiniBand networks."The post Video: Dimensioning Data Centre Resiliency at CSCS appeared first on insideHPC.

In this video, Gilad Shainer and Hussein Harake kick off the 2015 HPC Advisory Council Switzerland Conference. The event will focus on High-Performance Computing essentials, new developments and emerging technologies, best practices and hands-on training.The post Video: Welcome to the 2015 HPC Advisory Council Switzerland Conference appeared first on insideHPC.

"Adaptive Routing has been added to the static routing capability available in previous switch families. InfiniBand supports moving traffic via multiple parallel paths. Adaptive routing dynamically and automatically re-routes traffic to alleviate congested ports. In networks where traffic patterns are more predictable, static routing has been shown to produce superior results. The InfiniScale IV architecture provides the best of both static and adaptive routing."The post Video: Adaptive Routing for Scalable Topologies appeared first on insideHPC.

In this video from the HPC Advisory Council Switzerland Conference, Alexander Moskovsky from RSC presents: Leading Energy Efficient Supercomputing to Exascale.The post Video: RSC Technologies – Leading Energy Efficient Supercomputing to Exascale appeared first on insideHPC.

According to comments made at Nvidia’s GPU Technology Conference (GTC) last week, the Pascal, next generation GPU is now just a year away.

In this podcast, Dr. Rudy Tanzi from Harvard Medical School describes his pioneering research in Alzheimer’s disease and how HPC is critical to the path forward. "Dr. Tanzi currently spearheads the Alzheimer’s Genome Project, which recently identified four new AD gene candidates. This achievement was named one of the “Top Ten Medical Breakthroughs of 2008” by Time Magazine."

Watch to get the latest on the Coral supercomputer coming to ORNL. "ORNL’s supercomputing program has grown from humble beginnings to deliver some of the most powerful systems in the world. On the way, it has helped researchers deliver practical breakthroughs and new scientific knowledge in climate, materials, nuclear science, and a wide range of other disciplines."

In this TACC podcast, Klaus Schulten of the University of Illinois at Urbana-Champaign describes the analysis and modeling of the cellulosome bond. The research could boost efforts to develop catalysts for biofuel production from non-food waste plants.

In this video from the 2015 OFS Developer's Workshop, Bernard Metzler presents: Prototyping Byte-Addressable NVM Access.

The Pacific Northwest National Laboratory in Richland, WA is seeking an HPC Research Scientist in our Job of the Week.

This week at the OpenPOWER Summit in San Jose, the OpenPOWER Foundation showed off real hardware for the first time with 13 systems including a a prototype HPC server from IBM and new microprocessor customized for China. Built collaboratively by OpenPOWER members, the new solutions exploit the POWER architecture to provide more choice, customization and performance to customers, including hyperscale data centers.

In this episode, the Radio Free HPC team wraps up the GPU Technology Conference. The theme of the show this year was Deep Learning, a topic that is heating up the market for GPUs with challenges like image recognition and self-driving cars. As a sister conference, the OpenPOWER Summit this week in San Jose showcased the first OpenPower hardware, including a prototype HPC server from IBM that will pave the way to the two IBM/Nvidia/Mellanox Coral supercomputers expected in 2017.

In this video, Tesla does a field test of a software update that will bring powerful auto-steering functionality to its Model S fleet.

In this podcast, Michael Yorba from the Traders Network Radio Show interviews Alex Bouzari, Co-Founder & CEO of DataDirect Networks. Bouzari discusses how DDN helps customers solve their toughest problems.

Ocean modelling is complex from an algorithm standpoint and can require significant amounts of computing power to arrive at a simulation endpoint. However, many of the calculations that are contained in the simulation can be distributed among a cluster of systems and used on shared memory systems as well.

Today Quanta Cloud Technology (QCT) announced plans to build the first x86 CPU-based servers with Nvidia’s NVLink high-speed GPU interconnect technology. "NVLink unlocks the full potential of GPU accelerators by enabling CPUs and GPUs to transfer data at unprecedented speeds,” said Sumit Gupta, general manager of the Accelerated Computing business at NVIDIA. “QCT extends the benefits of NVLink to the x86 ecosystem and gives our customers an easy path to higher levels of enterprise and HPC application performance.”

"Does it matter if women in HPC are clustered in certain areas of work? I think that it does. It is vital in an industry where multi-skilled, interdisciplinary teams are seen as the model of the future that women are not there just to make up the numbers, but are given every support and encouragement in achieving their full potential in whatever roles in HPC teams they feel themselves most suited."

In this video from the 2015 OFS Developer’s Workshop, Sean Hefty from Intel presents: A Taste of OFI OpenFabrics Interfaces.