High-Performance Computing News Analysis | insideHPC

As an open source tool designed to navigate large amounts of data, Hadoop continues to find new uses in HPC. Managing a Hadoop cluster is different than managing an HPC cluster, however. It requires mastering some new concepts, but the hardware is basically the same and many Hadoop clusters now include GPUs to facilitate deep learning.The post Planning for the Convergence of HPC and Big Data appeared first on insideHPC.

Thomas Leung from the GE Global Research Center presented this talk at the PBS Works User Group. "The commercial world uses significant HPC resources for simulation and product design. An increasing number of HPC systems are deployed in the commercial space and their scale is getting larger and larger. These advanced systems push limits in every aspect of Enterprise IT. Accommodating such systems within the enterprise is a challenge, and there have been many recent changes to enterprise IT infrastructures and architectures resulting from the need to support HPC."The post HPC Across the Enterprise: How HPC Transforms the Corporate IT Ecosystem appeared first on insideHPC.

Today IEEE announced that Mateo Valero from the Barcelona Supercomputing Center will be the first European researcher to receive the Seymour Cray Award. "As one of the most prestigious honors in high performance computing, the Seymour Cray Award is given to those who exemplify "recognition of innovative contributions in the computer systems of high performance better exemplify the creative spirit of Seymour Cray. Valero is being recognized for his fundamental contributions to the field of vector architectures, super-scalar processors, processors,multithreaded processors and Very Long Instruction Word."The post Mateo Valero will be the first European to Receive the Seymour Cray Award appeared first on insideHPC.

"We figured out a way to get consumer-grade cards into a 4U chassis,” said Nor-Tech’s Vice President of Engineering, Dom Daninger and his team tested and retested the prototype until they were satisfied that their solution would be successful for most applications. “The result is a niche product that allows nearly all organizations to take advantage of GPU supercomputing capabilities—in essence supercomputing capabilities at an unheard of price point.”The post GPUs Power Low-Cost Supercomputer Solution from Nor-Tech appeared first on insideHPC.

PEZY Computing from Japan has earned the top three rankings on the Green500 list, using a 3M Fluorinert Electronic Liquid in an immersive cooling system built by ExaScaler Inc. The Green500 is a biannual ranking of the most energy-efficient supercomputers in the world. The triple win indicates growing progress and adoption in the field of immersion cooling with engineered dielectric fluids and its potential to transform the high performance computing (HPC) industry with step-change improvements in energy efficiency and compute performance.The post PEZY & ExaScaler Step Up on the Green500 List with Immersive Cooling appeared first on insideHPC.

"Intersect360 Research's annual HPC market model and forecast shows modest growth in 2014. Despite ongoing weakness in the public sector, commercial usage of HPC drove the market to $29.4 billion in 2014, a year-over-year growth of 2.8%. As applications for high-performance technologies expand, the market is projected to grow at a compound annual rate of 4.2% through 2019."The post Video: Worldwide HPC Market & 2015-2019 Market Forecast appeared first on insideHPC.

"Historically cyber security in HPC has been limited to detecting intrusions rather than designing security from the beginning in a holistic, layered approach to protect the system. SELinux has provided the needed framework to address cyber security issues for a decade, but the lack of an HPC and data analysis eco-system based on SELinux and the perception that the resulting configuration is “hard” to use has prevented SELinux configurations from being widely accepted. This presentation will discuss the eco-system that has been developed and certified, debunk the “hard” perception, and illustrate approaches for both government and commercial applications."The post SELinux at Lockheed: A New Multi-Level Security Initiative appeared first on insideHPC.

“This talk will focus on programming models and their designs for upcoming exascale systems with millions of processors and accelerators. Current status and future trends of MPI and PGAS (UPC and OpenSHMEM) programming models will be presented. We will discuss challenges in designing runtime environments for these programming models by taking into account support for multi-core, high-performance networks, GPGPUs, Intel MIC, scalable collectives (multi-core-aware, topology-aware, and power-aware), non-blocking collectives using Offload framework, one-sided RMA operations, schemes and architectures for fault-tolerance/fault-resilience.”The post Video: Communication Frameworks for HPC and Big Data appeared first on insideHPC.

Toni Cortés from the Barcelona Supercomputing Center presented this talk at the HPC Advisory Council Spain Conference. "BSC is the National Supercomputing Facility in Spain and was officially constituted in April 2005. BSC-CNS manages MareNostrum, one of the most powerful supercomputers in Europe, located at the Torre Girona chapel. The mission of BSC-CNS is to investigate, develop and manage information technology in order to facilitate scientific progress."The post BSC and Integrating Persistent Data and Parallel Programming Models appeared first on insideHPC.

Substantial challenges loom for the Oil and Gas sector, as problem sizes, resolution requirements and business pressures to reduce computing costs all continue to increase. To address these challenges, suppliers like Intel and NVIDIA are relentlessly increasing the number of cores and threads available in their CPU and GPU/co-processor modules.The post The Increase in Processing Demands of Seismic Computing appeared first on insideHPC.

"A university environment can be a challenge in many ways, with a wide variety of differing demands from more than a hundred different research groups, so how can a High Performance Computing group hope to meet the requirements of everyone? In this presentation I’ll explore some of the drivers for the HPC services we run at Imperial College London and how this maps onto our PBS Professional configuration. My talk will also cover how we use different features of PBS Pro and what advantages and benefits they give to us."The post Video: Imperial College: 30 Million HPC Jobs a Year and Counting appeared first on insideHPC.

"FieldView products and services from Intelligent Light have been specifically developed to help CFD users get more reliable results in less time from their CFD investments. Post-processing can be the most important step in the CFD process -this is where the “pay off” occurs – where you gain insight and make decisions. Yet it is often overlooked when planning effective CFD workflows."The post Intelligent Light: Breaking the Disk IO Bottleneck in CFD by Eliminating It appeared first on insideHPC.

Cloud computing is another tool that is helping the wind power sector up its game. "We are seeing movement from most engineering companies to cloud computing as the economics are better and the security of the cloud has improved. Additionally, massive amounts of resources are available cheaply and bandwidth has increased to match the needs of the wind power simulation space."The post Boosting Wind Power with Cloud Computing appeared first on insideHPC.

Today Mellanox announced that the HPC4Health Consortium, led by The Hospital for Sick Children (SickKids) and the University Health Network's Princess Margaret Cancer Centre, has selected its InfiniBand networking solutions to improve patient care and help researchers to optimize treatment with the ultimate goal of finding a cure for cancer. The end-to-end FDR 56Gb/s InfiniBand networking solution was adopted as the foundation of the center’s cancer and genomics program, to accelerate the sharing, processing and analysis of data generated from radiology imaging, medical imaging analysis, protein folding, x-ray diffraction in order to improve patient care and expedite cancer research.The post HPC4Health Selects Mellanox InfiniBand for Cancer and Genomics Research appeared first on insideHPC.

In this video from the Disruptive Technologies Panel at the HPC User Forum, Peter Braam from Cambridge University presents: Processing 1 EB per Day for the SKA Radio Telescope. "The Square Kilometre Array is an international effort to investigate and develop technologies which will enable us to build an enormous radio astronomy telescope with a million square meters of collecting area."The post Video: Processing 1 Exabyte per Day for the SKA Radio Telescope appeared first on insideHPC.

In this video (with transcript) from the 2015 HPC User Forum in Broomfield, Bob Sorenson from IDC moderates a User Agency panel discussion on the NSCI initiative. "You all have seen that usable statement inside the NSCI, and we are all about trying to figure out how to make usable machines. That is a key critical component as far, as we're concerned. But the thing that I think we're really seeing, we talked about the fact that a single thread performance is not increasing, and so what we're doing is we're simply increasing the parallelism and then the physics limitations, if you will, of how you cool and distribute power among the parts that are there. That really is leading to a paradigm shift from something that's based on how fast you can crunch the numbers to how fast you can feed the chips with data. It's really that paradigm shift, I think, more than anything else that's really going to change the way that we have to do our computing."The post User Agency Panel Discussion on the NSCI Initiative appeared first on insideHPC.

"A university environment can be a challenge in many ways, with a wide variety of differing demands from more than a hundred different research groups, so how can a High Performance Computing group hope to meet the requirements of everyone? In this presentation I’ll explore some of the drivers for the HPC services we run at Imperial College London and how this maps onto our PBS Professional configuration. My talk will also cover how we use different features of PBS Pro and what advantages and benefits they give to us."The post Video: PBS and Scheduling at NCI – The past, present and future appeared first on insideHPC.

Linding Lab at the University of Copenhagen used an SGI UV system to discover how genetic diseases such as cancer systematically attack the networks controlling human cells. By developing advanced algorithms to integrate data from quantitative mass-spectrometry and next generation sequencing of tumor samples, the UCPH researchers have been able to uncover cancer related changes to phospho-signaling networks at a global scale. The studies are some of the early results of the strategic collaboration between SGI and the Linding Lab at UCPH. The landmark findings have been published in two back-to-back papers in today's Cell journal.The post SGI UV Helps Decode How Mutations Rewire Cancer Cells appeared first on insideHPC.

BAE Systems in Salt Lake City is seeking an HPC Administrator in our Job of the Week.The post Job of the Week: HPC Systems Administrator at BAE Systems appeared first on insideHPC.

Today Oak Ridge announced approval of a project run ParallelWare from Appentra on the Titan Supercomputer. The project includes an allocation of 50,000 core hours on supercomputer. "ParallelWare is an source-to-source parallelizing compiler for sequential scientific programs. ParallelWare automatically discovers the parallelism available int he input sequential C code, and automatically generates parallel-equivalent C code annotated with OpenMP compiler directives.The post Oak Ridge to Run ParallWare on Titan appeared first on insideHPC.

Today IBM announced that Online, a leading managed service provider in France, has selected IBM Power Systems to extend its service capabilities for customers who want to increase the performance of their bare metal servers in the cloud.The post IBM Power Systems Speed Online’s Bare Metal Cloud Environment appeared first on insideHPC.

The SC15 conference has asked us to reach out to our readers and encourage you to sign up for this year's Mentor-Protégé Program. It's as easy as checking a box when you register for the conference.The post Sign up to Mentor a Student at SC15 appeared first on insideHPC.

CoolIT Systems made the 2015 PROFIT 500 list with five-year revenue growth of 578% and ranked 20th overall in the Information Technology sector.The post CoolIT Systems Named as one of Canada’s fastest-Growing Companies on the 2015 PROFIT 500 appeared first on insideHPC.

Last week, SC15 announced that Diane Bryant, senior vice president and general manager of Intel’s Data Center Group, has been selected as the HPC Matters plenary speaker. Recently named as one of Fortune’s Most Powerful Women, Bryant offers her perspectives on high performance computing, U.S. competitiveness, and the goal of reaching Exascale.The post Intel’s Diane Bryant Describes Pathways to Exascale appeared first on insideHPC.

Lawrence Livermore National Laboratory (LLNL) and the Rensselaer Polytechnic Institute will combine decades of expertise to help American industry and businesses expand use of high performance computing under a recently signed memorandum of understanding.The post LLNL & Rensselaer Polytechnic to Promote Industrial HPC appeared first on insideHPC.

Satoshi Matsuoka gave this talk at the PBS Works User Group this week. "The Tokyo Tech. TSUBAME2 supercomputer is one of the world’s leading supercomputer, ranked as high as #4 in the world on the Top500 and recognized as the “greenest supercomputer in the world” on the Green 500. With the GPU upgrade in 2013, it still sustains high performance (5.7 Petaflops Peak) and high usage (nearly 2000 registered users). However, such performance levels have been achieved with pioneering adoption of latest technologies such as GPUs and SSDs that necessitated non-traditional strategies in resource scheduling."The post TSUBAME2: How to Manage a Large GPU-Based Heterogeneous Supercomputer appeared first on insideHPC.

"Two components of ITAC, the Intel Trace Collector and the Intel Trace Analyzer can be used to understand the performance and bottlenecks of a Monte Carlo simulation. When each of the strike prices are distributed to both the Intel Xeon cores the Intel Xeon Phi coprocessor, the efficiency was about 79%, as the coprocessors can calculate the results much faster than the main CPU cores."The post Heterogeneous MPI Application Optimization appeared first on insideHPC.

Pointwise, a software company specializing in grid generation and pre-processing software for computational fluid dynamics (CFD), has been awarded a two-year, $1.2 million contract from the US Air Force Materiel Command, part of the Arnold Engineering Development Complex (AEDC), located at Arnold Air Force Base, Tennessee.The post US Air Force Awards Pointwise $1.2 Million CFD Contract appeared first on insideHPC.

Massive amounts of computing power and data are needed for effective and efficient processing for many areas that are considered in the Life Science domain. From drug design to genomic sequencing and risk analysis , many workflows require that the tools and processes be in place so that entire organizations are more effective.The post IBM Platform Computing Solutions for Life Sciences appeared first on insideHPC.

Today IPSJ, Japan's largest IT society honored Bill Dally from Nvidia with the Funai Achievement Award for his extraordinary achievements in the field of computer science and education. "Dally is the first non-Japanese scientist to receive the award since the first two awards were given out in 2002 to Alan Kay (a pioneer in personal computing) and in 2003 to Marvin Minsky (a pioneer in artificial intelligence)."The post Bill Dally from Nvidia Receives Funai Achievement Award appeared first on insideHPC.

Today Univa announced the Univa Grid Engine Container Edition, which fully incorporates Docker containers into the Univa Grid Engine resource manager. The Container Edition features the unique ability to run containers at scale and blend containers with other workloads and supports heterogeneous applications and technology environments.The post Univa Grid Engine Adds Docker Support appeared first on insideHPC.

In this video from the Disruptive Technologies Session at the 2015 HPC User Forum, Nick New from Optalysis describes the company's optical processing technology. "Optalysys technology uses light, rather than electricity, to perform processor intensive mathematical functions (such as Fourier Transforms) in parallel at incredibly high-speeds and resolutions. It has the potential to provide multi-exascale levels of processing, powered from a standard mains supply. The mission is to deliver a solution that requires several orders of magnitude less power than traditional High Performance Computing architectures."The post Optalysys: Disruptive Optical Processing Technology for HPC appeared first on insideHPC.

Today Spectra Logic announced it is now taking orders for Spectra tape libraries configured with Linear Tape-Open Generation 7 (LTO-7) technology. The combination of LTO-7, the industry-standard for tape technology, and Spectra tape libraries will result in the best storage density available per dollar.The post Spectra Logic to Offer LTO-7 Technology appeared first on insideHPC.

In a perfect world, there would be one version of all compilers, libraries, and profilers. To make things even easier, hardware would never change. However, technology marches forward, and such a world does not exist. Software tool features are updated, bugs are fixed, and performance is increased. Developers need these improvements but at the same time must manage these differences.The post Six Strategies for Maximizing GPU Clusters appeared first on insideHPC.

Today Curtiss-Wright Corporation announced that its Defense Solutions division is collaborating with leading High Performance Computing software vendor Bright Computing to bring its supercomputing software tools to the embedded Aerospace & Defense market as part of Curtiss-Wright’s recently announced OpenHPEC Accelerator Suite of best-in-class software development tools.The post Bright Computing Collaborates on OpenHPEC Accelerator Suite appeared first on insideHPC.

IDC developed a set of cybersecurity case studies of US commercial organizations in order to learn: What security problems they have experienced, changes that they have made to address them, and new underlying security procedures that they are exploring.The post Bob Sorensen from IDC Presents: Best Practices in Private Sector Cyber Security appeared first on insideHPC.

Today Altair announced that its PBS Professional has been chosen to manage workloads for the new Cray supercomputer to be installed at the Bureau of Meteorology (BoM), Australia's national weather, climate and water agency.The post Australian Bureau of Meteorology to Manage Cray Workloads with Altair PBS Pro appeared first on insideHPC.

Today SGI and IT4Innovations national supercomputing center in the Czech Republic announced the deployment of the Salomon supercomputer. With a peak performance of 2 Petaflops, the Salomon supercomputer is twenty times more powerful than its predecessor and is the most powerful supercomputer in Europe running on the Xeon Phi coprocessors.The post Czech Republic Steps Up with 2 Petaflop SGI ICE X Supercomputer appeared first on insideHPC.

For companies looking to test the viability of engineering in the cloud, Altair has teamed with Intel and Amazon Web Services (AWS) to offer an “HPC Challenge” for product design. In a nutshell, the program provides free cycles on AWS for up to 60 days, where users can run compute-intensive jobs for computer-aided engineering (CAE).The post Altair, Intel and Amazon Offer HPC Challenge appeared first on insideHPC.

Today Cray announced that the Swiss National Supercomputing Centre (CSCS) has installed a Cray CS-Storm cluster supercomputer to power the operational numerical weather forecasts run by the Swiss Federal Office of Meteorology and Climatology (MeteoSwiss). This is the first time a GPU-accelerated supercomputer has been used to run production numerical weather models for a major national weather service.The post Swiss CSCS to Power Weather Forecasts with GPUs on Cray CS-Storm appeared first on insideHPC.

Researchers are using the Titan supercomputer to power next-generation subsurface flow simulations. Improved models could benefit carbon sequestration, contaminant transport, and oil recovery research.The post Next-generation Subsurface Flow Simulations on Titan appeared first on insideHPC.

In this video plus transcripts from the 2015 HPC User Forum in Broomfield, Bob Sorensen from IDC moderates a panel discussion on the the National Strategic Computing Initiative (NSCI). "Established by an Executive Order by President Obama, the National Strategic Computing Initiative has a mission to ensure the United States continues leading high performance computing over the coming decades. As part of the effort, NSCI will foster the deployment of exascale supercomputers to take on the nation's Grand Challenges."The post Video: Panel on US Plans for Advancing HPC with NSCI appeared first on insideHPC.

In this video from the 2015 HPC User Forum, Will Koella from the Department of Defense discusses National Strategic Computing Initiative (NSCI). Established by an Executive Order by President Obama, NSCI has a mission to ensure the United States continues leading high performance computing over the coming decades. As part of the effort, NSCI will foster the deployment of exascale supercomputers to take on the nation’s Grand Challenges.The post Transcript: Will Koella from DoD Discusses the NSCI Initiative appeared first on insideHPC.

In this video from the 2015 HPC User Forum, Doug Kothe from Oak Ridge discusses National Strategic Computing Initiative (NSCI). Established by an Executive Order by President Obama, NSCI has a mission to ensure the United States continues leading high performance computing over the coming decades. As part of the effort, NSCI will foster the deployment of exascale supercomputers to take on the nation’s Grand Challenges.The post Transcript: Doug Kothe from Oak Ridge Discusses the NSCI Initiative appeared first on insideHPC.

In this video from the 2015 HPC User Forum, Randy Bryant, from the White House’s Office of Science and Technology Policy (OSTP) discusses National Strategic Computing Initiative (NSCI). Established by an Executive Order by President Obama, NSCI has a mission to ensure the United States continues leading high performance computing over the coming decades. As part of the effort, NSCI will foster the deployment of exascale supercomputers to take on the nation’s Grand Challenges.The post Transcript: Randy Bryant from the White House OSTP Discusses the NSCI Initiative appeared first on insideHPC.

In this video from the 2015 HPC User Forum, Irene Qualters from the National Science Foundation discusses National Strategic Computing Initiative (NSCI). Established by an Executive Order by President Obama, NSCI has a mission to ensure the United States continues leading high performance computing over the coming decades. As part of the effort, NSCI will foster the deployment of exascale supercomputers to take on the nation's Grand Challenges.The post Transcript: Irene Qualters from the NSF Discusses the NSCI Initiative appeared first on insideHPC.

In this special guest feature, Tom Wilkie from Scientific Computing World looks at some issues of life and death that will be discussed at the upcoming ISC Cloud and Big Data conference in Frankfurt.The post ISC Cloud & Big Data: From Banking to Personalized Medicine appeared first on insideHPC.