High-Performance Computing News Analysis | insideHPC

If the keys to health, longevity, and a better overall quality of life are encoded in our individual genetic make-up then few advances in the history of medicine can match the significance and potential impact of the Human Genome Project. Instigated in 1985 and since that time, the race has been centered on dramatically improving the breadth and depth of genomic understanding as well as reducing the costs involved in sequencing, storing, and processing an individual’s genomic information.The post Enabling Personalized Medicine through Genomic Workflow Acceleration appeared first on insideHPC.

"We go to the show for the technology, the engineering, the science, and the math. It’s HPCMatters and STEM. The vendors are showcasing their technology and the science their technology has enabled. The research exhibits are showing how they are contributing to the scientific process with the largest supercomputers that have cool names. That’s what’s so great about SC: It brings together many of the brilliant minds behind these technologies."The post Top 10 Things to Love About HPC and the SC16 Conference appeared first on insideHPC.

In this video from SC16, Dr. Eng Lim Goh from HPE/SGI discusses new trends in HPC Energy Efficiency and Deep Learning. "SGI's leadership in data analytics derives from deep expertise in High Performance Computing and over two decades delivering many of the world's fastest supercomputers. Leveraging this experience and SGI's innovative shared and distributed memory computing solutions for data analytics enables organizations to achieve greater insight, accelerate innovation, and gain competitive advantage."The post Fireside Chat: Dr. Eng Lim Goh on New Trends in HPC Energy Efficiency & Deep Learning appeared first on insideHPC.

"Adaptive Computing is driving up our customers’ productivity by helping them gain true insight into how their resources are being used, how to handle future capacity planning, and the service levels they are delivering to their most critical projects,” says Marty Smuin, CEO of Adaptive Computing. “This latest solution helps deliver the insights that organizations need in order to eliminate waste, avoid unnecessary delays, and make the changes that will align resources to better achieve organizational goals.”The post Adaptive Computing Rolls Out New Reporting & Analytics Tool appeared first on insideHPC.

In this podcast, Jason Stowe from Cycle Computing provides an update on the world of HPC in the Cloud. After that, he describes how the company is augmenting its software capabilities so that more users can take advantage of HPC for their toughest computing challenges. “Our CycleCloud V6 further optimizes what is already unique about its predecessor, bringing unmatched scalability, provisioning, and data management in a secure process. We are extremely pleased to bring V6 to market.”The post Podcast: How Cycle Computing is Riding the Wave of HPC in the Cloud appeared first on insideHPC.

"Real-time-analytics and Big Data environments are extremely demanding and the network is critical in linking together the extra high performance IBM POWER based servers and Tencent Cloud’s massive amounts of data,”said Amir Prescher, Sr. Vice President, Business Development, at Mellanox Technologies. “Tencent Cloud developed an optimized hardware/software platform to achieve new computing records, showing that Mellanox’s 100Gb/s Ethernet technology can deliver total infrastructure efficiency and improves application performance, making them ideal for Big Data applications.”The post Tencent Cloud Breaks World Record for Data Sorting with IBM & Mellanox appeared first on insideHPC.

One of the primary conversations these days in the field of networking is whether it is better to onload network functions onto the CPU or better to offload these functions to the interconnect hardware. "Onloading interconnect technology is easier to build, but the issue becomes the CPU utilization; because the CPU must manage and execute network operations, it has less availability for applications, which is its primary purpose."The post Offloading vs. Onloading: The Case of CPU Utilization appeared first on insideHPC.

Deep learning is one of the hottest topics at SC16. Now, DK Panda and his team at Ohio State University have announced an exciting new High-Performance Deep Learning project that aims to bring HPC technologies to the DL field. "Availability of large data sets like ImageNet and massively parallel computation support in modern HPC devices like NVIDIA GPUs have fueled a renewed interest in Deep Learning (DL) algorithms. This has triggered the development of DL frameworks like Caffe, Torch, TensorFlow, and CNTK. However, most DL frameworks have been limited to a single node. The objective of the HiDL project is to exploit modern HPC technologies and solutions to scale out and accelerate DL frameworks."The post DK Panda Team Launches High-Performance Deep Learning Project appeared first on insideHPC.

This version of COMPSs, available from today, updates the result of the team’s work in the last years on the provision of a set of tools that helps developers to program and execute their applications efficiently on distributed computational infrastructures such as clusters, grids and clouds. COMPSs is a task based programming model known for notably improving the performance of large scale applications by automatically parallelizing their execution.The post BSC Releases COMPSs Version 2.0 at SC16 appeared first on insideHPC.

Today OpenSFS, the nonprofit organization dedicated to the success of the Lustre file system, announced organizational changes to give its users—the researchers and scientists who use Lustre every day—more of a say in how OpenSFS moves forward. "Now the time has come for those who rely most on Lustre—its users—to guide OpenSFS into the future," said Stephen Simms, OpenSFS president and manager, high performance file systems at Indiana University.The post OpenSFS Reinvents Itself with a Focus on Lustre Users appeared first on insideHPC.

Today Appentra Solutions announced that the company will participate in the Emerging Technologies Showcase at SC16. As an HPC startup, Appentra was selected for its Parallware technology, an LLVM-based software technology that assists in the parallelization of scientific codes with OpenMP and OpenACC. "The new Parallware Trainer is a great tool for providing support to parallel programmers on their daily work,” said Xavier Martorell, Parallel Programming Models Group Manager at Barcelona Supercomputing Center.The post Appentra Solutions will be part of SC16 Emerging Technologies Showcase appeared first on insideHPC.

Today the Department of Energy’s Exascale Computing Project (ECP) today announced that it has selected four co-design centers as part of a 4 year, $48 million funding award. The first year is funded at $12 million, and is to be allocated evenly among the four award recipients. “By targeting common patterns of computation and communication, known as “application motifs”, we are confident that these ECP co-design centers will knock down key performance barriers and pave the way for applications to exploit all that capable exascale has to offer.”The post Exascale Computing Project Announces $48 Million to Establish Four Exascale Co-Design Centers appeared first on insideHPC.

“We chose to work with CoolIT Systems because their solutions are modular and robust, and as a result the most flexible and efficient for our situation,” says Keith Vanderlinde, Assistant Professor at the University of Toronto. “With the custom liquid cooling solution, we can drastically reduce CHIME’s energy consumption and squeeze additional processing out of the GPUs.”The post Custom Liquid Cooling to Support Canada’s Largest Radio Telescope appeared first on insideHPC.

Researchers and staff from the U.S. Department of Energy’s national laboratories will showcase some of DOE’s best computing and networking innovations and techniques at SC16 in Salt Lake City. "Computational scientists working for various DOE laboratories have been in involved in the conference since its 1988 beginnings, and this year’s event is no different. Experts from 14 national laboratories will be sharing a booth featuring speakers, presentations, demonstrations, discussions and simulations."The post DOE to Showcase Leadership in HPC at SC16 appeared first on insideHPC.

Intel Omni-Path Architecture (Intel OPA) volume shipments started a mere nine months ago in February of this year, but Intel’s high-speed, low-latency fabric for HPC has covered significant ground around the globe, including integration in HPC deployments making the Top500 list for June 2016. Intel’s fabric makes up 48 percent of installations running 100 Gbps fabrics on the Top500 June list, and they expect a significant increase in Top500 deployments, including one that could end up in the stratosphere among the top ten machines on the list.The post Intel Omni-Path Architecture Fabric, the Choice of Leading HPC Institutions appeared first on insideHPC.

Over at the ARM Connected Community, Darren Cepulis, writes that the popular chip platform is now part of the OpenHPC community. As one of a series of strategic moves, the effort should help bolster ARM as a platform for high performance computing.The post OpenHPC now available on ARM at SC16 appeared first on insideHPC.

To get maximum parallelization for an application, not only must the application be developed to take advantage of multiple cores, but should also have the code in place to keep a number of threads working on each core. A modern processor architecture, such as the Intel Xeon Phi processor, can accommodate at least 4 threads for each core. "On the Intel Xeon Phi processor, each of the threads per core is known as a hyper-thread. In this architecture, all of the threads on a core progress through the pipeline simultaneously, producing results much more quickly than if just one thread was used. The processor decides which thread should progress, based on a number of factors, such as waiting for data from memory, instruction availability, and stalls."The post Maximize Parallelization with Threading On A Core appeared first on insideHPC.

Today the Department of Energy’s Exascale Computing Project (ECP) today announced the selection of 35 software development proposals representing 25 research and academic organizations. “After a lengthy review, we are pleased to announce that we have selected 35 proposals for funding. The funding of these software development projects, following our recent announcement for application development awards, signals the momentum and direction of ECP as we bring together the necessary ecosystem and infrastructure to drive the nation’s exascale imperative.”The post Exascale Computing Project Awards $34 Million for Software Development appeared first on insideHPC.

In this slidecast, Gilad Shainer from Mellanox announces the world’s first HDR 200Gb/s data center interconnect solutions. "These 200Gb/s HDR InfiniBand solutions maintain Mellanox’s generation-ahead leadership while enabling customers and users to leverage an open, standards-based technology that maximizes application performance and scalability while minimizing overall data center total cost of ownership. Mellanox 200Gb/s HDR solutions will become generally available in 2017."The post Slidecast: Mellanox Announces 200Gb/s HDR InfiniBand Solutions appeared first on insideHPC.

With the SC conference returning to Salt Lake City next week, we’d like to share some of the reasons why we think SLC is one of the most underrated American cities.The post Salt Lake City Guide – A Wonder of the West appeared first on insideHPC.

Today StartupHPC posted their final agenda for their Workshop at SC16 in Salt Lake City. StartupHPC is focused on fostering entrepreneurship in high performance computing,” said founding member Shahin Khan of OrionX. “The StartupHPC Summit has a stellar lineup of speakers and thought leaders from the supercomputing community, and now, thanks to a generous sponsorship […]The post Free to Attend: StartupHPC Summit Monday, Nov. 14 in Salt Lake City appeared first on insideHPC.

Today Atos announced Bull Director for HPSS, Data Management software dedicated to High Performance Computing. Bull Director for HPSS optimizes current large scale storage solutions and frees up compute time for users. "In a context of data explosion, storage is often a bottleneck and has a negative impact on application performance. Atos has a long experience of implementing HPSS in challenging environments where long-term data preservation and re-use of massive data sets are key. Our ultimate objective with Bull Director for HPSS and the other future components is to get rid of these bottlenecks and free up compute time for users." explains Eric Eppe, Head of Products and Solutions for extreme computing at Atos.The post Tackling HPC Storage Bottlenecks with Bull Director for HPSS appeared first on insideHPC.

Today ECI announced plans to demonstrate a 400G backbone at SCinet, the world's largest and fastest high-performance network at SC16 in Salt Lake City. "ECI was delighted to receive the invitation to participate in this exciting demonstration for the high performance computing sector. ECI is no stranger to this sector. We provide services to many research and education networks worldwide. Some of our wins include DFN (Germany), Switch (Sweden), GRNet (Greece), and most recently an exciting win at DeIC (Denmark), details of which will be disclosed in the near future," said Tony Gomez, VP of Business Development for ECI in N. America."The post ECI to Demo 400G Optical Backbone on SC16 SCinet appeared first on insideHPC.

"By joining iEnergy, Cray can offer Landmark processing customers access to its high-performance hardware platform to help software users maximize their benefits from the SeisSpace processing system,” said Steve Angelovich, SeisSpace product manager, at Halliburton Landmark. iEnergy members have this opportunity because this online technical community enables its members to work, learn, contribute, and collaborate together. Rekha Patel, ecosystem evangelist at Halliburton Landmark, said, “We welcome Cray as a new iEnergy member and look forward to the synergy between SeisSpace and Cray’s cluster systems.”The post Cray Joins iEnergy Oil & Gas Community appeared first on insideHPC.

In this slidecast, Tony DeVarco from SGI describes how the company delivers Production Supercomputing for SMEs. “As the trusted leader in high performance computing, SGI helps companies find answers to the world’s biggest challenges. Our commitment to innovation is unwavering and focused on delivering market leading solutions in Technical Computing, Big Data Analytics, and Petascale Storage. Our solutions provide unmatched performance, scalability and efficiency for a broad range of customers.”The post Slidecast: How SGI is Meeting Manufacturing’s Need for Production Supercomputing appeared first on insideHPC.

SC16 returns to Salt Lake City this year. And while SLC is known for its gorgeous views of the mountains, what our readers may not know is that Salt Lake City is full of Hip, yes hip restaurants, cafes, bars, and things to see and do. "In this feature from the Print 'n Fly Guide Guide to SC16 in Salt Lake City, we offer you some great restaurant recommendations from the locals. Plus, we'll tell you where to get great cigars, a day at the spa, and more."The post Local’s Guide to Food & Entertainment at SC16 in Salt Lake City appeared first on insideHPC.

With SC16 coming to Salt Lake City, we asked the local's for their top pick for a great dinner place. The winner was Copper Onion. "The restaurant located on busy Broadway (and steps from the convention center) in downtown SLC, is a welcome respite from the city."The post Our Top Recommendation for a Great Dinner at SC16 in Salt Lake City appeared first on insideHPC.

In this special guest feature, Bill Mannel from Hewlett Packard Enterprise writes that upcoming Intel HPC Developer Conference in Salt Lake City is a great opportunity to learn about code modernization for the next generation of high performance computing applications. "As computing systems grow increasingly complex and new architecture designs become mainstream, training developers to write code which runs on future HPC systems will require a collaborative environment and the expertise of the best and brightest in the industry."The post Preparing Developers for Tomorrow’s Systems appeared first on insideHPC.

Today FlyElephant announced a collaboration with HPC HUB, a developer of complex software and hardware solutions in high performance computing. Now entering its second year, FlyElephant is a platform for data scientists, engineers and researchers that accelerates their work and improves their business by automating data science and engineering simulation tasks.The post FlyElephant Collaborates with HPC-HUB for High Performance in the Cloud appeared first on insideHPC.

Today BIOS IT announced plans for their exhibit at SC16 in Salt Lake City. BIOS IT is will be showcasing the latest HPC solutions and services, including their converged cloud platform in partnership with vScaler Ltd. "vScaler gives our clients the ability to deploy and manage HPC environments with on demand parallel file system creation within their own datacenters and when demand dictates, off-premise as well,” Ian Mellett, General Manager at BIOS IT comments.The post BIOS IT Collaborates with vScaler for HPC in the Cloud appeared first on insideHPC.

The ExaFLOW project has announced 3.3 Million Euros of funding for a group of eight organizations to take Europe’s CFD community one step closer to performing simulations in exascale environments.The post ExaFLOW Funds CFD Research for Exascale appeared first on insideHPC.

"CycleCloud has made an impact on a host of use cases - from our recently announced NASA Sub-Saharan carbon-emissions project to needs in the financial sector, manufacturing and life sciences. CycleCloud has saved countless hours overcoming the challenges typically associated with Cloud HPC and brought in real ROI,” said Jason Stowe, CEO, Cycle Computing. “Our CycleCloud V6 further optimizes what is already unique about its predecessor, bringing unmatched scalability, provisioning, and data management in a secure process. We are extremely pleased to bring V6 to market.”The post CycleCloud V6 spins up HPC Clusters in the Cloud appeared first on insideHPC.

“We have taken a flexible and adaptive approach to multi-level security that combines recent community advances with DDN-developed Lustre features to deliver full Lustre isolation, while minimizing the performance impact of the system overhead associated with implementing security,” said Robert Triendl, senior vice president, global sales, marketing and field services, DDN. “This approach lets us customize configurations that meet our customers’ security requirements without them having to sacrifice workflow efficiency.”The post DDN Announces Multi-Level Security Lustre Solution for HPC appeared first on insideHPC.

In this slidecast, Silicon Mechanics CTO Daniel Chow describes how the company brings value and performance to its HPC customers. "When looking for a leading solutions integrator to couple disparate hardware and software products into a “HPC Built For You” solution, that will keep up with the evolution and disruptive forces in technology – the Experts at Silicon Mechanics are here to help you."The post Slidecast: Silicon Mechanics – An Open-Technology Solutions Integrator appeared first on insideHPC.

The OpenACC standards group today announced several major milestones including the addition of new member, the National Supercomputing Center in Wuxi, the adoption of OpenACC by several major HPC applications, the addition of support for new target platforms and expanded implementationThe post OpenACC Gains Momentum in 2016 appeared first on insideHPC.

Attendees of SC16 who are interested in open source data management will have plenty of opportunities to learn about the integrated Rule-Oriented Data System (iRODS) and the new iRODS 4.2, which will be released just in time for the conference.The post iRODS Consortium Plans Busy Week at SC16 appeared first on insideHPC.

The Beowulf Bash returns to Salt Lake City on Monday, Nov 14. As the one party you don't want to miss, the Bash starts at 9pm, right after the SC16 opening gala. "Since its inception the Bash has been consistent about two things: 1) it is held on Monday night after the SC Opening Gala, and 2) most attendees have a darn good time. For almost a decade now the Beowulf Bash invites have come to us with a bit of an edge. We caught up with the two people who create the Beowulf Bash invitations, Lara Kisielewska of Xand McMahon and Doug Eadline of Cluster Monkey, to find out more about these unique invites."The post The 2016 Beowulf Bash Interview: The Story Behind “Beosnark” appeared first on insideHPC.

Today Cray announced the Department of Defense High Performance Computing Modernization Program (HPCMP) has awarded the Company with a $26 million supercomputer contract for a Cray XC40 supercomputer and three Cray Sonexion storage systems.The post DoD Modernization Program to Acquire Cray XC40 appeared first on insideHPC.

In this podcast, the Radio Free HPC team previews the ancillary events around SC16 in Salt Lake City. With a full week in store, this could be the best conference yet. After our event roundup, they share their predictions for SC16 total attendance numbers.The post Radio Free HPC Does the Day-by-Day SC16 Preview Show appeared first on insideHPC.

NVIDIA is a leading provider of GPU accelerators that are used in many High Performance Computing environments. This research paper from Gabriel Consulting Group explains the need for this new generation of hardware in today's data center and looks at what new technologies actual users are looking for.The post GPU Accelerators in Today’s Data Center: Performance & Efficiency appeared first on insideHPC.

Researchers at the Department of Energy’s SLAC National Accelerator Laboratory are playing key roles in two recently funded computing projects with the goal of developing cutting-edge scientific applications for future exascale supercomputers that can perform at least a billion billion computing operations per second – 50 to 100 times more than the most powerful supercomputers in the world today.The post SLAC & Berkeley Researchers Prepare for Exascale appeared first on insideHPC.

Today Atos in Europe announced “Atos Quantum,” an ambitious program to develop quantum computing solutions that offer unprecedented computing power, while enhancing cyber security products to face these new technologies. "Today, taking advantage of our expertise in supercomputers and cyber security, we are fully committed to the second quantum revolution that will disrupt all of our clients' business activities in the coming decades, from medicine to agriculture through finance and industries. It’s a real collective, human and technological adventure that opens up to us. For the one who liked the digital evolution they will love the quantum revolution.”The post “Atos Quantum” Program Launches in Europe appeared first on insideHPC.

NERSC is working with Cray to explore new ways to more efficiently move data in and out of Cori, a powerful supercomputer being constructed in California. "We need to take advantage of a network guru’s design for moving data for a specific experiment but have SDN do all of the bookkeeping for which compute nodes need to be connected to what networks,” said Brent Draney, group lead for the Networking, Servers and Security Group at NERSC. “I would rather see our network engineers analyze the data flow and how to meet the need instead of having to manually reconfigure the network for the demands of each job.”The post Software Defined Networking to Speed Data for Cori Supercomputer appeared first on insideHPC.

A panel of some of the world’s leading experts will come together to discuss this next frontier of healthcare at SC16, the premier international conference showcasing HPC on Nov. 14 in Salt Lake City. “Truly transformative discoveries are happening, and those discoveries are driving powerful shifts in how we combat disease and make people’s lives better.”The post Precision Medicine is Next Frontier in HPC at SC16 appeared first on insideHPC.

The Extreme Science and Engineering Discovery Environment (XSEDE) annual conference is transforming into an independent entity designed to unite the high-performance computing and advanced digital research community. The new Practice & Experience in Advanced Research Computing conference (PEARC) will welcome all who care about using advanced digital services for research. The PEARC17 Conference will take place in New Orleans, Louisiana, July 9-13, 2017.The post XSEDE Conference Morphs into PEARC17 appeared first on insideHPC.

Workshop Papers from ISC 2016 are now available as a free download. "The 21 workshops were held on June 26, 2016 at the Frankfurt Marriott Hotel with over 600 registered attendees, about 170 presentations, and over a dozen panel discussions. These workshops provided a focused, in-depth platform with presentations, discussions, and interaction on topics related to all aspects of research, development, and application of large-scale, high-performance experimental and commercial systems."The post ISC 2016 Workshop Papers Available as Free Download appeared first on insideHPC.

Today LiquidCool Solutions (LCS) announced plans to unveil two new liquid submerged servers at SC16 in Salt Lake City. Based on a clamshell design, the SCS Submerged Cloud Server is a 2U 4-node server designed for Cloud-computing applications. The SGS, Submerged GPU Server, is a 2U dual node server designed for HPC applications that can be equipped with four GPU cards or four Xeon Phi boards. Both servers are completely fanless and require no mechanical refrigeration for cooling.The post LCS to Unveil Immersive-cooled Servers at SC16 appeared first on insideHPC.

"Our new SGI UV 300 capabilities will help us achieve major milestones sooner than predicted,” said Albert Park, senior director, Bioinformatics, AbbVie Stemcentrx. “The new SGI system is able to process larger quantities of data faster than ever and provides us with ease of management. We see significant advantages of having a single OS control our systems, including ease of use, lower power consumption and increased compute power. There’s no price tag for technology that can help discover a drug that will save millions of lives.”The post SGI Powers Cancer Research at AbbVie Stemcentrx appeared first on insideHPC.

'Trading firms in the STAC Benchmark Council designed the STAC-M3 suite to represent a range of performance challenges that are common in financial time-series analysis," said Peter Lankford, Director of STAC. "As data volumes grow and as the query demands from quants, machines, and regulators increase, it is more important than ever for tick database solutions to perform well at scale. Kx's kdb+, running on Dell EMC DSSD D5 and PowerEdge servers, has established performance records while testing on the largest STAC-M3 data scale so far."The post Kx Breaks STAC Benchmark Record with Dell EMC DSSD D5 appeared first on insideHPC.

Are you coming to SC16 in Salt Lake City? As far as transportation goes, SLC has gone through remarkable changes since we last visited at SC12. As you’ll learn in the Print ‘n Fly Guide to SC16 in Salt Lake City, a new light rail system will get you from the airport and all about town. At the same time, we’ll give you great tips to get around the new, unregulated taxi fares that could leave you feeling frustrated.The post Transportation Guide to SC16 in Salt Lake City appeared first on insideHPC.