A-Z Index | Directory | Careers

Perlmutter Debuts in the Top 5 of the Top500

June 29, 2021

By Kathy Kincade
Contact: [email protected]

Permutter condensed final

Just weeks after its official unveiling, the Perlmutter supercomputer at the National Energy Research Scientific Computing Center (NERSC) has earned the number 5 position in the Top500 List with a performance benchmark of 64.6 Pflop/s and is among the top 10 in two other Top500 benchmarks. The announcement was made Monday, June 28 during the ISC21 conference.

Started in 1993, the Top500 project aims to provide a reliable basis for tracking and detecting trends in high performance computing and bases rankings on HPL, a portable implementation of the high-performance LINPACK benchmark. The organization currently oversees three separate benchmarking competitions twice each year: the Top500 List; the High-Performance Conjugate Gradient (HPCG), a challenging alternative metric for assessing supercomputer performance; and the Green500, which measures energy efficiency.

In addition to the Top500 64.6 Pflop/s achievement in this latest round, Perlmutter recorded 1.91 HPCG-petaflops in the HPCG benchmark, earning it the #3 spot on that list; and a power efficiency of 25.55 gigaflops/watt in the Green500, which earned it the #6 spot on that list. It is also notable that these measurements were run using containers and NERSC's Shifter container runtime. Containers enabled various combinations of libraries and builds to be rapidly tested.

“We are pleased to see that Perlmutter is the one system in the top 5 of the Top500 list that is also in the top 10 of the Green500,” said Jay Srinivasan, the NERSC-9 (Perlmutter) project director at NERSC. “The confluence of high performance and power efficiency is a notable achievement.”

While Perlmutter was optimized for NERSC’s broad DOE Office of Science workload and not HPL, “we are very happy with the results, and HPL proved to be a useful stress test for the system,” said NERSC Director Sudip Dosanjh. “The system has also excelled at AI and energy efficiency benchmarks.”

Perlmutter is an HPE Cray EX system being delivered to Lawrence Berkeley National Laboratory (Berkeley Lab) in two phases. Phase 1 features 1,536 GPU-accelerated nodes, each containing four NVIDIA NVlink-connected A100 Tensor Core GPUs and one 3rd Gen AMD EPYC™ processor. Phase 1 also includes a 35 PB all-flash Lustre file system that will provide very high-bandwidth storage. Phase 2, set to arrive later this year, will add 3,072 CPU-only nodes, each with two 3rd Gen AMD EPYC™ processors and 512 GB of memory per node.

This architecture will provide four times the computational power currently available at NERSC and is designed to enhance scientific simulation, data analysis, and artificial intelligence productivity across a multitude of scientific disciplines.

“I'm very happy to hear that Perlmutter has officially been recognized as one of the top supercomputers in the world on two top measures: performance and efficiency,” said Jonathan Carter, Associate Laboratory Director for Computing Sciences at Berkeley Lab.

NERSC is a U.S. Department of Energy Office of Science user facility.

About Computing Sciences at Berkeley Lab

High performance computing plays a critical role in scientific discovery, and researchers increasingly rely on advances in computer science, mathematics, computational science, data science, and large-scale computing and networking to increase our understanding of ourselves, our planet, and our universe. Berkeley Lab’s Computing Sciences Area researches, develops, and deploys new foundations, tools, and technologies to meet these needs and to advance research across a broad range of scientific disciplines.

Founded in 1931 on the belief that the biggest scientific challenges are best addressed by teams, Lawrence Berkeley National Laboratory and its scientists have been recognized with 13 Nobel Prizes. Today, Berkeley Lab researchers develop sustainable energy and environmental solutions, create useful new materials, advance the frontiers of computing, and probe the mysteries of life, matter, and the universe. Scientists from around the world rely on the Lab’s facilities for their own discovery science. Berkeley Lab is a multiprogram national laboratory, managed by the University of California for the U.S. Department of Energy’s Office of Science.

DOE’s Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit energy.gov/science.