IDEAS Goes Big: Fostering Better Software Development for Exascale
September 25, 2017
Scalability of scientific applications is a major focus of the Department of Energy’s Exascale Computing Project (ECP) and in that vein, a project known as IDEAS-ECP, or Interoperable Design of Extreme-scale Application Software, is also being scaled up to deliver insight on software development to the research community.
One channel is a series of webinars on best practices for HPC software developers which began in June. IDEAS-ECP members will also present a half-day tutorial on Better Scientific Software and host a birds-of-a-feather (BOF) session at the SC17 conference in November.
The next webinar, “TAU Performance System,” will be presented by Sameer Shende of the University of Oregon at 1 p.m. Wednesday, November 8 (Eastern). TAU is a powerful profiling and tracing toolkit that covers multiple aspects of performance instrumentation, measurement, and analysis. The webinar is free, but registration is required.
The IDEAS-ECP webinar series debuted with a talk on “Python in HPC” by Rollin Thomas of the National Energy Research Scientific Computing Center (NERSC), at Lawrence Berkeley National Laboratory (Berkeley Lab) in collaboration with William Scullin of Argonne National Laboratory and Matt Belhorn from Oak Ridge National Laboratory. More than 200 people registered for the event and 158 attended.
“At the meeting of ECP principal investigators in January, we noticed from the presentations that a number of the projects use Python, but getting good performance out of Python on highly parallel machines is difficult so we chose that as the topic for our first webinar,” said Berkeley Lab’s Osni Marques, who is the IDEAS-ECP lead for developing webinar content. “Our ultimate goal is to provide strategies for improving productivity and the development of applications, libraries and software.”
The webinars and SC17 tutorial are part of the IDEAS-ECP Outreach effort led by David Bernholdt of Oak Ridge National Laboratory. Bernholdt said that the original IDEAS project grew out of longstanding recognition in the HPC science community that fostering better software development would lead to more productive and sustainable software.
“When ECP was ramping up, people started talking about the need for improved practices as they would need to take a quantum leap to get their software and applications ready for exascale,” Bernholdt said. “So we persuaded them that IDEAS could be valuable for ECP, as well as have even broader impacts.”
Originally funded by DOE’s offices of Advanced Scientific Computing Research and Biological and Environmental Research, IDEAS launched a biweekly series of webinars in 2016, which was a demanding schedule. As part of ECP, the team rebooted the webinars to a more sustainable monthly schedule.
The webinars are announced via an 800-member mailing list and registration is required (and free). Each webinar is also archived for viewing by anyone.
Bernholdt said that the webinars are collaborative, like many of DOE’s research projects. In the case of the session on Python, the three participating labs each handles Python a bit differently and there are many nuances. By being aware of this, attendees will be better informed if they run into a snag.
The team peruses the literature and speaks with researchers are meetings to glean topics of interest for the sessions.
The tutorials are also evolving to meet the needs of researchers. The SC17 tutorial, to be led by Bernholdt, Anshu Dubey of Argonne National Laboratory and Michael A. Heroux and Alicia Klinvex of Sandia National Laboratories, is an evolved version of a tutorial given at the February 2017 SIAM Conference on Computational Science and Engineering. A version of it will also be presented at the PRACE (Partnership for Advanced Computing in Europe) IT4Innovations meeting Oct. 4-5 in Prague.
Bernholdt said the project fills an important niche as software development for both science and HPC are in a different context from mainstream computing and IDEAS tailors its information to the scientific HPC community.
The overall IDEAS-ECP project is led by Mike Heroux of Sandia National Laboratories and Lois Curfman McInnes of Argonne. Ashley Barker of the Oak Ridge Leadership Computing Center is the ECP manager for the project.
To receive announcements of future IDEAS-ECP events, please subscribe to the IDEAS mailing list.
The work was funded through the Department of Energy’s Exascale Computing Project through the Office of Advanced Scientific Computing Research in the DOE Office of Science.
The Office of Science of the U.S. Department of Energy supports Berkeley Lab. The Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit science.energy.gov.
About Computing Sciences at Berkeley Lab
High performance computing plays a critical role in scientific discovery. Researchers increasingly rely on advances in computer science, mathematics, computational science, data science, and large-scale computing and networking to increase our understanding of ourselves, our planet, and our universe. Berkeley Lab’s Computing Sciences Area researches, develops, and deploys new foundations, tools, and technologies to meet these needs and to advance research across a broad range of scientific disciplines.
Founded in 1931 on the belief that the biggest scientific challenges are best addressed by teams, Lawrence Berkeley National Laboratory and its scientists have been recognized with 16 Nobel Prizes. Today, Berkeley Lab researchers develop sustainable energy and environmental solutions, create useful new materials, advance the frontiers of computing, and probe the mysteries of life, matter, and the universe. Scientists from around the world rely on the Lab’s facilities for their own discovery science. Berkeley Lab is a multiprogram national laboratory, managed by the University of California for the U.S. Department of Energy’s Office of Science.
DOE’s Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit energy.gov/science.