A-Z Index | Phone Book | Careers

Berkeley Lab Contributes Expertise to New Amazon Web Services Offering

July 13, 2010

Contact: Linda Vu, lvu@lbl.gov , 510-495-2402

CloudComputinggen.jpg

Today Amazon Web Services (AWS) launched Cluster Compute Instances for Amazon EC2, which makes high-bandwidth, low-latency high performance computing (HPC) resources available in a cloud-computing environment. To ensure that the new Amazon EC2 service will be able to handle a gamut of demanding HPC applications ranging from electronic design automation to financial services, Amazon Web Services worked closely with researchers at the Lawrence Berkeley National Laboratory (Berkeley Lab).

"Many scientific research areas require high-throughput, low-latency, interconnected systems where applications can quickly communicate with each other. NERSC has extensive experience in setting up and maintaining these types of high-performance computing systems and we were happy to share this expertise in our collaboration with AWS," says Keith Jackson, a computer scientist in the Advanced Computing for Sciences Department of the Berkeley Lab's Computational Research Division (CRD).

The National Energy Research Scientific Computing Center (NERSC) at the Berkeley Lab is the primary high performance computing facility supporting unclassified scientific research sponsored by the U.S. Department of Energy. NERSC serves approximately 3,000 researchers annually in disciplines ranging from cosmology and climate to chemistry and nanoscience. To ensure that NERSC computing systems can successfully handle the wide range of scientific computing applications required by its users, the center's staff runs a series of comprehensive benchmarks on every new machine procured by the facility. Researchers in NERSC's Software and Programming Group also developed the Integrated Performance Monitoring software (IPM) to measure how well scientific applications perform on these HPC systems. To test the HPC performance of Cluster Compute Instances for Amazon EC2 the Berkeley Lab team applied these same tools to the company's new offering.

"When we applied these tests to the new Cluster Compute Instances for Amazon EC2, we found that the new offering performed 8.5 times faster than the previous Amazon instance types," adds Jackson, who led the Berkeley Lab portion of the collaboration.

Magellan, a Department of Energy project funded by the American Recovery and Reinvestment Act, is investigating whether cloud computing could meet the specialized computing needs of science. As part of this project NERSC experts are looking into the characteristics that are required to support a scientific HPC workload in a cloud computing environment, and are making these findings available to providers. They are also conducting comparative studies to understand how commercial clouds behave and whether they will be beneficial for science research.

In addition to Jackson, two members of the NERSC's Magellan research team contributed to this collaboration with Amazon Web Services, Lavanya Ramakrishnan and Shane Canon. Other Berkeley Lab collaborators include: NERSC's John Shalf, Harvey Wasserman and Nick Wright; Information Technology Division's Krishna Muriki and Qin Yong; and Greg Bell, who is now with the Energy Sciences Network (ESnet).

For more information about our work with Amazon Web Services, please visit:
http://aws.amazon.com/hpc-applications
For more information about Computing Sciences at Berkeley Lab, please visit: www.lbl.gov/cs


About Computing Sciences at Berkeley Lab

The Lawrence Berkeley National Laboratory (Berkeley Lab) Computing Sciences organization provides the computing and networking resources and expertise critical to advancing the Department of Energy's research missions: developing new energy sources, improving energy efficiency, developing new materials and increasing our understanding of ourselves, our world and our universe.

ESnet, the Energy Sciences Network, provides the high-bandwidth, reliable connections that link scientists at 40 DOE research sites to each other and to experimental facilities and supercomputing centers around the country. The National Energy Research Scientific Computing Center (NERSC) powers the discoveries of 6,000 scientists at national laboratories and universities, including those at Berkeley Lab's Computational Research Division (CRD). CRD conducts research and development in mathematical modeling and simulation, algorithm design, data storage, management and analysis, computer system architecture and high-performance software implementation. NERSC and ESnet are DOE Office of Science User Facilities.

Lawrence Berkeley National Laboratory addresses the world's most urgent scientific challenges by advancing sustainable energy, protecting human health, creating new materials, and revealing the origin and fate of the universe. Founded in 1931, Berkeley Lab's scientific expertise has been recognized with 13 Nobel prizes. The University of California manages Berkeley Lab for the DOE’s Office of Science.

DOE’s Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit science.energy.gov.