ESnet to Increase Network Performance, Reliability with Metropolitan Area Networks
October 8, 2004
Responding to the increasingly data-intensive demands of the scientific community, the U.S. Department of Energy’s (DOE) Energy Sciences Network (ESnet) is implementing a new architecture of connected Metropolitan Area Networks (MAN).
ESnet, which is managed by DOE’s Lawrence Berkeley National Laboratory, is a high-speed network serving thousands of DOE scientists and collaborators worldwide. A pioneer in providing high-bandwidth, reliable connections, ESnet enables researchers at national laboratories, universities and other institutions to communicate with each other using the collaborative capabilities needed to address some of the world's most important scientific challenges. ESnet connects 40 sites nationally and provides high-speed connectivity for DOE collaborations with the U.S. research and education community and collaborations with the international science communities in Europe and Asia.
ESnet’s current architecture consists of a national core network connecting six hubs. The individual sites are connected to the hubs in a single circuit spoke-like fashion. However, for reasons of both reliability and bandwidth, this architecture is insufficient to meet future demands.
Over the past two years, two workshops sponsored by DOE’s Office of Science examined a set of major DOE science disciplines. They determined that the process of science related to computing and communication must change over the next decade in order to make significant progress. Such changes include: using massive amounts of distributed data, coupling multiple simulation components that run at different locations, and accessing, using, and managing computing resources that scattered over much of the globe.
“The network capabilities that address these requirements include high bandwidth connectivity, guaranteed bandwidth services and highly reliable network connectivity,” said Bill Johnston, project manager for ESnet. “We just couldn’t meet these needs with our previous architecture.
“One benefit of the ring structure of the MANs is that it will provide the national labs with redundant access to the network, thus providing substantially increased reliability,” Johnston said. “Additionally, multiple optical channels will allow for ESnet to provide new services identified in the science requirements, in particular guaranteed high bandwidth channels.”
The new MANs, the first of which will be built in the San Francisco Bay Area, will be based on multiple 10 gigabit/second (Gb/s) optical channels (“lambdas”) that provide high-speed access to the ESnet core network. In the long term, the ring structured MANs will be connected by more than one national core network, with each national core connecting to the MANs at different physical locations for increased wide-area reliability, Johnston said.
The San Francisco Bay Area ESnet MAN will be a 10 Gb/s ring and will connect DOE’s Stanford Linear Accelerator (SLAC), Lawrence Berkeley National Laboratory (LBNL), Joint Genome Institute (JGI), National Energy Research Scientific Computing Center (NERSC), the ESnet core network hub in Sunnyvale, Calif., which is run by Qwest Communications International, Inc., and the Level 3 Communications, Inc.’s Sunnyvale site that includes a National Lambda Rail hub with access to DOE’s UltraScience Net.
The San Francisco Bay Area MAN has just received approval and funding from DOE. Engineering and construction should take about six months. This will be followed by six months of testing and integration into the production of ESnet. Some sites will require less construction and will be connected earlier within this time frame.
About Computing Sciences at Berkeley Lab
The Computing Sciences Area at Lawrence Berkeley National Laboratory(Berkeley Lab) provides the computing and networking resources and expertise critical to advancing Department of Energy Office of Science (DOE-SC) research missions: developing new energy sources, improving energy efficiency, developing new materials, and increasing our understanding of ourselves, our world, and our universe. ESnet, the Energy Sciences Network, provides the high-bandwidth, reliable connections that link scientists at 40 DOE research sites to each other and to experimental facilities and supercomputing centers around the country. The National Energy Research Scientific Computing Center (NERSC) powers the discoveries of 7,000-plus scientists at national laboratories and universities. NERSC and ESnet are both Department of Energy Office of Science National User Facilities. The Computational Research Division (CRD) conducts research and development in mathematical modeling and simulation, algorithm design, data storage, management and analysis, computer system architecture and high-performance software implementation.
Berkeley Lab addresses the world's most urgent scientific challenges by advancing sustainable energy, protecting human health, creating new materials, and revealing the origin and fate of the universe. Founded in 1931, Berkeley Lab's scientific expertise has been recognized with 13 Nobel prizes. The University of California manages Berkeley Lab for the DOE’s Office of Science. The DOE Office of Science is the United States' single largest supporter of basic research in the physical sciences and is working to address some of the most pressing challenges of our time. For more information, please visit science.energy.gov.