SENSE Takes Software-Defined Networking to the Next Level
November 11, 2019
As part of SC19’s Network Research Exhibition, ESnet will help demonstrate advancements in networked system automation as part of the Software-defined network for End-to-end Networked Science at Exascale (SENSE) project.
In the era of big data driven by exascale computing, cloud computing, machine learning, and artificial intelligence, the SENSE team is building intelligent network services. This system allows scientific applications to manage and schedule network resources in a manner similar to experimental instruments and computing and data storage resources.
SENSE enables the provisioning of multi-domain, multi-resource end-to-end Layer 2 and 3 services including end-site resources such as data transfer nodes (DTN), which are servers in a data center that are optimized for bandwidth and tuned to transfer data efficiently. The SENSE Layer 2 services include deterministic end-to-end resource guarantees and automated DTN private address configuration. The SENSE Layer 3 service provides mechanisms for directing traffic onto a specific Layer 3 Virtual Private Network for policy or quality of service reasons. The system also allows workflow middleware to redirect traffic at granularities of a single flow, a specific end-system, or an entire end-site onto a SENSE provisioned service.
The SENSE team is led by ESnet and includes participants from Fermilab and Argonne National Lab and the National Energy Research Scientific Computing Center at Berkeley Lab, and Caltech and the University of Maryland/Mid-Atlantic Crossroads. The SENSE demonstration at SC19 utilizes a persistent testbed which has been deployed across these participant facilities and adds resources on the exhibit showroom. The SENSE NRE demo is identified as "SC19-NRE-013 – SENSE: Intelligent Network Services for Science Workflows" and will be held in the Caltech booth, #543.
At SC19, the team will demonstrate the new SENSE Layer 3 service and the ability to integrate with domain science workflows and other cyberinfrastructure systems, by interacting with the production provisioning system of ESnet and other regional and site networks. This will include early work and vision for integration of SENSE with the Large Hadron Collider File Transfer Services, DOE Superfacility, BigData Express, and the AutoGOLE – a global scale network-provisioning system using open standards.
The SENSE team is also collaborating with other NRE demonstrations, including the following:
- SC19-NRE-019 - Global Petascale to Exascale Workflows for Data Intensive Science
- SC19-NRE-020 - LHC Multi-Resource, Multi-Domain Orchestration via AutoGOLE, SENSE
- SC19-NRE-011 - BigData Express: A scalable and high-performance data transfer platform
- SC19-NRE-023 - International Data Transfer over AmLight Express and Protect (ExP)
About Computing Sciences at Berkeley Lab
The Computing Sciences Area at Lawrence Berkeley National Laboratory provides the computing and networking resources and expertise critical to advancing Department of Energy Office of Science research missions: developing new energy sources, improving energy efficiency, developing new materials, and increasing our understanding of ourselves, our world, and our universe.
Founded in 1931 on the belief that the biggest scientific challenges are best addressed by teams, Lawrence Berkeley National Laboratory and its scientists have been recognized with 13 Nobel Prizes. Today, Berkeley Lab researchers develop sustainable energy and environmental solutions, create useful new materials, advance the frontiers of computing, and probe the mysteries of life, matter, and the universe. Scientists from around the world rely on the Lab’s facilities for their own discovery science. Berkeley Lab is a multiprogram national laboratory, managed by the University of California for the U.S. Department of Energy’s Office of Science.
DOE’s Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit energy.gov/science.