Guiang, Jonathan and Arora, Aashay and Davila, Diego and Graham, John and Mishin, Dima and Hutton, Thomas and Sfiligoi, Igor and Wuerthwein, Frank and Lehman, Tom and Yang, Xi and Guok, Chin and Newman, Harvey and Balcas, Justas (2022) Integrating End-to-End Exascale SDN into the LHC Data Distribution Cyberinfrastructure. In: PEARC '22: Practice and Experience in Advanced Research Computing. ACM , New York, NY, Art. No. 53. ISBN 978-1-4503-9161-0. https://resolver.caltech.edu/CaltechAUTHORS:20220711-653044000
![]() |
PDF
- Published Version
Creative Commons Attribution. 1MB |
Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20220711-653044000
Abstract
The Compact Muon Solenoid (CMS) experiment at the CERN Large Hadron Collider (LHC) distributes its data by leveraging a diverse array of National Research and Education Networks (NRENs), which CMS is forced to treat as an opaque resource. Consequently, CMS sees highly variable performance that already poses a challenge for operators coordinating the movement of petabytes around the globe. This kind of unpredictability, however, threatens CMS with a logistical nightmare as it barrels towards the High Luminosity LHC (HL-LHC) era in 2030, which is expected to produce roughly 0.5 exabytes of data per year. This paper explores one potential solution to this issue: software-defined networking (SDN). In particular, the prototypical interoperation of SENSE, an SDN product developed by the Energy Sciences Network, with Rucio, the data management software used by the LHC, is outlined. In addition, this paper presents the current progress in bringing these technologies together.
Item Type: | Book Section | ||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Related URLs: |
| ||||||||||||||||||||
ORCID: |
| ||||||||||||||||||||
Additional Information: | © 2022 Owner/Author. This work is licensed under a Creative Commons Attribution International 4.0 License. Online: 8 July 2022. This ongoing work is partially supported by the US National Science Foundation (NSF) Grants OAC-2030508, OAC-1841530, OAC-1836650, MPS-1148698, and PHY-1624356. In addition, the development of SENSE is supported by the US Department of Energy (DOE) Grants DE-SC0015527, DE-SC0015528, DE-SC0016585, and FP-00002494. Finally, this work would not be possible without the significant contributions of collaborators at ESNet, Caltech, and SDSC. | ||||||||||||||||||||
Group: | CMS@Caltech | ||||||||||||||||||||
Funders: |
| ||||||||||||||||||||
Subject Keywords: | exascale, data distribution, software defined networking | ||||||||||||||||||||
DOI: | 10.1145/3491418.3535134 | ||||||||||||||||||||
Record Number: | CaltechAUTHORS:20220711-653044000 | ||||||||||||||||||||
Persistent URL: | https://resolver.caltech.edu/CaltechAUTHORS:20220711-653044000 | ||||||||||||||||||||
Usage Policy: | No commercial reproduction, distribution, display or performance rights in this work are provided. | ||||||||||||||||||||
ID Code: | 115470 | ||||||||||||||||||||
Collection: | CaltechAUTHORS | ||||||||||||||||||||
Deposited By: | George Porter | ||||||||||||||||||||
Deposited On: | 12 Jul 2022 14:07 | ||||||||||||||||||||
Last Modified: | 12 Jul 2022 14:07 |
Repository Staff Only: item control page