A Caltech Library Service

Integrating End-to-End Exascale SDN into the LHC Data Distribution Cyberinfrastructure

Guiang, Jonathan and Arora, Aashay and Davila, Diego and Graham, John and Mishin, Dima and Hutton, Thomas and Sfiligoi, Igor and Wuerthwein, Frank and Lehman, Tom and Yang, Xi and Guok, Chin and Newman, Harvey and Balcas, Justas (2022) Integrating End-to-End Exascale SDN into the LHC Data Distribution Cyberinfrastructure. In: PEARC '22: Practice and Experience in Advanced Research Computing. ACM , New York, NY, Art. No. 53. ISBN 978-1-4503-9161-0.

[img] PDF - Published Version
Creative Commons Attribution.


Use this Persistent URL to link to this item:


The Compact Muon Solenoid (CMS) experiment at the CERN Large Hadron Collider (LHC) distributes its data by leveraging a diverse array of National Research and Education Networks (NRENs), which CMS is forced to treat as an opaque resource. Consequently, CMS sees highly variable performance that already poses a challenge for operators coordinating the movement of petabytes around the globe. This kind of unpredictability, however, threatens CMS with a logistical nightmare as it barrels towards the High Luminosity LHC (HL-LHC) era in 2030, which is expected to produce roughly 0.5 exabytes of data per year. This paper explores one potential solution to this issue: software-defined networking (SDN). In particular, the prototypical interoperation of SENSE, an SDN product developed by the Energy Sciences Network, with Rucio, the data management software used by the LHC, is outlined. In addition, this paper presents the current progress in bringing these technologies together.

Item Type:Book Section
Related URLs:
URLURL TypeDescription
Guiang, Jonathan0000-0002-2155-8260
Arora, Aashay0000-0003-3453-4740
Davila, Diego0000-0002-8664-5154
Hutton, Thomas0000-0002-1969-3121
Sfiligoi, Igor0000-0002-9308-5327
Wuerthwein, Frank0000-0001-5912-6124
Newman, Harvey0000-0003-0964-1480
Balcas, Justas0000-0001-9538-5078
Additional Information:© 2022 Owner/Author. This work is licensed under a Creative Commons Attribution International 4.0 License. Online: 8 July 2022. This ongoing work is partially supported by the US National Science Foundation (NSF) Grants OAC-2030508, OAC-1841530, OAC-1836650, MPS-1148698, and PHY-1624356. In addition, the development of SENSE is supported by the US Department of Energy (DOE) Grants DE-SC0015527, DE-SC0015528, DE-SC0016585, and FP-00002494. Finally, this work would not be possible without the significant contributions of collaborators at ESNet, Caltech, and SDSC.
Funding AgencyGrant Number
Department of Energy (DOE)DE-SC0015527
Department of Energy (DOE)DE-SC0015528
Department of Energy (DOE)DE-SC0016585
Department of Energy (DOE)FP-00002494
Subject Keywords:exascale, data distribution, software defined networking
Record Number:CaltechAUTHORS:20220711-653044000
Persistent URL:
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:115470
Deposited By: George Porter
Deposited On:12 Jul 2022 14:07
Last Modified:12 Jul 2022 14:07

Repository Staff Only: item control page