Published October 7, 2025 | Version Published
Journal Article Open

Data Movement Manager (DMM) for the SENSE-Rucio Interoperation Prototype

  • 1. ROR icon University of California, San Diego
  • 2. ROR icon California Institute of Technology
  • 3. ROR icon Energy Sciences Network

Abstract

The Data Movement Manager (DMM) is a prototype interface that connects CERN's data management software, Rucio, with the Software-Defined Networking (SDN) service SENSE by ESnet. It enables SDN-enabled highenergy physics data flows using the existing worldwide LHC computing grid infrastructure. A key feature of DMM is transfer-priority-based bandwidth allocation, optimizing network usage. Additionally, it provides fine-grained monitoring of underperforming flows by leveraging end-to-end data flow monitoring. This is achieved through access to host-level (network interface) throughput metrics and transfer-tool (FTS) data transfer job-level metrics. This paper details the design and implementation of DMM.

Copyright and License

© The Authors, published by EDP Sciences, 2025. This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Acknowledgement

This ongoing work is partially supported by the US National Science Foundation (NSF) Grants OAC-1841530, OAC-1836650, PHY-2323298 and PHY-1624356. In addition, the development of SENSE is supported by the US Department of Energy (DOE) Grants DESC0015527, DE-SC0015528, DE-SC0016585, and FP-00002494. Finally, this work would not be possible without the significant contributions of collaborators at CENIC, ESnet, Caltech, and SDSC.

Files

epjconf_chep2025_01208.pdf

Files (1.4 MB)

Name Size Download all
md5:d7de220bcb542a74a7c389194a477fd0
1.4 MB Preview Download

Additional details

Related works

Is new version of
Discussion Paper: arXiv:2508.00792 (arXiv)

Funding

National Science Foundation
OAC-1841530
National Science Foundation
OAC-1836650
National Science Foundation
PHY-2323298
National Science Foundation
PHY-1624356
United States Department of Energy
DESC0015527
United States Department of Energy
DE-SC0015528
United States Department of Energy
DE-SC0016585
United States Department of Energy
FP-00002494

Caltech Custom Metadata

Caltech groups
Division of Physics, Mathematics and Astronomy (PMA)
Publication Status
Published