Data Movement Manager (DMM) for the SENSE-Rucio Interoperation Prototype
Creators
Contributors
Abstract
The Data Movement Manager (DMM) is a prototype interface that connects CERN's data management software, Rucio, with the Software-Defined Networking (SDN) service SENSE by ESnet. It enables SDN-enabled highenergy physics data flows using the existing worldwide LHC computing grid infrastructure. A key feature of DMM is transfer-priority-based bandwidth allocation, optimizing network usage. Additionally, it provides fine-grained monitoring of underperforming flows by leveraging end-to-end data flow monitoring. This is achieved through access to host-level (network interface) throughput metrics and transfer-tool (FTS) data transfer job-level metrics. This paper details the design and implementation of DMM.
Copyright and License
© The Authors, published by EDP Sciences, 2025. This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Acknowledgement
This ongoing work is partially supported by the US National Science Foundation (NSF) Grants OAC-1841530, OAC-1836650, PHY-2323298 and PHY-1624356. In addition, the development of SENSE is supported by the US Department of Energy (DOE) Grants DESC0015527, DE-SC0015528, DE-SC0016585, and FP-00002494. Finally, this work would not be possible without the significant contributions of collaborators at CENIC, ESnet, Caltech, and SDSC.
Files
epjconf_chep2025_01208.pdf
Files
(1.4 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:d7de220bcb542a74a7c389194a477fd0
|
1.4 MB | Preview Download |
Additional details
Related works
- Is new version of
- Discussion Paper: arXiv:2508.00792 (arXiv)
Funding
- National Science Foundation
- OAC-1841530
- National Science Foundation
- OAC-1836650
- National Science Foundation
- PHY-2323298
- National Science Foundation
- PHY-1624356
- United States Department of Energy
- DESC0015527
- United States Department of Energy
- DE-SC0015528
- United States Department of Energy
- DE-SC0016585
- United States Department of Energy
- FP-00002494