Diolkos: improving ethernet throughput through dynamic port selection
Abstract
In large networked systems, a sudden increase in traffic could slowdown the network significantly, impacting network quality for multiple users. We present Diolkos, a system that leverages smart switches to dynamically re-reroute data flows in response to drops in performance. In contrast to other techniques, our tool predicts the future throughput at each port in a switch if a data flow were to be sent through it, and updates which port should be taken to maximize throughput. We use several techniques to predict network switch performance on a software defined network (SDN) mimicking topologies commonly found in datacenters. Experimentally, we demonstrate the effectiveness of choosing a port to send flows through based on predicted performance. We found that using a distributed predictive technique achieves a 24% improvement over using a traditional heuristic technique.
Additional Information
© 2021 Copyright held by the owner/author(s). We thank our collaborators Wenji Wu, Soren Telfer and Michael Jensen for their help in reviewing this paper. We also thank NVIDIA Corporation for their donation of a TITAN Xp GPU used as part of the development of Diolkos. Part of this work was conducted at "iBanks", the AI GPU cluster at Caltech. We acknowledge NVIDIA, SuperMicro and the Kavli Foundation for their support of "iBanks". We acknowledge support from Caltech's Intelligent Quantum Networks and Technologies (INQNET) research program, AT&T's Palo Alto Foundry and funding support from the U.S. Department of Energy's (DOE) Office of Advanced Scientific Computing Research as part of "Integrated End-to-end Performance Prediction and Diagnosis." This work is partially supported by a DOE/HEP QuantISED program grant, QCCFP/Quantum Machine Learning and Quantum Computation Frameworks (QCCFP-QMLQCF) for HEP, Grant No. DE-SC0019219. This work is partially supported by the U.S. DOE, Office of Science, Office of High Energy Physics under Award No. DE-SC0011925 and DE-AC02-07CH11359.Attached Files
Published - 3457388.3458659.pdf
Files
Name | Size | Download all |
---|---|---|
md5:15c04119c463341f694b549c9752f779
|
977.1 kB | Preview Download |
Additional details
- Eprint ID
- 109169
- Resolver ID
- CaltechAUTHORS:20210518-092623444
- Department of Energy (DOE)
- DE-SC0019219
- Department of Energy (DOE)
- DE-SC0011925
- Department of Energy (DOE)
- DE-AC02-07CH11359
- Created
-
2021-05-19Created from EPrint's datestamp field
- Updated
-
2021-05-19Created from EPrint's last_modified field
- Caltech groups
- INQNET