CaltechAUTHORS
  A Caltech Library Service

DIANA Scheduling Hierarchies for Optimizing Bulk Job Scheduling

Anjum, Ashiq and McClatchey, Richard and Stockinger, Heinz and Ali, Arshad and Willers, Ian and Thomas, Michael and Sagheer, Muhammad and Hasham, Khawar and Alvi, Omer (2006) DIANA Scheduling Hierarchies for Optimizing Bulk Job Scheduling. In: 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06). IEEE , Piscataway, NJ, p. 89. ISBN 0-7695-2734-5. https://resolver.caltech.edu/CaltechAUTHORS:20170427-145030435

[img] PDF - Published Version
See Usage Policy.

340Kb

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20170427-145030435

Abstract

The use of meta-schedulers for resource management in large-scale distributed systems often leads to a hierarchy of schedulers. In this paper, we discuss why existing meta-scheduling hierarchies are sometimes not sufficient for Grid systems due to their inability to re-organise jobs already scheduled locally. Such a job re-organisation is required to adapt to evolving loads which are common in heavily used Grid infrastructures. We propose a peer-topeer scheduling model and evaluate it using case studies and mathematical modelling. We detail the DIANA (Data Intensive and Network Aware) scheduling algorithm and its queue management system for coping with the load distribution and for supporting bulk job scheduling. We demonstrate that such a system is beneficial for dynamic, distributed and self-organizing resource management and can assist in optimizing load or job distribution in complex Grid infrastructures.


Item Type:Book Section
Related URLs:
URLURL TypeDescription
https://doi.org/10.1109/E-SCIENCE.2006.261173DOIArticle
http://ieeexplore.ieee.org/document/4031062/PublisherArticle
Additional Information:© 2006 IEEE.
Record Number:CaltechAUTHORS:20170427-145030435
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20170427-145030435
Official Citation:A. Anjum et al., "DIANA Scheduling Hierarchies for Optimizing Bulk Job Scheduling," 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06), Amsterdam, The Netherlands, 2006, pp. 89-89. doi: 10.1109/E-SCIENCE.2006.261173
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:77022
Collection:CaltechAUTHORS
Deposited By: Kristin Buxton
Deposited On:27 Apr 2017 22:06
Last Modified:03 Oct 2019 17:52

Repository Staff Only: item control page