CaltechAUTHORS
  A Caltech Library Service

Control-based Scheduling in a Distributed Stream Processing System

Khorlin, Andrey-A and Chandy, K. Mani (2006) Control-based Scheduling in a Distributed Stream Processing System. In: SCW 2006: IEEE Services Computing Workshops. IEEE , Los Alamitos, CA, pp. 55-64. ISBN 0-7695-2681-0. https://resolver.caltech.edu/CaltechAUTHORS:20110216-140704666

[img]
Preview
PDF - Published Version
See Usage Policy.

204Kb

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20110216-140704666

Abstract

Stream processing systems receive continuous streams of messages with raw information and produce streams of messages with processed information. The utility of a stream-processing system depends, in part, on the accuracy and timeliness of the output. Streams in complex event processing systems are processed on distributed systems; several steps are taken on different processors to process each incoming message, and messages may be enqueued between steps. This paper deals with the problems of distributed dynamic control of streams to optimize the total utility provided by the system. A challenge of distributed control is that timeliness of output depends only on the total end-toend time and is otherwise independent of the delays at each separate processor whereas the controller for each processor takes action to control only the steps on that processor and cannot directly control the entire network. This paper identifies key problems in distributed control and analyzes two scheduling algorithms that help in an initial analysis of a difficult problem.


Item Type:Book Section
Related URLs:
URLURL TypeDescription
http://dx.doi.org/10.1109/SCW.2006.8 DOIArticle
Additional Information:© 2006 IEEE. Issue Date: Sept. 2006, Date of Current Version: 11 December 2006.
Record Number:CaltechAUTHORS:20110216-140704666
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20110216-140704666
Official Citation:Andrey Khorlin; K. Mani Chandy; , "Control-Based Scheduling in a Distributed Stream Processing System," Services Computing Workshops, 2006. SCW '06. IEEE , vol., no., pp.55-64, Sept. 2006 doi: 10.1109/SCW.2006.8 URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4027013&isnumber=4026994
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:22251
Collection:CaltechAUTHORS
Deposited By: Benjamin Perez
Deposited On:16 Feb 2011 22:24
Last Modified:03 Oct 2019 02:36

Repository Staff Only: item control page