Share Email Print

Proceedings Paper

Streamline: a scheduling heuristic for streaming applications on the grid
Author(s): Bikash Agarwalla; Nova Ahmed; David Hilley; Umakishore Ramachandran
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Scheduling a streaming application on high-performance computing (HPC) resources has to be sensitive to the computation and communication needs of each stage of the application dataflow graph to ensure QoS criteria such as latency and throughput. Since the grid has evolved out of traditional high-performance computing, the tools available for scheduling are more appropriate for batch-oriented applications. Our scheduler, called Streamline, considers the dynamic nature of the grid and runs periodically to adapt scheduling decisions using application requirements (per-stage computation and communication needs), application constraints (such as co-location of stages), and resource availability. The performance of Streamline is compared with an Optimal placement, Simulated Annealing (SA) approximations, and E-Condor, a streaming grid scheduler built using Condor. For kernels of streaming applications, we show that Streamline performs close to the Optimal and SA algorithms, and an order of magnitude better than E-Condor under non-uniform load conditions. We also conduct scalability studies showing the advantage of Streamline over other approaches.

Paper Details

Date Published: 16 January 2006
PDF: 15 pages
Proc. SPIE 6071, Multimedia Computing and Networking 2006, 607107 (16 January 2006); doi: 10.1117/12.642809
Show Author Affiliations
Bikash Agarwalla, Georgia Institute of Technology (United States)
Nova Ahmed, Georgia Institute of Technology (United States)
David Hilley, Georgia Institute of Technology (United States)
Umakishore Ramachandran, Georgia Institute of Technology (United States)

Published in SPIE Proceedings Vol. 6071:
Multimedia Computing and Networking 2006
Surendar Chandra; Carsten Griwodz, Editor(s)

© SPIE. Terms of Use
Back to Top