Share Email Print

Proceedings Paper

Processing TOVS Polar Pathfinder data using the distributed batch controller
Author(s): James Duff; Kenneth M. Salem; Axel Schweiger; Miron Livny
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The distributed batch controller (DBC) supports scientific batch data processing. Batch jobs are distributed by the DBC over a collection of computing resources. Since these resources may be widely scattered the DBC is well suited for collaborative research efforts whose resources may not be centrally located. The DBC provides its users with centralized monitoring and control of distributed batch jobs. Version 1 of the DBC is currently being used by the TOVS Polar Pathfinder project to generate Arctic atmospheric temperature and humidity profiles. Profile generating jobs are distributed and executed by the DBC on workstation clusters located at several sites across the US. This paper describes the data processing requirements of the TOVS Polar Pathfinder project, and how the DBC is being used to meet them. It also describes Version 2 of the DBC. DBC V2 is implemented in Java, and utilizes a number of advanced Java features such as threads and remote method invocation. It incorporates a number of functional enhancements. These include a flexible mechanism supporting interoperation of the DBC with a wider variety of execution resources and an improved user interface.

Paper Details

Date Published: 18 September 1997
PDF: 11 pages
Proc. SPIE 3117, Earth Observing Systems II, (18 September 1997); doi: 10.1117/12.278920
Show Author Affiliations
James Duff, Univ. of Maryland/College Park (United States)
Kenneth M. Salem, Univ. of Waterloo (Canada)
Axel Schweiger, Univ. of Washington (United States)
Miron Livny, Univ. of Wisconsin/Madison (United States)

Published in SPIE Proceedings Vol. 3117:
Earth Observing Systems II
William L. Barnes, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?