Share Email Print
cover

Proceedings Paper

The Gemini online data processing system
Author(s): Shane Walker; Kim Gillies; Allan Brighton
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

Processing astronomical images is an inherently resource intensive procedure that is typically time consuming as well. At the same time, first order reductions are particularly important during the observing process since they can provide key quality assessment information. To resolve this conflict, the Online Data Processing (OLDP) system being commissioned at the Gemini Observatory automatically maps reduction sequences onto a cluster of servers during observing, taking advantage of available concurrency where possible. The user constructs a visual representation of the sequence for an observation using the Gemini Observing Tool. No constraints are placed upon the series of steps that comprise the sequence. At runtime, the OLDP reads the reduction sequence from the Observing Database and splits it into smaller pieces for simultaneous execution on the cluster. Recipe steps can be implemented in IRAF, shell scripts, or Java, and other types can be plugged into the architecture without modifying the core of the code base. This paper will introduce the Gemini OLDP and demonstrate how it utilizes modern infrastructure technology like Jini and JavaSpaces to achieve its goals.

Paper Details

Date Published: 16 September 2004
PDF: 12 pages
Proc. SPIE 5493, Optimizing Scientific Return for Astronomy through Information Technologies, (16 September 2004); doi: 10.1117/12.552082
Show Author Affiliations
Shane Walker, Gemini Observatory (Chile)
Kim Gillies, Gemini Observatory (Chile)
Allan Brighton, Gemini Observatory (Chile)


Published in SPIE Proceedings Vol. 5493:
Optimizing Scientific Return for Astronomy through Information Technologies
Peter J. Quinn; Alan Bridger, Editor(s)

© SPIE. Terms of Use
Back to Top