Share Email Print

Proceedings Paper

The Gemini Recipe System: a dynamic workflow for automated data reduction
Author(s): Kathleen Labrie; Craig Allen; Paul Hirst; Jennifer Holt; River Allen; Kaniela Dement
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Gemini's next generation data reduction software suite aims to offer greater automation of the data reduction process without compromising the flexibility required by science programs using advanced or unusual observing strategies. The Recipe System is central to our new data reduction software. Developed in Python, it facilitates near-real time processing for data quality assessment, and both on- and off-line science quality processing. The Recipe System can be run as a standalone application or as the data processing core of an automatic pipeline. The data reduction process is defined in a Recipe written in a science (as opposed to computer) oriented language, and consists of a sequence of data reduction steps, called Primitives, which are written in Python and can be launched from the PyRAF user interface by users wishing to use them interactively for more hands-on optimization of the data reduction process. The fact that the same processing Primitives can be run within both the pipeline context and interactively in a PyRAF session is an important strength of the Recipe System. The Recipe System offers dynamic flow control allowing for decisions regarding processing and calibration to be made automatically, based on the pixel and the metadata properties of the dataset at the stage in processing where the decision is being made, and the context in which the processing is being carried out. Processing history and provenance recording are provided by the AstroData middleware, which also offers header abstraction and data type recognition to facilitate the development of instrument-agnostic processing routines.

Paper Details

Date Published: 29 July 2010
PDF: 8 pages
Proc. SPIE 7737, Observatory Operations: Strategies, Processes, and Systems III, 77371U (29 July 2010); doi: 10.1117/12.857370
Show Author Affiliations
Kathleen Labrie, Gemini Observatory (United States)
Craig Allen, Gemini Observatory (United States)
Paul Hirst, Gemini Observatory (United States)
Jennifer Holt, Univ. of California, Santa Cruz (United States)
Gemini Observatory (United States)
River Allen, Gemini Observatory (United States)
Kaniela Dement, Gemini Observatory (United States)

Published in SPIE Proceedings Vol. 7737:
Observatory Operations: Strategies, Processes, and Systems III
David R. Silva; Alison B. Peck; B. Thomas Soifer, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?