Share Email Print

Proceedings Paper

Delivering data reduction pipelines to science users
Author(s): Wolfram Freudling; Martino Romaniello
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The European Southern Observatory has a long history of providing specialized data processing algorithms, called recipes, for most of its instruments. These recipes are used for both operational purposes at the observatory sites, and for data reduction by the scientists at their home institutions. The two applications require substantially different environments for running and controlling the recipes. In this papers, we describe the ESOReflex environment that is used for running recipes on the users’ desktops. ESOReflex is a workflow driven data reduction environment. It allows intuitive representation, execution and modification of the data reduction workflow, and has facilities for inspection of and interaction with the data. It includes fully automatic data organization and visualization, interaction with recipes, and the exploration of the provenance tree of intermediate and final data products. ESOReflex uses a number of innovative concepts that have been described in Ref. 1. In October 2015, the complete system was released to the public. ESOReflex allows highly efficient data reduction, using its internal bookkeeping database to recognize and skip previously completed steps during repeated processing of the same or similar data sets. It has been widely adopted by the science community for the reduction of VLT data.

Paper Details

Date Published: 11 July 2016
PDF: 6 pages
Proc. SPIE 9910, Observatory Operations: Strategies, Processes, and Systems VI, 99101U (11 July 2016); doi: 10.1117/12.2232734
Show Author Affiliations
Wolfram Freudling, European Southern Observatory (Germany)
Martino Romaniello, European Southern Observatory (Germany)

Published in SPIE Proceedings Vol. 9910:
Observatory Operations: Strategies, Processes, and Systems VI
Alison B. Peck; Robert L. Seaman; Chris R. Benn, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?