Share Email Print
cover

Proceedings Paper

SIP: a modern flexible data pipeline
Author(s): Pauline Barmby; Zhong Wang; Massimo Marengo; Matthew L.N. Ashby
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

IRAC, the Infrared Array Camera on the Spitzer Space Telescope, generated well over 150,000 images during the in-orbit checkout and science verification phase of the mission. All of these were processed with SIP, the SAO IRAC Pipeline. SIP was created by and for the members of the IRAC instrument team at the Smithsonian Astrophysical Observatory, to allow short-timescale data processing and rapid-turnaround software testing and algorithm modification. SIP makes use of perl scripting and data mirroring to transfer and manage data, a mySQL database to select calibration data, and Python/numarray to process the image data; it is designed to run with no user interaction. SIP is fast, flexible, and robust. We present some 'lessons learned' from the construction and maintenance of SIP, and discuss prospects for future improvement.

Paper Details

Date Published: 16 September 2004
PDF: 7 pages
Proc. SPIE 5493, Optimizing Scientific Return for Astronomy through Information Technologies, (16 September 2004); doi: 10.1117/12.550468
Show Author Affiliations
Pauline Barmby, Harvard-Smithsonian Ctr. for Astrophysics (United States)
Zhong Wang, Harvard-Smithsonian Ctr. for Astrophysics (United States)
Massimo Marengo, Harvard-Smithsonian Ctr. for Astrophysics (United States)
Matthew L.N. Ashby, Harvard-Smithsonian Ctr. for Astrophysics (United States)


Published in SPIE Proceedings Vol. 5493:
Optimizing Scientific Return for Astronomy through Information Technologies
Peter J. Quinn; Alan Bridger, Editor(s)

© SPIE. Terms of Use
Back to Top