Share Email Print

Proceedings Paper

Designing a multi-petabyte database for LSST
Author(s): Jacek Becla; Andrew Hanushevsky; Sergei Nikolaev; Ghaleb Abdulla; Alex Szalay; Maria Nieto-Santisteban; Ani Thakar; Jim Gray
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The 3.2 giga-pixel LSST camera will produce approximately half a petabyte of archive images every month. These data need to be reduced in under a minute to produce real-time transient alerts, and then added to the cumulative catalog for further analysis. The catalog is expected to grow about three hundred terabytes per year. The data volume, the real-time transient alerting requirements of the LSST, and its spatio-temporal aspects require innovative techniques to build an efficient data access system at reasonable cost. As currently envisioned, the system will rely on a database for catalogs and metadata. Several database systems are being evaluated to understand how they perform at these data rates, data volumes, and access patterns. This paper describes the LSST requirements, the challenges they impose, the data access philosophy, results to date from evaluating available database technologies against LSST requirements, and the proposed database architecture to meet the data challenges.

Paper Details

Date Published: 29 June 2006
PDF: 8 pages
Proc. SPIE 6270, Observatory Operations: Strategies, Processes, and Systems, 62700R (29 June 2006); doi: 10.1117/12.671721
Show Author Affiliations
Jacek Becla, Stanford Linear Accelerator Ctr. (United States)
Andrew Hanushevsky, Stanford Linear Accelerator Ctr. (United States)
Sergei Nikolaev, Lawrence Livermore National Lab. (United States)
Ghaleb Abdulla, Lawrence Livermore National Lab. (United States)
Alex Szalay, Johns Hopkins Univ. (United States)
Maria Nieto-Santisteban, Johns Hopkins Univ. (United States)
Ani Thakar, Johns Hopkins Univ. (United States)
Jim Gray, Microsoft Research (United States)

Published in SPIE Proceedings Vol. 6270:
Observatory Operations: Strategies, Processes, and Systems
David R. Silva; Rodger E. Doxsey, Editor(s)

© SPIE. Terms of Use
Back to Top