Share Email Print
cover

Proceedings Paper

Spatial statistical analysis of large astronomical datasets
Author(s): Istvan Szapudi
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The future of astronomy will be dominated with large and complex data bases. Megapixel CMB maps, joint analyses of surveys across several wavelengths, as envisioned in the planned National Virtual Observatory (NVO), TByte/day data rate of future surveys (Pan-STARRS) put stringent constraints on future data analysis methods: they have to achieve at least N log N scaling to be viable in the long term. This warrants special attention to computational requirements, which were ignored during the initial development of current analysis tools in favor of statistical optimality. Even an optimal measurement, however, has residual errors due to statistical sample variance. Hence a suboptimal technique with significantly smaller measurement errors than the unavoidable sample variance produces results which are nearly identical to that of a statistically optimal technique. For instance, for analyzing CMB maps, I present a suboptimal alternative, indistinguishable from the standard optimal method with N3 scaling, that can be rendered N log N with a hierarchical representation of the data; a speed up of a trillion times compared to other methods. In this spirit I will present a set of novel algorithms and methods for spatial statistical analyses of future large astronomical data bases, such as galaxy catalogs, megapixel CMB maps, or any point source catalog.

Paper Details

Date Published: 19 December 2002
PDF: 15 pages
Proc. SPIE 4847, Astronomical Data Analysis II, (19 December 2002); doi: 10.1117/12.461128
Show Author Affiliations
Istvan Szapudi, Institute for Astronomy/Univ. of Hawaii (United States)


Published in SPIE Proceedings Vol. 4847:
Astronomical Data Analysis II
Jean-Luc Starck; Fionn D. Murtagh, Editor(s)

© SPIE. Terms of Use
Back to Top