Share Email Print

Proceedings Paper

An experiment in big data: storage, querying and visualisation of data taken from the Liverpool Telescope's wide field cameras
Author(s): R. M. Barnsley; Iain A. Steele; R. J. Smith; Neil R. Mawson
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The Small Telescopes Installed at the Liverpool Telescope (STILT) project has been in operation since March 2009, collecting data with three wide field unfiltered cameras: SkycamA, SkycamT and SkycamZ. To process the data, a pipeline was developed to automate source extraction, catalogue cross-matching, photometric calibration and database storage. In this paper, modifications and further developments to this pipeline will be discussed, including a complete refactor of the pipeline's codebase into Python, migration of the back-end database technology from MySQL to PostgreSQL, and changing the catalogue used for source cross-matching from USNO-B1 to APASS. In addition to this, details will be given relating to the development of a preliminary front-end to the source extracted database which will allow a user to perform common queries such as cone searches and light curve comparisons of catalogue and non-catalogue matched objects. Some next steps and future ideas for the project will also be presented.

Paper Details

Date Published: 18 July 2014
PDF: 10 pages
Proc. SPIE 9152, Software and Cyberinfrastructure for Astronomy III, 91522L (18 July 2014); doi: 10.1117/12.2055558
Show Author Affiliations
R. M. Barnsley, Liverpool John Moores Univ. (United Kingdom)
Iain A. Steele, Liverpool John Moores Univ. (United Kingdom)
R. J. Smith, Liverpool John Moores Univ. (United Kingdom)
Neil R. Mawson, Liverpool John Moores Univ. (United Kingdom)

Published in SPIE Proceedings Vol. 9152:
Software and Cyberinfrastructure for Astronomy III
Gianluca Chiozzi; Nicole M. Radziwill, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?