Share Email Print

Proceedings Paper • new

ChiVOLabs: cloud service that offer interactive environment for reprocessing astronomical data
Author(s): Humberto A. Farias; Daniel Ortiz; Camilo Núñez; Mauricio Solar; Margarita Bugueno
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The advancement of technology in telescopes and observation instruments has allowed more and more data to be available with higher resolutions and quality, but the way to obtain this data is the same, astronomers are conditioned obtain observation time. Once the data is public in most cases fall into disuse and except with initiatives such as virtual observatories that seek to offer this data over standards and protocols for storage and access, the data are not used again. Our proposal seeks to recover these large volumes of observations already made and offer them as a cloud service from a High Performance Computing environment to be reprocessed by the scientific community with the aim of generating new science from them, for this in the Chilean Virtual observatory we have created ChiVOLabs, a system that has a microservice architecture on Docker that allows us, based on searches in our virtual observatories, to offer the possibility of reprocessing ALMA data through a Jupyter Notebook interface. The process start using the IVOA protocol: Simple Cone Search to find the astronomical data and then select the option to reprocess them. Our architecture create a DOCKER environment with the entire analysis stack of ChiVO and Python in our datacenter, furthermore transforms the reduction script used to generate the original product in a jupyter notebook automatically connected to our CASA cluster (Pipleine of reduction of ALMA). Finally we search in our datalake raw ALMA data, known as ADSM, from which is generated the selected product and are created a link to these raw in the container. With this we offer the scientific community the possibility of reprocessing these data according to their scientific interests and generating new data products that can finally be downloaded or continue to be working with our libraries using the full power of our datacenter

Paper Details

Date Published: 6 July 2018
PDF: 10 pages
Proc. SPIE 10707, Software and Cyberinfrastructure for Astronomy V, 107072R (6 July 2018); doi: 10.1117/12.2313304
Show Author Affiliations
Humberto A. Farias, Univ. Técnica Federico Santa María (Chile)
Daniel Ortiz, Univ. de La Serena (Chile)
Camilo Núñez, Univ. Técnica Federico Santa María (Chile)
Mauricio Solar, Univ. Técnica Federico Santa María (Chile)
Margarita Bugueno, Univ. Técnica Federico Santa María (Chile)

Published in SPIE Proceedings Vol. 10707:
Software and Cyberinfrastructure for Astronomy V
Juan C. Guzman; Jorge Ibsen, Editor(s)

© SPIE. Terms of Use
Back to Top