Share Email Print

Proceedings Paper

Exploring No-SQL alternatives for ALMA monitoring system
Author(s): Tzu-Chiang Shen; Ruben Soto; Patricio Merino; Leonel Peña; Marcelo Bartsch; Alvaro Aguirre; Jorge Ibsen
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The Atacama Large Millimeter /submillimeter Array (ALMA) will be a unique research instrument composed of at least 66 reconfigurable high-precision antennas, located at the Chajnantor plain in the Chilean Andes at an elevation of 5000 m. This paper describes the experience gained after several years working with the monitoring system, which has a strong requirement of collecting and storing up to 150K variables with a highest sampling rate of 20.8 kHz. The original design was built on top of a cluster of relational database server and network attached storage with fiber channel interface. As the number of monitoring points increases with the number of antennas included in the array, the current monitoring system demonstrated to be able to handle the increased data rate in the collection and storage area (only one month of data), but the data query interface showed serious performance degradation. A solution based on no-SQL platform was explored as an alternative to the current long-term storage system. Among several alternatives, mongoDB has been selected. In the data flow, intermediate cache servers based on Redis were introduced to allow faster streaming of the most recently acquired data to web based charts and applications for online data analysis.

Paper Details

Date Published: 18 July 2014
PDF: 6 pages
Proc. SPIE 9152, Software and Cyberinfrastructure for Astronomy III, 91520F (18 July 2014); doi: 10.1117/12.2055880
Show Author Affiliations
Tzu-Chiang Shen, ALMA (Chile)
Ruben Soto, ALMA (Chile)
Patricio Merino, ALMA (Chile)
Leonel Peña, ALMA (Chile)
Marcelo Bartsch, ALMA (Chile)
Alvaro Aguirre, ALMA (Chile)
Jorge Ibsen, European Southern Observatory (Chile)

Published in SPIE Proceedings Vol. 9152:
Software and Cyberinfrastructure for Astronomy III
Gianluca Chiozzi; Nicole M. Radziwill, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?