Share Email Print

Proceedings Paper

Operational logs analysis at ALMA observatory based on ELK stack
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

During operations, the ALMA observatory generates a huge amount of logs which contain not only valuable information related to specific failures but also for long term performance analysis. We implemented a big data solution based on Elasticsearch, Logstash and Kibana. They are configured as decoupled system which causes zero impact on the existent operations. It is able to keep more than six months of operation logs online. In this paper, we'll describe this infrastructure, applications built on top of it, and the problems that we faced during its implementation.

Paper Details

Date Published: 26 July 2016
PDF: 9 pages
Proc. SPIE 9913, Software and Cyberinfrastructure for Astronomy IV, 991323 (26 July 2016); doi: 10.1117/12.2232258
Show Author Affiliations
Juan Pablo Gil, ALMA (Chile)
Johnny Reveco, ALMA (Chile)
Tzu-Chiang Shen, ALMA (Chile)

Published in SPIE Proceedings Vol. 9913:
Software and Cyberinfrastructure for Astronomy IV
Gianluca Chiozzi; Juan C. Guzman, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?