Share Email Print
cover

Proceedings Paper

Anomaly detection of software system logs based on natural language processing
Author(s): Mengying Wang; Lele Xu; Lili Guo
Format Member Price Non-Member Price
PDF $17.00 $21.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

System logs record the daily status of operating systems, application software, firewalls, etc. Analyzing system logs can help to prevent and eliminate information security events in real time. In this paper, we propose to analyze the system logs for anomalous event detection based on natural language processing. First, we use doc2vec of natural language processing algorithm to construct sentence vectors, then apply several state-of-the-art classification algorithms on the sentence vectors for anomaly detection. The system logs generated by the Thunderbird supercomputer are adopted here to verify the proposed method. The results show that doc2vec combined with machine learning classification algorithms could not only effectively extract the semantic information of the logs, but also perform excellent anomaly detection.

Paper Details

Date Published: 29 October 2018
PDF: 8 pages
Proc. SPIE 10836, 2018 International Conference on Image and Video Processing, and Artificial Intelligence, 108361K (29 October 2018); doi: 10.1117/12.2513857
Show Author Affiliations
Mengying Wang, Technology and Engineering Ctr. for Space Utilization (China)
Univ. of Chinese Academy of Sciences (China)
Lele Xu, Technology and Engineering Ctr. for Space Utilization (China)
Lili Guo, Technology and Engineering Ctr. for Space Utilization (China)


Published in SPIE Proceedings Vol. 10836:
2018 International Conference on Image and Video Processing, and Artificial Intelligence
Ruidan Su, Editor(s)

© SPIE. Terms of Use
Back to Top