Skip to Main content Skip to Navigation
Conference papers

System Problem Detection by Mining Process Model from Console Logs

Abstract : Given the explosive growth of large-scale services, manually detecting problems from console logs is infeasible. In the current study, we propose a novel process mining algorithm to discover process model from console logs, and further use the obtained process model to detect anomalies. In brief, the console logs are first parsed into events, and the events from one single session are further grouped to event sequences. Then, a process model is mined from the event sequences to describe the main system behaviors. At last, we use the process model to detect anomalous log information. Experiments on Hadoop File System log dataset show that this approach can detect anomalies from log messages with high accuracy and few false positives. Compared with previously proposed automatic anomaly detection methods, our approach can provide intuitive and meaningful explanations to human operators as well as identify real problems accurately. Furthermore, the process model is easy to understand.
Document type :
Conference papers
Complete list of metadata

Cited literature [7 references]  Display  Hide  Download
Contributor : Hal Ifip <>
Submitted on : Friday, February 9, 2018 - 2:25:59 PM
Last modification on : Friday, February 9, 2018 - 2:30:23 PM
Long-term archiving on: : Friday, May 4, 2018 - 10:01:32 PM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Jian Li, Jian Cao. System Problem Detection by Mining Process Model from Console Logs. 14th IFIP International Conference on Network and Parallel Computing (NPC), Oct 2017, Hefei, China. pp.140-144, ⟨10.1007/978-3-319-68210-5_16⟩. ⟨hal-01705438⟩



Record views


Files downloads