logs2graphs: Data-driven graph representation and visualization of log data

Abstract

In recent years, AIOps has helped a lot with the exploration of different types of resources, in the processes of optimization and automation of complex IT operations. One of the main resources that AIOps is exploring is system logs. There are many techniques based on machine learning in AIOps that help in logs anomaly detection, logs prediction, and root cause analysis guided by logs, but a majority of them are considering log messages either individually or as log sequences, without exploring the relationships between different types of logs. We believe that those relationships can be expressed via using graph representations of log messages and those representations can be utilized in almost any AIOps operation. Therefore in this paper, we present logs2graphs, an open-source system for the creation and visualization of such graph representations of log messages, which is compatible with several publicly available log sources and expandable to other log sources.