Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems, because they are often the only data available that record software runtime information. As modern software is evolving into a large scale, the volume of logs has increased rapidly. To enable effective and efficient usage of modern software logs in reliability engineering, a number of studies have been conducted on automated log analysis. This survey presents a detailed overview of automated log analysis research, including how to automate and assist the writing of logging statements, how to compress logs, how to parse logs into structured event templates, and how to employ logs to detect anomalies, predict failures, and facilitate diagnosis. Additionally, we survey work that releases open-source toolkits and datasets. Based on the discussion of the recent advances, we present several promising future directions toward real-world and next-generation automated log analysis.

中文翻译：

---

可靠性工程自动化日志分析综述

日志是通过在软件源代码中记录语句生成的半结构化文本。近几十年来，软件日志在许多软件系统的可靠性保证机制中变得必不可少，因为它们通常是记录软件运行时信息的唯一可用数据。随着现代软件向大规模演进，日志量迅速增加。为了在可靠性工程中有效和高效地使用现代软件日志，已经对自动化日志分析进行了许多研究。本调查详细介绍了自动化日志分析研究，包括如何自动化和协助编写日志语句、如何压缩日志、如何将日志解析为结构化事件模板以及如何使用日志来检测异常、预测故障、并便于诊断。此外，我们调查了发布开源工具包和数据集的工作。基于对最近进展的讨论，我们提出了几个有前途的未来方向，以实现现实世界和下一代自动日志分析。