Abstract:Log parsing, a vital task for interpreting the vast and complex data produced within software architectures faces significant challenges in the transition from academic benchmarks to the industrial domain. Existing log parsers, while highly effective on standardized public datasets, struggle to maintain performance and efficiency when confronted with the sheer scale and diversity of real-world industrial logs. These challenges are two-fold: 1) massive log templates: The performance and efficiency of most existing parsers will be significantly reduced when logs of growing quantities and different lengths; 2) Complex and changeable semantics: Traditional template-matching algorithms cannot accurately match the log templates of complicated industrial logs because they cannot utilize cross-language logs with similar semantics. To address these issues, we propose ECLIPSE, Enhanced Cross-Lingual Industrial log Parsing with Semantic Entropy-LCS, since cross-language logs can robustly parse industrial logs. On the one hand, it integrates two efficient data-driven template-matching algorithms and Faiss indexing. On the other hand, driven by the powerful semantic understanding ability of the Large Language Model (LLM), the semantics of log keywords were accurately extracted, and the retrieval space was effectively reduced. Notably, we launch a Chinese and English cross-platform industrial log parsing benchmark ECLIPSE- BENCH to evaluate the performance of mainstream parsers in industrial scenarios. Our experimental results across public benchmarks and ECLIPSE- BENCH underscore the superior performance and robustness of our proposed ECLIPSE. Notably, ECLIPSE both delivers state-of-the-art performance when compared to strong baselines and preserves a significant edge in processing efficiency.

EUSP: An Easy-to-Use Semantic Parsing PlatForm.

Semantic Parsing for English as a Second Language

Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm

ECLIPSE: Semantic Entropy-LCS for Cross-Lingual Industrial Log Parsing

Spontaneous Speech Parsing in Travel Information Inquiring and Booking Systems

Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction

SemParser: A Semantic Parser for Log Analysis

A Survey of Semantic Parsing Techniques

Learning Programmatic Idioms for Scalable Semantic Parsing

Enhancing spatial and textual analysis with EUPEG: an extensible and unified platform for evaluating geoparsers

A Hybrid Semantic Parsing Approach for Tabular Data Analysis

Semantic Parsing with Syntax- and Table-Aware SQL Generation

Intelligent Parsing: An Automated Parsing Framework for Extracting Design Semantics from E-commerce Creatives

Lexicon-injected Semantic Parsing for Task-Oriented Dialog

Comparing Knowledge-Intensive and Data-Intensive Models for English Resource Semantic Parsing.

Using Elements Of Semantic Parsing In E-Learning Environments

HELP: Hierarchical Embeddings-based Log Parsing

Semantic Human Parsing via Scalable Semantic Transfer over Multiple Label Domains

Peking at MRP 2019: Factorization- and Composition-Based Parsing for Elementary Dependency Structures

Dynamic Syntax Mapping: A New Approach to Unsupervised Syntax Parsing

Knowledge-Aware Conversational Semantic Parsing Over Web Tables