Abstract:Distributed data collection and analysis over networks are ubiquitous, especially over the wireless sensor networks (WSNs). Distributed clustering is one of the most important topics in distributed data analysis. It is desired to explore the hidden structure of the data collected/stored in geographically distributed nodes. In recent years, several distributed data clustering techniques have been developed based on the K-means algorithm or the Gaussian mixture model. In these methods, data structures are captured by measures only based on the first and the second order statistics. When the structure of cluster data is complicated, these statistics are insufficient and may lead to unsatisfactory clustering results. In such a case, using information theoretic measures can achieve better clustering performance since they take the whole distribution of cluster data into account. In this work, we incorporate an information theoretic measure into the cost function of the distributed clustering, to present a linear and a kernel distributed clustering algorithms. In the algorithms, each node solves a local clustering problem through diffusion cooperation with its neighboring nodes. In order to preserve privacy and save communication costs, in the cooperation, nodes merely exchange a few parameters instead of original data with their one-hop neighbors. Simulation results show that the proposed distributed algorithms can achieve almost as good clustering results as the corresponding centralized information theoretic clustering algorithms on both synthetic and real data.

Error Log Clustering of Internet Software

Log clustering based problem identification for online service systems

Client Error Clustering Approaches in Content Delivery Networks (CDN)

Using Visualization to Improve Clustering Analysis on Heterogeneous Information Network.

INVESTIGATION OF CLUSTERING AND CLASSIFICATION METHODS FOR INTELLECTUAL ANALYSIS OF LOG FILES

Log Analysis Techniques using Clustering in Network Forensics

System log clustering approaches for cyber security applications: A survey

Logzip: Extracting Hidden Structures via Iterative Clustering for Log Compression

Web Log Data Analysis by Enhanced Fuzzy C Means Clustering

Clustering event logs using iterative partitioning

Distributed Information Theoretic Clustering

Algorithms and methods of data clustering in the analysis of information security event logs

ClusterLog: Clustering Logs for Effective Log-based Anomaly Detection

LogKG: Log Failure Diagnosis through Knowledge Graph

PATH CLUSTERING: DISCOVERING THE KNOWLEDGE IN THE WEB SITE

Research on Web Log Data Mining Technology Based on Optimized Clustering Analysis Algorithm

LogRCA: Log-based Root Cause Analysis for Distributed Services

Correlation-Based Web Document Clustering for Adaptive Web Interface Design

ClusteredLog: Optimizing Log Structures for Efficient Data Recovery and Integrity Management in Database Systems

Detecting Performance Anomaly with Correlation Analysis for Internetware

Lopper: An Efficient Method For Online Log Pattern Mining Based On Hybrid Clustering Tree