Abstract:This article proposes a novel fuzzy clustering based anomaly detection method for pump current time series of EDFA systems. The proposed change detection framework (CDF) strategically combines the advantages of entropy analysis (EA) and principle component analysis (PCA) with fuzzy clustering procedures. In the framework, EA is applied for dynamic selection of features for reduction of the feature space and increase of computational performance. Furthermore, PCA is utilized to extract features from the raw feature space to enable generalization capability of the subsequent fuzzy clustering procedures. Three different fuzzy clustering methods, more precisely the fuzzy clustering algorithm, a probabilistic clustering algorithm and a possibilistic clustering algorithm are evaluated for performance and generalization. Hence, the proposed framework has the innovative feature to detect changes in pump current time series at an early stage for arbitrary points of operation, compared to state-of-the-art predefined alarms in commercially used EDFAs. Moreover, the approach is implemented and tested using experimental data. In addition, the proposed framework enables further approaches of applying decentralized predictive maintenance for optical fiber networks.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to detect anomalies in the erbium - doped fiber amplifier (EDFA) pump - current time series in order to monitor the aging process. Specifically, existing commercial EDFA systems usually use predefined alarm thresholds to detect the aging of pump lasers. However, when the optical amplifier operates below the maximum output power, this aging - detection method is not reliable enough. Therefore, this paper proposes a time - series anomaly - detection framework (CDF) based on fuzzy clustering, aiming to detect changes in the pump - current time series at an early stage at any operating point, thereby reducing the size of the data set provided to the evaluation algorithm and improving the reliability of the system. ### Main Contributions 1. **Innovative Anomaly - Detection Framework**: This framework combines the advantages of entropy analysis (EA) and principal component analysis (PCA), as well as fuzzy - clustering techniques, and is able to detect changes in the pump - current time series at an early stage at any operating point. 2. **Multi - Sensor Data Integration**: This method can integrate multiple - sensor data and perform effective anomaly detection under different operating conditions. 3. **Experimental Verification**: The effectiveness and robustness of the proposed framework have been verified through experimental data, especially when dealing with data streams containing degradation features and noise. ### Method Overview - **Entropy Analysis (EA)**: Used for dynamic feature selection, reducing the feature space and improving computational performance. - **Principal Component Analysis (PCA)**: Used for extracting features from the original feature space and enhancing the generalization ability of the subsequent fuzzy - clustering process. - **Fuzzy Clustering**: The performance and generalization ability of three different fuzzy - clustering methods (classical fuzzy - clustering algorithm, probability - clustering algorithm, and possibility - clustering algorithm) are evaluated. ### Experimental Results - **Training - Behavior Analysis**: By comparing the training errors under different configurations, the advantages of the proposed framework in terms of convergence and stability are verified. - **Dimensionality - Reduction Effect**: Combining entropy analysis and principal component analysis significantly improves the generalization ability and performance of the algorithm. - **Anomaly - Detection Performance**: By introducing the change - point - detection (CPD) index, it is verified that the proposed framework can detect anomalies when the pump - current change is small (such as a 4.9% drift), much earlier than the traditional predefined threshold (usually set at 10%). ### Conclusion This paper proposes a new change - detection framework based on entropy analysis, principal component analysis, and fuzzy clustering, which can detect anomalies in the EDFA pump - current time series at an early stage under any operating conditions. This not only improves the reliability of the system but also makes it possible to achieve decentralized predictive maintenance of fiber - break networks. Future work will further analyze the anomaly - detection problem under any operating conditions and propose prediction and diagnosis models for EDFA.

Anomaly Detection in Time Series of EDFA Pump Currents to Monitor Degeneration Processes using Fuzzy Clustering

Compound Fuzzy Clustering Anomaly Detection Based on Production Process Coupling

An Anomaly Detection and Scenario Classification Scheme Based on Fuzzy C-means Clustering

An Unsupervised Framework for Anomaly Detection in a Water Treatment System

The Application of a Double CUSUM Algorithm in Industrial Data Stream Anomaly Detection

Discrimination of Three or More Partial Discharge Sources by Multi-Step Clustering of Cumulative Energy Features

Power Equipment Anomaly Detection Based on Spatiotemporal Clustering

Machine Learning-based Anomaly Detection in Optical Fiber Monitoring

A New Fault Detection Method Based on Artificial Immune Systems

A Novel Sequence Discriminative Feature Extraction Network and Its Application in Offline Industrial Fault Pattern Clustering

Fuzzy c-Shape: A new algorithm for clustering finite time series waveforms

An autocorrelation incremental fuzzy clustering framework based on dynamic conditional scoring model

Clustering-based anomaly detection in multivariate time series data

ML-based Anomaly Detection in Optical Fiber Monitoring

Anomaly Detection System in Cloud Environment Using Fuzzy Clustering Based ANN

Dynamic log file analysis: An unsupervised cluster evolution approach for anomaly detection

Anomaly Detection Algorithm Based on CFSFDP

A weighted fuzzy C-means clustering method with density peak for anomaly detection in IoT-enabled manufacturing process

Deep-Compact-Clustering Based Anomaly Detection Applied to Electromechanical Industrial Systems

A Statistical Feature-Based Anomaly Detection Method for PFC Using Canonical Correlation Analysis

Dynamic Micro-cluster-Based Streaming Data Clustering Method for Anomaly Detection.