Abstract:Canonical correlation analysis (CCA) is a correlation analysis technique that is widely used in statistics and the machine-learning community. However, the high complexity involved in the training process lays a heavy burden on the processing units and memory system, making CCA nearly impractical in large-scale data. To overcome this issue, a novel CCA method that tries to carry out analysis on the dataset in the Fourier domain is developed in this article. Appling Fourier transform on the data, we can convert the traditional eigenvector computation of CCA into finding some predefined discriminative Fourier bases that can be learned with only element-wise dot product and sum operations, without complex time-consuming calculations. As the eigenvalues come from the sum of individual sample products, they can be estimated in parallel. Besides, thanks to the data characteristic of pattern repeatability, the eigenvalues can be well estimated with partial samples. Accordingly, a progressive estimate scheme is proposed, in which the eigenvalues are estimated through feeding data batch by batch until the eigenvalues sequence is stable in order. As a result, the proposed method shows its characteristics of extraordinarily fast and memory efficiencies. Furthermore, we extend this idea to the nonlinear kernel and deep models and obtained satisfactory accuracy and extremely fast training time consumption as expected. An extensive discussion on the fast Fourier transform (FFT)-CCA is made in terms of time and memory efficiencies. Experimental results on several large-scale correlation datasets, such as MNIST8M, X-RAY MICROBEAM SPEECH, and Twitter Users Data, demonstrate the superiority of the proposed algorithm over state-of-the-art (SOTA) large-scale CCA methods, as our proposed method achieves almost same accuracy with the training time of our proposed method being 1000 times faster. This makes our proposed models best practice models for dealing with large-scale correlation datasets. The source code is available at https://github.com/Mrxuzhao/FFTCCA.

Efficient and Fast Joint Sparse Constrained Canonical Correlation Analysis for Fault Detection.

Independent component analysis - Based sparse autoencoder in the application of fault diagnosis

A Novel Dynamic Baysian Canonical Correlation Analysis Method for Fault Detection

Fault Detection Based on Canonical Correlation Analysis with Rank Constrained Optimization

A Highly Efficient Joint Sparsity Constrained Robust Principal Component Analysis for Fault Diagnosis

A novel scheme for multivariate statistical fault detection with application to the Tennessee Eastman process

Accelerated Kernel Canonical Correlation Analysis with Fault Relevance for Nonlinear Process Fault Isolation

Robust and Sparse Canonical Correlation Analysis for Fault Detection and Diagnosis Using Training Data with Outliers

A Single-Side Neural Network-Aided Canonical Correlation Analysis With Applications to Fault Diagnosis

Data-Driven Process Monitoring Using Structured Joint Sparse Canonical Correlation Analysis

Joint Sparse Principal Component Analysis Based Roust Sparse Fault Detection

A Just-In-Time-Learning-Aided Canonical Correlation Analysis Method for Multimode Process Monitoring and Fault Detection

Sparse Generalized Canonical Correlation Analysis: Distributed Alternating Iteration Based Approach

A Reversible Residual Network-Aided Canonical Correlation Analysis to Fault Detection and Diagnosis in Electrical Drive Systems

Fault Detection for Non-Gaussian Processes Using Generalized Canonical Correlation Analysis and Randomized Algorithms

Fault Detection with Improved Principal Component Pursuit Method

Extraordinarily Time- and Memory-Efficient Large-Scale Canonical Correlation Analysis in Fourier Domain: from Shallow to Deep.

On Sparse Canonical Correlation Analysis

Tssnalm: A Fast Two-Stage Semi-Smooth Newton Augmented Lagrangian Method for Sparse CCA.

Structured Joint Sparse Principal Component Analysis for Fault Detection and Isolation

Deep Canonical Correlation Analysis Using Sparsity Constrained Optimization for Nonlinear Process Monitoring