Abstract:Tensor decomposition is a fundamental technique widely applied in signal processing, machine learning, and various other fields. However, traditional tensor decomposition methods encounter limitations when jointly analyzing multi-block tensors, as they often struggle to effectively explore shared information among tensors. In this study, we first introduce a novel coupled nonnegative CANDECOMP/PARAFAC decomposition algorithm optimized by the alternating proximal gradient method (CoNCPD-APG). This algorithm is specially designed to address the challenges of jointly decomposing different tensors that are partially or fully linked, while simultaneously extracting common components, individual components and, core tensors. Recognizing the computational challenges inherent in optimizing nonnegative constraints over high-dimensional tensor data, we further propose the lraCoNCPD-APG algorithm. By integrating low-rank approximation with the proposed CoNCPD-APG method, the proposed algorithm can significantly decrease the computational burden without compromising decomposition quality, particularly for multi-block large-scale tensors. Simulation experiments conducted on synthetic data, real-world face image data, and two kinds of electroencephalography (EEG) data demonstrate the practicality and superiority of the proposed algorithms for coupled nonnegative tensor decomposition problems. Our results underscore the efficacy of our methods in uncovering meaningful patterns and structures from complex multi-block tensor data, thereby offering valuable insights for future applications.

Nonnegative Tensor Decomposition Via Collaborative Neurodynamic Optimization

Fast Learnings of Coupled Nonnegative Tensor Decomposition Using Optimal Gradient and Low-rank Approximation

Enhancing neurodynamic approach with physics-informed neural networks for solving non-smooth convex optimization problems

Binary matrix factorization via collaborative neurodynamic optimization

A Fast Implementation for the Canonical Polyadic Decomposition

An inexactly accelerated algorithm for nonnegative tensor CP decomposition with the column unit constraints

Tensor Decompositions for Count Data that Leverage Stochastic and Deterministic Optimization

A Collective Neurodynamic System for Distributed Optimization with Applications in Model Predictive Control.

Tensor Networks for Latent Variable Analysis: Higher Order Canonical Polyadic Decomposition

Supervised Learning for Non-Sequential Data: A Canonical Polyadic Decomposition Approach

A Neurodynamic Approach for Solving Time-Dependent Nonlinear Equation System: A Distributed Optimization Perspective

A neurodynamic optimization approach to distributed nonconvex optimization based on an HP augmented Lagrangian function

Stochastic Mirror Descent for Low-Rank Tensor Decomposition Under Non-Euclidean Losses

NeuLFT: A Novel Approach to Nonlinear Canonical Polyadic Decomposition on High-Dimensional Incomplete Tensors

Blind Source Separation Based on Collective Neurodynamic Optimization Approach

Inverse-free distributed neurodynamic optimization algorithms for sparse reconstruction

A Collective Neurodynamic Penalty Approach to Nonconvex Distributed Constrained Optimization

A Neurodynamic Approach to Nonsmooth Constrained Pseudoconvex Optimization Problem

Neurodynamic approaches for multi-agent distributed optimization

Sparse Bayesian Learning Based on Collaborative Neurodynamic Optimization