Abstract:In this paper, we consider the nonlinear least squares (NLLSs) problems in adaptive networks, where a collection of nodes with adaptation ability by learning are required to estimate a global vector parameter by minimizing the specified convex cost function. Although the global Gauss-Newton (GN) method is an excellent candidate for solving such problems, many challenges need to be addressed for practical realization due to its natures of centralization and noncooperation. Without specialized design for routing, we motivate and propose new diffusion GN methods with cooperative strategy among local neighborhoods. The good performances of diffusion cooperation schemes have been proved in different literatures, such as distribution, robustness, and easy implementation. The proposed cooperative diffusion strategies are named as aggregation-then-update (ATU) and update-then-aggregation (UTA), which reach fully information diffusion across network and consist of two steps in a reversible way including aggregation of local estimates and local GN update. Although all implementations are local, the cooperation between nodes is network wide. Based on the steady-state equilibria theory in the nonlinear discrete dynamical system, the convergence analysis of proposed algorithms is provided. The results show that the global convergence can be achieved when the sufficient conditions are satisfied. We also provide performance comparisons and analysis together with simulation to confirm the applicability and effectiveness of proposed diffusion GN algorithms.

Generalized Combined Nonlinear Adaptive Filters: from the Perspective of Diffusion Adaptation over Networks.

Generalized Combined Nonlinear Adaptive Filters for Nonlinear Acoustic Echo Cancellation.

A Generalized Collaborative Functional Link Adaptive Filter for Nonlinear Active Noise Control

Affine Combination of Diffusion Strategies over Networks

The Effective Cooperative Diffusion Strategies With Adaptation Ability by Learning Across Adaptive Network-Wide Systems

Adaptive Filtering over Complex Networks in Intricate Environments

Improved functional link artificial neural network via convex combination for nonlinear active noise control.

Deep Filtering With Adaptive Learning Rates

Multitask Diffusion Adaptation over Networks with Common Latent Representations

Adaptive Clustering for Multitask Diffusion Networks

Convex combinations of multiple kernel adaptive filters

General Cauchy Conjugate Gradient Algorithms Based on Multiple Random Fourier Features

Recursive Constrained Generalized Maximum Correntropy Algorithms for Adaptive Filtering

Self-balancing Collaboration Between Linear and Nonlinear Adaptive Sub-Filters for Hybrid Active Noise Control

A novel sign adaptation scheme for convex combination of two adaptive filters

Adaptive aggregation of Monte Carlo augmented decomposed filters for efficient group-equivariant convolutional neural network

Deep Generative Fixed-filter Active Noise Control

Distributed Adaptive Networks: A Graphical Evolutionary Game-Theoretic View

General Mixed-Norm-Based Diffusion Adaptive Filtering Algorithm for Distributed Estimation over Network.

Combination of LMS Adaptive Filters with Coefficients Feedback

AF-GCN: Completing Various Graph Tasks Efficiently Via Adaptive Quadratic Frequency Response Function in Graph Spectral Domain