Abstract:In this paper, we consider the nonlinear least squares (NLLSs) problems in adaptive networks, where a collection of nodes with adaptation ability by learning are required to estimate a global vector parameter by minimizing the specified convex cost function. Although the global Gauss-Newton (GN) method is an excellent candidate for solving such problems, many challenges need to be addressed for practical realization due to its natures of centralization and noncooperation. Without specialized design for routing, we motivate and propose new diffusion GN methods with cooperative strategy among local neighborhoods. The good performances of diffusion cooperation schemes have been proved in different literatures, such as distribution, robustness, and easy implementation. The proposed cooperative diffusion strategies are named as aggregation-then-update (ATU) and update-then-aggregation (UTA), which reach fully information diffusion across network and consist of two steps in a reversible way including aggregation of local estimates and local GN update. Although all implementations are local, the cooperation between nodes is network wide. Based on the steady-state equilibria theory in the nonlinear discrete dynamical system, the convergence analysis of proposed algorithms is provided. The results show that the global convergence can be achieved when the sufficient conditions are satisfied. We also provide performance comparisons and analysis together with simulation to confirm the applicability and effectiveness of proposed diffusion GN algorithms.

Zeroth-Order Diffusion Adaptive Filter over Networks.

Zeroth-Order Diffusion Adaptation over Networks

Variance Reduced Diffusion Adaptation for Online Learning over Networks

Diffusion Least Mean Kurtosis Algorithm and Its Performance Analysis

Diffusion Information Theoretic Learning for Distributed Estimation over Network

Diffusion Sparse Least-Mean Squares over Networks

Distributed Filtering over Networks Based on Diffusion Strategy

A Class of Diffusion Zero Attracting Stochastic Gradient Algorithms With Exponentiated Error Cost Functions

Zeroth-Order Online Alternating Direction Method of Multipliers: Convergence Analysis and Applications.

Diffusion Sign Subband Adaptive Filtering Algorithm for Distributed Estimation

Distributed Zeroth-Order Optimization: Convergence Rates That Match Centralized Counterpart

Diffusion adaptive filtering algorithm based on the Fair cost function

The Diffusion Least Mean Square Algorithm with Variable Q -Gradient.

Training-Free Adaptive Diffusion with Bounded Difference Approximation Strategy

General Mixed-Norm-Based Diffusion Adaptive Filtering Algorithm for Distributed Estimation over Network.

Adaptive Filtering over Complex Networks in Intricate Environments

Zeroth-order algorithms for stochastic distributed nonconvex optimization

The Effective Cooperative Diffusion Strategies With Adaptation Ability by Learning Across Adaptive Network-Wide Systems

Diffusion Random Fourier Adaptive Filtering Algorithm Based on Logistic Distance Metric for Distributed Estimation

Multitask Diffusion Affine Projection Sign Algorithm and Its Sparse Variant for Distributed Estimation

Diffusion Kalman Filter Algorithm for Adaptive Network with Quantized Information Exchange.