Abstract:Distributed estimation is an important technique for in-network signal processing. In this work, we consider a general case where the unknown parameter vectors (tasks) for different nodes can be different, which is different from the common single-task problem and is known as the multitask problem. Besides, it is assumed that there are some similarities among these tasks. Thus, the performance may be improved by performing the intertask cooperation. To improve robustness against different degrees of difference among the tasks, an adaptive intertask cooperation strategy is proposed. On the other hand, in most of the existing distributed algorithms, it is usually assumed that noise/errors are confined to the output signal. However, in many real environments, the input and output signals may be both corrupted by noise, which is described by the errors-in-variables (EIV) model. In such a case, it has been demonstrated that the total least-squares (TLS) method based on minimizing the squared total error outperforms the classical least-squares method. In this paper, we consider the EIV model with several parameter vectors to be estimated simultaneously, and we derive a distributed TLS algorithm with adaptive intertask cooperation for the in-network cooperative estimation problem. For this algorithm, theoretical performance analysis is provided. Besides, to verify its effectiveness, numerical simulations are given.

Multitask Diffusion Adaptation over Networks with Common Latent Representations

Diffusion LMS over Multitask Networks.

Multitask Diffusion Adaptation over Networks

Adaptive Clustering for Multitask Diffusion Networks

Diffusion LMS for Clustered Multitask Networks

Diffusion Lms Over Multitask Networks With Noisy Links

Multitask Diffusion Affine Projection Sign Algorithm and Its Sparse Variant for Distributed Estimation

Distributed Jointly Sparse Multitask Learning over Networks

Diffusion LMS for multitask problems with overlapping hypothesis subspaces

Distributed Learning of Predictive Structures from Multiple Tasks over Networks

Adaptation and Learning over Networks for Nonlinear System Modeling

Variance Reduced Diffusion Adaptation for Online Learning over Networks

Multitask Learning Over Graphs: An Approach for Distributed, Streaming Machine Learning

Penalty-Based Multitask Distributed Adaptation over Networks with Constraints

Learning over Multitask Graphs -- Part II: Performance Analysis

Diffusion Adaptation over Networks with Kernel Least-Mean-square

Distributed Diffusion Adaptation Over Graph Signals

Distributed Networked Multi-task Learning

Online Distributed Learning over Graphs with Multitask Graph-Filter Models

Distributed TLS over Multitask Networks with Adaptive Intertask Cooperation