Abstract:Over the last decade, many pairwise-constraint-based metric learning algorithms have been developed to automatically learn application-specific metrics from data under similarity/dissimilarity data-pair constraints (weak labels). Nevertheless, these existing methods are designed for the centralized learning case, in which all the data and constraints are supposed to be gathered together in one source, and the algorithms utilize the whole data and constraints information during the learning process. However, in many real applications, large amounts of data (constraints) are dispersedly generated/stored in geographically distributed nodes over networks. Thus, it might be impractical to centralize the whole data information to one fusion node. Besides, in such cases, it is often hard to have every data pair labeled due to the huge data-pair amounts, resulting in numerous unlabeled data pairs. Given these situations, in this paper, we propose two types, namely, a diffusion type and an alternating-direction-method-of-multipliers type, of distributed semi-supervised metric learning frameworks, which make use of both labeled and unlabeled data pairs. The proposed frameworks can be easily used to extend centralized metric learning methods of different objective functions to distributed cases. In particular, we apply our frameworks on a well-behaved centralized semi-supervised metric learning method called SERAPH and yield two new distributed semi-supervised metric learning algorithms. Our simulation results show that the metrics learned by the proposed distributed algorithms are very close to that of the corresponding centralized method in most cases.

Distributed Analysis Dictionary Learning Using a Diffusion Strategy

Class-Aware Analysis Dictionary Learning for Pattern Classification.

Distributed Dictionary Learning over Heterogeneous Clients Using Local Adaptive Dictionaries

Diffusion Information Theoretic Learning for Distributed Estimation over Network

Distributed Active Learning.

Analysis Dictionary Learning Using Block Coordinate Descent Framework with Proximal Operators

Distributed Semi-Supervised Metric Learning.

Distributed Learning of Predictive Structures from Multiple Tasks over Networks

Discriminative analysis dictionary learning with adaptively ordinal locality preserving

Locality Constrained Analysis Dictionary Learning via K-SVD Algorithm

Distributed estimation over complex networks

Distributed Event-Based Learning via ADMM

Jointly Learning Structured Analysis Discriminative Dictionary and Analysis Multiclass Classifier

Affine Combination of Diffusion Strategies over Networks

Distributed Filtering over Networks Based on Diffusion Strategy

A Distributed Approach Toward Discriminative Distance Metric Learning

Distributing the Stochastic Gradient Sampler for Large-Scale LDA.

Distributed Convolutional Dictionary Learning (DiCoDiLe): Pattern Discovery in Large Images and Signals

An analysis dictionary learning algorithm under a noisy data model with orthogonality constraint

An augmented Lagrangian multi-scale dictionary learning algorithm

Diffusion Adaptation over Networks with Kernel Least-Mean-square