Abstract:In many computer vision applications, one image can be represented by multiple heterogeneous features from different views, most of them commonly locate in high-dimensional space. These features can reflect different characteristics of one same object, they contain compatible and complementary information among each other. How to construct an uniform low-dimensional embedding features which represent useful information of multi-view features is still an important and urgent issue to be solved. Therefore, we propose a multi-view fusion method via tensor learning and gradient descent (MvF-TG) in this paper. MvF-TG reconstructs a lowdimensional mapping subspace of each object by utilizing its k nearest neighbors, which preserves the underlying neighborhood structure of the original local manifold. The new method can effectively exploit the spatial correlation information from the multi-view features by tensor learning. Furthermore, the method constructs a gradient descent optimization model to generate the better unified low dimensional embedding. The proposed method is compared with several single-view and multi-view dimensional reduction methods in these indicators of P, R, MAP and F-measure. In the retrieval experiments, the P values of the newmethod respectively are 86.80%, 52.00%, 68.56% and 78.80% on datasets of Corel1k, Corel5k, Corel10k and Holidays. In the classification experiments, the mean accuracies of it respectively are 47.94% and 87.58% on datasets of Caltech101 and Coil. These values are higher than those obtained by other comparison methods, various evaluations based on the applications of image classification and retrieval demonstrates the effectiveness of our proposed method on multi-view feature fusion dimension reduction.

Large-margin multi-view Gaussian process

Large-margin multi-view Gaussian process for image classification

Multi-View Correlated Feature Learning by Uncovering Shared Component.

A Novel Image Classification Method Based on Manifold Learning and Gaussian Mixture Model

Large Linear Multi-output Gaussian Process Learning

Large-Margin Predictive Latent Subspace Learning for Multiview Data Analysis.

Predictive Subspace Learning for Multi-view Data: a Large Margin Approach.

Multi-View Deep Gaussian Processes for Supervised Learning

Scalable Variational Gaussian Process Classification

Deep convolutional Gaussian processes

A spatial Gaussian process method for hyperspectral remote sensing imagery classification

Rethinking Feature Distribution for Loss Functions in Image Classification

LCBM: A Multi-View Probabilistic Model for Multi-Label Classification

Gaussian Process Approach to Remote Sensing Image Classification

A Multi-View Fusion Method Via Tensor Learning And Gradient Descent For Image Features

Composite Inference for Gaussian Processes

Generating Multi-Center Classifier via Conditional Gaussian Distribution

Multi-view Latent Space Learning Based on Local Discriminant Embedding

High-Order Distance-Based Multiview Stochastic Learning in Image Classification

Grassmannian regularized structured multi-view embedding for image classification.

Multi-view Common Component Discriminant Analysis for Cross-view Classification