Abstract:In many computer vision applications, one image can be represented by multiple heterogeneous features from different views, most of them commonly locate in high-dimensional space. These features can reflect different characteristics of one same object, they contain compatible and complementary information among each other. How to construct an uniform low-dimensional embedding features which represent useful information of multi-view features is still an important and urgent issue to be solved. Therefore, we propose a multi-view fusion method via tensor learning and gradient descent (MvF-TG) in this paper. MvF-TG reconstructs a lowdimensional mapping subspace of each object by utilizing its k nearest neighbors, which preserves the underlying neighborhood structure of the original local manifold. The new method can effectively exploit the spatial correlation information from the multi-view features by tensor learning. Furthermore, the method constructs a gradient descent optimization model to generate the better unified low dimensional embedding. The proposed method is compared with several single-view and multi-view dimensional reduction methods in these indicators of P, R, MAP and F-measure. In the retrieval experiments, the P values of the newmethod respectively are 86.80%, 52.00%, 68.56% and 78.80% on datasets of Corel1k, Corel5k, Corel10k and Holidays. In the classification experiments, the mean accuracies of it respectively are 47.94% and 87.58% on datasets of Caltech101 and Coil. These values are higher than those obtained by other comparison methods, various evaluations based on the applications of image classification and retrieval demonstrates the effectiveness of our proposed method on multi-view feature fusion dimension reduction.

Variational Image Fusion Approach Based on TGV and Local Information

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

An Efficient Fusion Algorithm Combining Feature Extraction and Variational Optimization for CT and MR Images

Infrared and Visible Image Fusion Via Variational Bayesian Approximation Method

Medical Image Fusion Based on Variational and Nonlinear Structure Tensor

Perceptual Contrast-Based Image Fusion： A Variational Approach

Multi-focus image fusion using residual removal and fractional order differentiation focus measure

A Multi-View Fusion Method Via Tensor Learning And Gradient Descent For Image Features

Confidence driven TGV fusion

Infrared and Visible Image Fusion Based on Local Gradient Constraints.

Medical image fusion based on improved multi-scale morphology gradient-weighted local energy and visual saliency map

EgeFusion: Towards Edge Gradient Enhancement in Infrared and Visible Image Fusion With Multi-Scale Transform

MRI/CT Fusion Based on Latent Low Rank Representation and Gradient Transfer

CT and MRI Image Fusion Algorithm Based on Hybrid ℓ0ℓ1 Layer Decomposing and Two-Dimensional Variation Transform

CT and MRI image fusion algorithm based on hybrid l 0 l 1 layer decomposing and two-dimensional variation transform

Variational Osmosis for Non-linear Image Fusion

Variational Model-Based Very High Spatial Resolution Remote Sensing Image Fusion

Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting

A new approach to medical image fusion based on the improved Extended difference-of-Gaussians combined with the Coati optimization algorithm

Medical image fusion based on extended difference-of-Gaussians and edge-preserving

The fusion of infrared and visible images via decomposition-based structure transfer and local saliency detection