Abstract:The fusion of multi-band images including far-infrared image (FIRI), near-infrared image (NIRI), and visible image (VISI) primarily suffers from four challenges. One is the problem of simultaneous fusion for multiple images. Most existing methods are oriented towards the fusion of two objects, which is generally achieved with a sequential fusion method. This means that intermediate fusion results are repeatedly integrated with the unprocessed images until all images have been fused. However, this may amplify the blurring effect, and even engender artifacts. Second, consistent training labels for image fusion cannot currently be obtained for some types of images (e.g., medical images, and multi-band images), which may lead to the failed application of supervised learning methods. Third, the existing methods often do not directly focus on the potential mapping relationship between the original, and resulting images, which usually increases the unpredictability of the fusion results. Fourth, redundant features or singularities are often not eliminated in the general fusion process, and both may interfere with or even obscure significant features in the source images. To address the abovementioned problems, this paper proposes a latent representation learning model that can synchronously integrate multi-band images without samples. Specifically, the model can capture the clean, and distinctive features of the originals via latent low-rank, and sparse embedding. The extracted intrinsic features are projected onto the target fusion space through an assumed mapping relationship. The final results were obtained through the designed optimization algorithm. In addition, numerous experiments were implemented to prove the rationality, and feasibility of the proposed fusion model with subjective evaluation, objective indexes, and convergence analysis.

Fusion Tracking in Color and Infrared Images Using Joint Sparse Representation

Fusion Tracking in Color and Infrared Images Using Sequential Belief Propagation

Tracking an Object over 200 FPS with the Fusion of Prior Probability and Kalman Filter

Visual Tracking Using Sparsity Induced Similarity

Real Time Object Tracking Using Fused Color And Edge Cues

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Visual tracking via robust multi-task multi-feature joint sparse representation

The Effect of Infrared and Visible Image Fusion on Object Tracking Using Correlation Matching

Tracking via Robust Multi-task Multi-view Joint Sparse Representation

QueryTrack: Joint-Modality Query Fusion Network for RGBT Tracking

Object fusion tracking for RGB-T images via channel swapping and modal mutual attention

Latent Representation Learning Model for Multi-Band Images Fusion via Low-Rank and Sparse Embedding

Robust visual tracking using incremental sparse representation

Visual Tracking Using Iterative Sparse Approximation

Infrared Object Tracking Algorithm with Temporal Features Fusion Siamese Network

Latent low-rank representation with sparse consistency constraint for infrared and visible image fusion

Robust Fragments-Based Tracking with Multi-Feature Joint Kernel Sparse Representation

Learning a Dynamic Feature Fusion Tracker for Object Tracking

Real-Time Speaker Tracking Using Particle Filter Sensor Fusion

Using Sparse Parts in Fused Information to Enhance Performance in Latent Low-Rank Representation-Based Fusion of Visible and Infrared Images

Infrared and visible image fusion based on domain transform filtering and sparse representation