Hyperspectral Image Mixed Noise Removal via Double Factor Total Variation Nonlocal Low-Rank Tensor Regularization

Yongjie Wu,Wei Xu,Liangliang Zheng

DOI: https://doi.org/10.3390/rs16101686

IF: 5

2024-05-10

Remote Sensing

Abstract:A hyperspectral image (HSI) is often corrupted by various types of noise during image acquisition, e.g., Gaussian noise, impulse noise, stripes, deadlines, and more. Thus, as a preprocessing step, HSI denoising plays a vital role in many subsequent tasks. Recently, a variety of mixed noise removal approaches have been developed for HSI, and the methods based on spatial–spectral double factor and total variation (DFTV) regularization have achieved comparable performance. Additionally, the nonlocal low-rank tensor model (NLR) is often employed to characterize spatial nonlocal self-similarity (NSS). Generally, fully exploring prior knowledge can improve the denoising performance, but it significantly increases the computational cost when the NSS prior is employed. To solve this problem, this article proposes a novel DFTV-based NLR regularization (DFTVNLR) model for HSI mixed noise removal. The proposed model employs low-rank tensor factorization (LRTF) to characterize the spectral global low-rankness (LR), introduces 2-D and 1-D TV constraints on double-factor to characterize the spatial and spectral local smoothness (LS), respectively. Meanwhile, the NLR is applied to the spatial factor to characterize the NSS. Then, we developed an algorithm based on proximal alternating minimization (PAM) to solve the proposed model effectively. Particularly, we effectively controlled the computational cost from two aspects, namely taking small-sized double factor as regularization object and putting the time-consuming NLR model before the main loop with fewer iterations to solve it independently. Finally, considerable experiments on simulated and real noisy HSI substantiate that the proposed method is superior to the related state-of-the-art methods in balancing the denoising effect and speed.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary

What problem does this paper attempt to address?

The problem this paper attempts to address is the impact of various types of noise on hyperspectral images (HSI) during acquisition, such as Gaussian noise, impulse noise, stripes, and dead lines. These noises severely degrade the quality of HSI, limiting the performance of subsequent tasks such as classification, unmixing, fusion, feature learning, super-resolution, and target detection. Therefore, HSI denoising, as a preprocessing step, plays a crucial role in many subsequent tasks.

Specifically, the paper proposes a hybrid noise removal method based on dual-factor total variation non-local low-rank tensor regularization (DFTVNLR), aiming to balance denoising effectiveness and computational cost. This method characterizes the global low-rankness (LR) of the spectrum through low-rank tensor factorization (LRTF), the local smoothness (LS) of the spatial and spectral domains through 2D and 1D total variation (TV) constraints, and the non-local self-similarity (NSS) of the spatial domain through a non-local low-rank model (NLR). Additionally, the paper develops a proximal alternating minimization (PAM) algorithm to efficiently solve the proposed model and improves efficiency by controlling two aspects of computational cost: first, using small-sized dual factors as regularization objects, and second, solving the time-consuming NLR model independently before the main loop to reduce the number of iterations. Finally, extensive experiments validate the superiority of the proposed method in removing hybrid noise, recovering spatial texture structures, and preserving spectral features.