Noise reduction in the spectral domain of hyperspectral images using denoising autoencoder methods

Chu Zhang,Lei Zhou,Yiying Zhao,Susu Zhu,Fei Liu,Yong He
DOI: https://doi.org/10.1016/j.chemolab.2020.104063
IF: 4.175
2020-08-01
Chemometrics and Intelligent Laboratory Systems
Abstract:<p>Denoising of spectra has been a great challenge in hyperspectral image analysis. Near-infrared hyperspectral images of milk powder, rice flour and soybean flour were acquired and denoising in the spectral domain were studied. Noise free spectra and noises were simulated based on sample pixel-wise spectra. The noisy spectra with signal to noise ratio (SNR) around 45 dB (similar to real pixel-wise spectra) were simulated. The simulated noisy spectra were preprocessed by traditional methods as moving average smoothing (MAS), Savitzky-Golay smoothing (SGS), wavelet transform (WT) and empirical mode decomposition (EMD). The basic denoising autoencoder (DAE-1) and the stacked DAE (DAE-2) were studied for denoising. The noisy spectra with SNR around 35 dB and 55 dB were further simulated to explore the effectiveness of DAE based methods. DAE-1 and DAE-2 performed better than the other methods, with higher SNR, lower mean squared error (MSE) and mean absolute error (MAE). The developed DAE methods were applied to real-world pixel-wise spectra with good performances. The overall results proved the feasibility of using DAE based methods for noise reduction in the spectral domain of hyperspectral images, and the DAE based methods have great potential to be extended to spectral denoising of other vibrational spectroscopy techniques.</p>
automation & control systems,computer science, artificial intelligence,instruments & instrumentation,statistics & probability,mathematics, interdisciplinary applications,chemistry, analytical
What problem does this paper attempt to address?