Abstract:In the process of collecting spectrum signals, the spectrum data is often interfered with by the optical system and electronic circuit of the instrument, which results in noise and characteristic peaks of the light source, and seriously interferes with the spectrum characteristic of the real spectrum signal. Therefore, it is necessary to use a reasonable preprocessing method to retain the useful signal in the spectrum signal, filter the noise signal as much as possible and filter the light source characteristic peak to improve the robustness and accuracy of the quantitative analysis of spectral information. Spectrum online detection system requires minimizing the influence of human parameter selection on the denoising effect. Singular value decomposition (SVD) is often applied to the denoising caused by the system circuit. The selection of the order of singular value denoising is very important to improve the signal-to-noise ratio. However, the selection of parameters mainly depends on empirical debugging and experimental verification. Therefore, this paper proposes a spectral signal denoising algorithm based on singular value reconstruction of signal component frequency. The algorithm firstly reconstructs the single singular value component signal of the original spectral signal. Then, the Fast Fourier Transform (FFT) of each singular value component signal is performed to obtain the frequency value corresponding to the maximum amplitude of each signal. Finally, according to the singular value decreasing mode, the first-order hysteresis difference of the corresponding component signal frequency value is carried out, and the frequency difference spectrum is obtained. The results show that the first peak value of the difference spectrum is the effective order of singular value decomposition denoising. Random noise of different intensity is added to the UV-Visible spectrum signal measured online of a solution containing a variety of metals, and the signal to noise ratio and root mean square error are compared. The results show that the proposed algorithm's signal-to-noise ratio and root mean square error are 22. 05%, 10. 88% and 74. 28%, 41. 29% higher than those of SG filter and wavelet transform respectively. The proposed algorithm is fully data driven, which not only suppresses the noise effect in processing the real UV-Vis spectrum signal, but also effectively filters out the characteristic peak of the light source of the micro spectrometer, so it has a good application prospect in the quantitative analysis of UV-Vis spectrum signal.

Denoising Autoencoder Aided Spectrum Reconstruction for Colloidal Quantum Dot Spectrometers

Solver-informed Neural Networks for Spectrum Reconstruction of Colloidal Quantum Dot Spectrometers.

Robust Spectral Reconstruction Algorithm Enables Quantum Dot Spectrometers with Subnanometer Spectral Accuracy

A Spectrum Denoising Method Based on Low-Rank Recovery Dictionary Learning with Its Application to Chemical Oxygen Demand Detection

Iterative Differential Autoregressive Spectrum Estimation for Raman Spectrum Denoising

A Study on Denoising with Deep Convolutional Neural Networks in Spatial Heterodyne Spectroscopy

Denoising Autoencoder based Noise Reduction Technique for Raman Spectrometers for Standoff Detection of Chemical Warfare Agents

A Two-stage Raman Imaging Denoising Algorithm Based on Deep Learning

Denoising Algorithm of Spectral Signal Based on FFT SVD

Denoising of Digital Filtering Based on Wavelength Modulation Spectroscopy

A Neural Network Computational Spectrometer Trained by a Small Dataset with High-Correlation Optical Filters

A Self-Supervised Hyperspectral Image Restoration Method Based on Convolutional Sparse Coding and Superpixel Segmentation

Research on a Spectral Reconstruction Method with Noise Tolerance

Deep Learning-Based Denoising of Spatial Heterodyne Spectroscopy Interferograms Without Clear Images

Signal‐to‐noise Ratio Enhancement for Raman Spectra Based on Optimized Raman Spectrometer and Convolutional Denoising Autoencoder

Repairing Noise-Contaminated Low-Frequency Vibrational Spectra with an Attention U-Net

A colloidal quantum dot spectrometer

Denoising Hyperspectral Field Spectra of Vegetation with a Prosail-Fed Denoising Autoencoder.

Weak signal extraction enabled by deep neural network denoising of diffraction data

A Least Angle Regression Assessment Algorithm Based on Joint Dictionary for Visible and Near-Infrared Spectrum Denoising

DSPNet: A Lightweight Dilated Convolution Neural Networks for Spectral Deconvolution With Self-Paced Learning