Abstract:As a typical optical detective method, Raman spectroscopy has been widely used in many fields such as biological analysis, disease diagnosis and molecular recognition due to its unique non-invasive, fast, in-situ and extremely high specificity. The fingerprint characteristics of Raman Spectroscopy make it an important tool in the biomedical field. However, many problems greatly influence the application of this technology, including weak Raman scattering signal, the large dependence on analysts for data processing and analysis, and the low capabilities of automated processing. It is usually difficult to obtain an effective and stable Raman spectrum of various interference factors, including the noise from experimental equipment or environment and spontaneous fluorescence of the biological sample. All kinds of random noises will interfere with identifying fingerprint peak information in Raman spectroscopy and increase the difficulty of Raman feature extraction, so denoising is an important task in the preprocessing of Raman Spectroscopy analysis. In this paper, using the backpropagation algorithm and considering the characteristics of the data, we built the noise judgment and denoising neural network model respectively, based on the linear difference between the ideal spectral segment and the noisy spectral segment. For the simulation experiments, the data of Raman spectra are composed of a series of randomly generated mathematical models of the Lorentz peak. Different intensities of noises were added to the randomly generated single Raman spectrum and 100 groups of Raman spectra, respectively. In addition, the new method has been compared with the classic sliding window average method, Savitzky-Golay filter method, Fourier transforms, and wavelet threshold transform method. Using the Root mean square error and Signal to noise ratio indicators for analysis, the results show that all methods can complete the denoising task under low noise, but the denoising effect of the sliding window average method is obviously reduced at the edge of the spectrum. With the increase of the noise signal, the denoising performance of the sliding window average method, S-G filtering method, and Fourier transform method have all decreased significantly. Overall, the denoising method based on a backpropagation neural network is better than the Fourier transform method, sliding average window method, and S-G filter method. This method avoids complex parameter optimization settings and at the same time, obtains the denoising effect that is almost the same as the optimal wavelet transform method. It greatly simplifies the parameter setting and is more suitable for the automated denoising of the Raman spectrum.

A Least Angle Regression Assessment Algorithm Based on Joint Dictionary for Visible and Near-Infrared Spectrum Denoising

Hyperspectral Remote Image Denoising Based on Multitask Nonnegative Dictionary Learning

Local Regression Algorithm Based on Net Analyte Signal and Its Application in Near Infrared Spectral Analysis

A Spectrum Denoising Method Based on Low-Rank Recovery Dictionary Learning with Its Application to Chemical Oxygen Demand Detection

Spectral-Spatial Joint Noise Estimation for Hyperspectral Images

A Denoising Method Based on Back Propagation Neural Network for Raman Spectrum

Joint Baseline-Correction and Denoising for Raman Spectra

Panchromatic image based dictionary learning for hyperspectral imagery denoising

A Noise-Model-Free Hyperspectral Image Denoising Method Based on Diffusion Model.

A Study on Denoising with Deep Convolutional Neural Networks in Spatial Heterodyne Spectroscopy

Research on an Optical E-Nose Denoising Method Based on LSSVM

Image Denoising Using Local Adaptive Least Squares Support Vector Regression

Image Denoising via Joint-Dictionary Learning

Denoising of Raman Spectra Using a Neural Network Based on Variational Mode Decomposition, Empirical Wavelet Transform, and Encoder-Bidirectional Long Short-Term Memory

Multispectral imagery denoising using hierarchical dictionary learning with spatial-spectral information

Hyperspectral Image Denoising Based On Spectral Dictionary Learning And Sparse Coding

Hierarchical Sparse Learning with Spectral-Spatial Information for Hyperspectral Imagery Denoising.

High Resolution Remote Sensing Image Denoising Algorithm Based on Sparse Representation and Adaptive Dictionary Learning

Combining Deep Denoiser and Low-rank Priors for Infrared Small Target Detection

Infrared Spectrum Denoising with Combination of Lifting Wavelet Domain Thresholding and Median Filtering

Denoising Method of Airborne IRMSS Based on Low-rank Matrix Approximation and Constant Statistics