Abstract:As a typical optical detective method, Raman spectroscopy has been widely used in many fields such as biological analysis, disease diagnosis and molecular recognition due to its unique non-invasive, fast, in-situ and extremely high specificity. The fingerprint characteristics of Raman Spectroscopy make it an important tool in the biomedical field. However, many problems greatly influence the application of this technology, including weak Raman scattering signal, the large dependence on analysts for data processing and analysis, and the low capabilities of automated processing. It is usually difficult to obtain an effective and stable Raman spectrum of various interference factors, including the noise from experimental equipment or environment and spontaneous fluorescence of the biological sample. All kinds of random noises will interfere with identifying fingerprint peak information in Raman spectroscopy and increase the difficulty of Raman feature extraction, so denoising is an important task in the preprocessing of Raman Spectroscopy analysis. In this paper, using the backpropagation algorithm and considering the characteristics of the data, we built the noise judgment and denoising neural network model respectively, based on the linear difference between the ideal spectral segment and the noisy spectral segment. For the simulation experiments, the data of Raman spectra are composed of a series of randomly generated mathematical models of the Lorentz peak. Different intensities of noises were added to the randomly generated single Raman spectrum and 100 groups of Raman spectra, respectively. In addition, the new method has been compared with the classic sliding window average method, Savitzky-Golay filter method, Fourier transforms, and wavelet threshold transform method. Using the Root mean square error and Signal to noise ratio indicators for analysis, the results show that all methods can complete the denoising task under low noise, but the denoising effect of the sliding window average method is obviously reduced at the edge of the spectrum. With the increase of the noise signal, the denoising performance of the sliding window average method, S-G filtering method, and Fourier transform method have all decreased significantly. Overall, the denoising method based on a backpropagation neural network is better than the Fourier transform method, sliding average window method, and S-G filter method. This method avoids complex parameter optimization settings and at the same time, obtains the denoising effect that is almost the same as the optimal wavelet transform method. It greatly simplifies the parameter setting and is more suitable for the automated denoising of the Raman spectrum.

Repairing Noise-Contaminated Low-Frequency Vibrational Spectra with an Attention U-Net

Denoising of Raman Spectra Using a Neural Network Based on Variational Mode Decomposition, Empirical Wavelet Transform, and Encoder-Bidirectional Long Short-Term Memory

A Denoising Method Based on Back Propagation Neural Network for Raman Spectrum

Retrieving genuine nonlinear Raman responses in ultrafast spectroscopy via deep learning

A Study on Denoising with Deep Convolutional Neural Networks in Spatial Heterodyne Spectroscopy

Iterative Differential Autoregressive Spectrum Estimation for Raman Spectrum Denoising

Modified Denoising Method of Raman Spectra-Based Deep Learning for Raman Semi-Quantitative Analysis and Imaging

Weak signal extraction enabled by deep neural network denoising of diffraction data

A Two-stage Raman Imaging Denoising Algorithm Based on Deep Learning

Noise Reduction of Nuclear Magnetic Resonance Spectroscopy Using Lightweight Deep Neural Network

Denoising Autoencoder Aided Spectrum Reconstruction for Colloidal Quantum Dot Spectrometers

Noise Reduction Technique for Raman Spectrum using Deep Learning Network

Deep neural network: As the novel pipelines in multiple preprocessing for Raman spectroscopy

Deep learning for 'artefact' removal in infrared spectroscopy

Attention-Based Octave Network for Hyperspectral Image Denoising

Learning Attention in the Frequency Domain for Flexible Real Photograph Denoising

Automatic Identification of Strong Energy Noise in Seismic Data Based on U-Net

An Adaptive Denoising Method for Raman Spectroscopy Based on Lifting Wavelet Transform

Efficient Seismic Data Denoising via Deep Learning With Improved MCA-SCUNet

A Spectrum Denoising Method Based on Low-Rank Recovery Dictionary Learning with Its Application to Chemical Oxygen Demand Detection

Self-Supervised Learning for Generic Raman Spectrum Denoising