Abstract:As a typical optical detective method, Raman spectroscopy has been widely used in many fields such as biological analysis, disease diagnosis and molecular recognition due to its unique non-invasive, fast, in-situ and extremely high specificity. The fingerprint characteristics of Raman Spectroscopy make it an important tool in the biomedical field. However, many problems greatly influence the application of this technology, including weak Raman scattering signal, the large dependence on analysts for data processing and analysis, and the low capabilities of automated processing. It is usually difficult to obtain an effective and stable Raman spectrum of various interference factors, including the noise from experimental equipment or environment and spontaneous fluorescence of the biological sample. All kinds of random noises will interfere with identifying fingerprint peak information in Raman spectroscopy and increase the difficulty of Raman feature extraction, so denoising is an important task in the preprocessing of Raman Spectroscopy analysis. In this paper, using the backpropagation algorithm and considering the characteristics of the data, we built the noise judgment and denoising neural network model respectively, based on the linear difference between the ideal spectral segment and the noisy spectral segment. For the simulation experiments, the data of Raman spectra are composed of a series of randomly generated mathematical models of the Lorentz peak. Different intensities of noises were added to the randomly generated single Raman spectrum and 100 groups of Raman spectra, respectively. In addition, the new method has been compared with the classic sliding window average method, Savitzky-Golay filter method, Fourier transforms, and wavelet threshold transform method. Using the Root mean square error and Signal to noise ratio indicators for analysis, the results show that all methods can complete the denoising task under low noise, but the denoising effect of the sliding window average method is obviously reduced at the edge of the spectrum. With the increase of the noise signal, the denoising performance of the sliding window average method, S-G filtering method, and Fourier transform method have all decreased significantly. Overall, the denoising method based on a backpropagation neural network is better than the Fourier transform method, sliding average window method, and S-G filter method. This method avoids complex parameter optimization settings and at the same time, obtains the denoising effect that is almost the same as the optimal wavelet transform method. It greatly simplifies the parameter setting and is more suitable for the automated denoising of the Raman spectrum.

Recent progress and applications of Raman spectrum denoising algorithms in chemical and biological analyses: A review

Denoising of Raman Spectra Using a Neural Network Based on Variational Mode Decomposition, Empirical Wavelet Transform, and Encoder-Bidirectional Long Short-Term Memory

A Denoising Method Based on Back Propagation Neural Network for Raman Spectrum

A Novel Pre-Processing Algorithm Based on the Wavelet Transform for Raman Spectrum

Recent advances in Raman technology with applications in agriculture, food and biosystems: A review

Recent Progresses in Machine Learning Assisted Raman Spectroscopy

Variational Mode Decomposition for Raman Spectral Denoising

An Adaptive Denoising Method for Raman Spectroscopy Based on Lifting Wavelet Transform

Iterative Differential Autoregressive Spectrum Estimation for Raman Spectrum Denoising

Denoising of Raman Spectra Based on Wavelet Transform

Recent advances in background-free Raman scattering for bioanalysis

Peak‐aware adaptive denoising for Raman spectroscopy based on machine learning approach

A Two-stage Raman Imaging Denoising Algorithm Based on Deep Learning

Self-Supervised Learning for Generic Raman Spectrum Denoising

Recovery of Raman Spectra with Low Signal-to-noise Ratio Using Wiener Estimation.

Modified Denoising Method of Raman Spectra-Based Deep Learning for Raman Semi-Quantitative Analysis and Imaging

Deep Learning for Raman Spectroscopy: A Review

Sparse decomposition enables adaptive and accurate Raman spectral denoising

Recent Advances in Spontaneous Raman Spectroscopic Imaging: Instrumentation and Applications

Advances in Raman spectroscopy and imaging for biomedical research

Deep neural network: As the novel pipelines in multiple preprocessing for Raman spectroscopy