Abstract:Raman spectroscopy is a kind of vibrational method that can rapidly and non-invasively gives chemical structural information with the Raman spectrometer. Despite its technical advantages, in practical application scenarios, Raman spectroscopy often suffers from interference, such as noises and baseline drifts, resulting in the inability to acquire high-quality Raman spectroscopy signals, which brings challenges to subsequent spectral analysis. The commonly applied spectral preprocessing methods, such as Savitzky–Golay smooth and wavelet transform, can only perform corresponding single-item processing and require manual intervention to carry out a series of tedious trial parameters. Especially, each scheme can only be used for a specific data set. In recent years, the development of deep neural networks has provided new solutions for intelligent preprocessing of spectral data. In this paper, we first creatively started from the basic mechanism of spectral signal generation and constructed a mathematical model of the Raman spectral signal. By counting the noise parameters of the real system, we generated a simulation dataset close to the output of the real system, which alleviated the dependence on data during deep learning training. Due to the powerful nonlinear fitting ability of the neural network, fully connected network model is constructed to complete the baseline estimation task simply and quickly. Then building the Unet model can effectively achieve spectral denoising, and combining it with baseline estimation can realize intelligent joint processing. Through the simulation dataset experiment, it is proved that compared with the classic method, the method proposed in this paper has obvious advantages, which can effectively improve the signal quality and further ensure the accuracy of the peak intensity. At the same time, when the proposed method is applied to the actual system, it also achieves excellent performance compared with the common method, which indirectly indicates the effectiveness of the Raman signal simulation model. The research presented in this paper offers a variety of efficient pipelines for the intelligent processing of Raman spectroscopy, which can adapt to the requirements of different tasks while providing a new idea for enhancing the quality of Raman spectroscopy signals.

Simulation and quantitative analysis of Raman spectra in chemical processes with autoencoders

Automated Decomposition Algorithm for Raman Spectra Based on a Voigt Line Profile Model

Raman Spectroscopic Quantitative Analysis Based on Genetic Algorithm and Linear Superposition Principle

An Improved Algorithm to Remove Cosmic Spikes in Raman Spectra for Online Monitoring

Hyperspectral unmixing for Raman spectroscopy via physics-constrained autoencoders

Automated Hyperspectral 2D/3D Raman Analysis Using the Learner-Predictor Strategy: Machine Learning-Based Inline Raman Data Analytics

Deep learning-based Raman spectroscopy qualitative analysis algorithm: A convolutional neural network and transformer approach

Deep neural network: As the novel pipelines in multiple preprocessing for Raman spectroscopy

Transferability of Machine Learning Models for Predicting Raman Spectra

Simultaneous prediction of 16 quality attributes during protein A chromatography using machine learning based Raman spectroscopy models

Optimized Preprocessing and Machine Learning for Quantitative Raman Spectroscopy in Biology

Data Augmentation Scheme for Raman Spectra with Highly Correlated Annotations

Denoising and Baseline Correction Methods for Raman Spectroscopy Based on Convolutional Autoencoder: A Unified Solution

Integration of just‐in‐time learning with variational autoencoder for cell culture process monitoring based on Raman spectroscopy

A Novel Fault Detection and Identification Method for Complex Chemical Processes Based on OSCAE and CNN

Deep learning and artificial intelligence methods for Raman and surface-enhanced Raman scattering

Retrieving genuine nonlinear Raman responses in ultrafast spectroscopy via deep learning

Recent Progresses in Machine Learning Assisted Raman Spectroscopy

Novel Multimode Process Soft Sensing Methods Based on the Dynamic Mixture Variational Autoencoder Regression Model

Machine Learning algorithms for in-line monitoring during Yeast Fermentations based on Raman Spectroscopy

Assessing the Performance of 1D-Convolution Neural Networks to Predict Concentration of Mixture Components from Raman Spectra