The Internet Knowledge Manager, Dynamic Digital Libraries, and Agents You Can Understand

A. Walker

DOI: https://doi.org/10.1045/MARCH98-WALKER

1998-03-15

D-Lib Magazine

Abstract:

What problem does this paper attempt to address?

Automated background subtraction algorithm for raman spectra based on iterative weighted least squares

Hua Ruan,LianKui Dai

2011-01-01

Asian Journal of Chemistry

Abstract:A major problem in Raman spectroscopy is that the spectrum is often suffered from intrinsic fluorescence which is orders of magnitude greater than the Raman signal. Background subtraction is essential for further analysis, particularly for quantitative analysis using multivariate calibration. In this paper, we propose a background removal algorithm which approximates the background by a polynomial and estimates the polynomial coefficients by iterative weighted least squares. The performance of the algorithm accompanied with two comparative methods are evaluated both on simulated and real Raman spectra. The results show that the proposed algorithm provides the best result using R(2) between the actual and extracted Raman peaks. It also improves the performance of background removal in quantitative Raman spectroscopy. Further more, the algorithm is least dependent on the choice of polynomial order.
Background Subtraction of Raman Spectra Based on Iterative Polynomial Smoothing

Tuo Wang,Liankui Dai

DOI: https://doi.org/10.1177/0003702816670915

2016-01-01

Applied Spectroscopy

Abstract:In this paper, a novel background subtraction algorithm is presented that can automatically recover Raman signal. This algorithm is based on an iterative polynomial smoothing method that highly reduces the need for experience and a priori knowledge. First, a polynomial filter is applied to smooth the input spectrum (the input spectrum is just an original spectrum at the first iteration). The output curve of the filter divides the original spectrum into two parts, top and bottom. Second, a proportion is calculated between the lowest point of the signal in the bottom part and the highest point of the signal in the top part. The proportion is a key index that decides whether to go into a new iteration. If a new iteration is needed, the minimum value between the output curve and the original spectrum forms a new curve that goes into the same filter in the first step and continues as another iteration until no more iteration is needed to finally get the background of the original spectrum. Results from the simulation experiments not only show that the iterative polynomial smoothing algorithm achieves good performance, processing time, cost, and accuracy of recovery, but also prove that the algorithm adapts to different background types and a large signal-to-noise ratio range. Furthermore, real measured Raman spectra of organic mixtures and non-organic samples are used to demonstrate the application of the algorithm.
Automated Decomposition Algorithm for Raman Spectra Based on a Voigt Line Profile Model

Yunliang Chen,Liankui Dai

DOI: https://doi.org/10.1364/ao.55.004085

IF: 1.9

2016-01-01

Applied Optics

Abstract:Raman spectra measured by spectrometers usually suffer from band overlap and random noise. In this paper, an automated decomposition algorithm based on a Voigt line profile model for Raman spectra is proposed to solve this problem. To decompose a measured Raman spectrum, a Voigt line profile model is introduced to parameterize the measured spectrum, and a Gaussian function is used as the instrumental broadening function. Hence, the issue of spectral decomposition is transformed into a multiparameter optimization problem of the Voigt line profile model parameters. The algorithm can eliminate instrumental broadening, obtain a recovered Raman spectrum, resolve overlapping bands, and suppress random noise simultaneously. Moreover, the recovered spectrum can be decomposed to a group of Lorentzian functions. Experimental results on simulated Raman spectra show that the performance of this algorithm is much better than a commonly used blind deconvolution method. The algorithm has also been tested on the industrial Raman spectra of ortho-xylene and proved to be effective.
Background-free stimulated Raman scattering imaging by manipulating photons in the spectral domain

Hanlin Zhu,Hyeon Jeong Lee,Delong Zhang

DOI: https://doi.org/10.1016/b978-0-323-85158-9.00002-6

2022-01-01

Abstract:Stimulated Raman scattering (SRS) is widely accepted as free of the nonresonant background appearing in coherent antiStokes Raman scattering (CARS), which led to a common misunderstanding that SRS is background free. On the contrary, the phase-sensitive detection scheme of conventional SRS imaging is subject to quite a few competing nonRaman processes, including transient absorption, cross-phase modulation, photothermal lensing, and two-photon absorption, which can often overwhelm real Raman signal and should be considered as nonresonant background. Although high-NA collection and longer excitation wavelength can help reduce such background signals, it still imposes limitations to image quality thus broader applications of SRS imaging. In order to make SRS imaging truly background free, new strategies have been demonstrated based on the aspect of spectroscopy, i.e., Raman process differs from background signals fundamentally in physics, which can then be distinguished spectrally. This chapter focuses on the technological advances of background-free SRS imaging, followed by a brief introduction of the enabling applications.
Blind Spectral Unmixing Based on Sparse Component Analysis for Hyperspectral Remote Sensing Imagery

Yanfei Zhong,Xinyu Wang,Lin Zhao,Ruyi Feng,Liangpei Zhang,Yanyan Xu

DOI: https://doi.org/10.1016/j.isprsjprs.2016.04.008

IF: 12.7

2016-01-01

ISPRS Journal of Photogrammetry and Remote Sensing

Abstract:Recently, many blind source separation (BSS)-based techniques have been applied to hyperspectral unmixing. In this paper, a new blind spectral unmixing method based on sparse component analysis (BSUSCA) is proposed to solve the problem of highly mixed data. The BSUSCA algorithm consists of an alternative scheme based on two-block alternating optimization, by which we can simultaneously obtain the endmember signatures and their corresponding fractional abundances. According to the spatial distribution of the endmembers, the sparse properties of the fractional abundances are considered in the proposed algorithm. A sparse component analysis (SCA)-based mixing matrix estimation method is applied to update the endmember signatures, and the abundance estimation problem is solved by the alternating direction method of multipliers (ADMM). SCA is utilized for the unmixing due to its various advantages, including the unique solution and robust modeling assumption. The robustness of the proposed algorithm is verified through simulated experimental study. The experimental results using both simulated data and real hyperspectral remote sensing images confirm the high efficiency and precision of the proposed algorithm.
Multi-Source Separation Under Two “Blind” Conditions for Fiber-Optic Distributed Acoustic Sensor

Huijuan Wu,Yimeng Liu,Yunlin Tu,Yuwen Sun,Dengke Gan,Yuanfeng Song,Yunjiang Rao

DOI: https://doi.org/10.1109/jlt.2022.3142020

IF: 4.7

2022-04-15

Journal of Lightwave Technology

Abstract:Significant progress has been made in single source recognition for fiber-optical distributed acoustic sensor (DAS). However, it is still challenging to detect and identify more than one unpredictable vibration sources when they are superimposed at the same fiber receiving point. Thus, in this paper it is proposed a blind multi-source separation method based on fast independent component analysis (FastICA), which utilizes the independency and non-Gaussianity of different sources. Firstly, two multi-source mixing mechanisms and separability of different sources received by DAS based on -OTDR are discussed; to solve the two blind problems that the source number and the mixing mode are both unknown, a linear simultaneous mixing mode is assumed, and the source number is estimated by singular value decomposition to the observation matrix; then preprocessing of denoising and anti-mixing, and separation with FastICA by maximizing negative entropy are carried out to make the non-Gaussianity of the estimated signal achieve its maximum; finally, feasibility of the separation method is evaluated through several mixing cases including simulations with two to four field collected signals and a real field test with two sources superimposed on the buried fiber. Signal waves and the spectra, and three separation indicators, such as the Performance Index (PI), the signal correlation coefficients, and the signal mean square error (SMSE), are used to evaluate the performance of the method. As far as we know, it is the first time to realize the separation of an unknown number of the superimposed sources detected by DAS.

engineering, electrical & electronic,optics,telecommunications
Improving Quantitative Analysis with Cross Instrument-Sparse Bayesian Learning (CI-SBL) Raman Spectroscopy Analysis Algorithm

Jinglei Zhai,Zilong Wang,Xin Chen,Yunfeng Li,Tengyu Wu,Biao Sun,Pei Liang

DOI: https://doi.org/10.1021/acs.analchem.4c02659

2024-08-06

Abstract:Qualitative and quantitative analysis of Raman spectroscopy is a widely used nondestructive analytical technique in many fields. It utilizes the Raman scattering effect of lasers to obtain molecular vibration information on samples. By comparison with the Raman spectra of standard substances, qualitative and quantitative analyses can be achieved on unknown samples. However, current Raman spectroscopy analysis algorithms still have many drawbacks. They struggled to handle quantitative analysis between different instruments. Their prediction accuracy for concentration is generally low, with poor robustness. Therefore, this study addresses these deficiencies by designing the cross instrument-sparse Bayesian learning (CI-SBL) Raman spectroscopy analysis algorithm. CI-SBL can facilitate spectroscopic analysis between different instruments through the cross instrument module. CI-SBL converts data from portable instruments into data from scientific instruments, with high similarity between the converted spectrum and the spectrum from the scientific instruments reaching 98.6%. The similarity between the raw portable instrument spectrum and the scientific instrument spectrum is often lower than 90%. The cross instrument effect of the CI-SBL is remarkable. Moreover, CI-SBL employs sparse Bayesian learning (SBL) as the core module for analysis. Through multiple iterations, the SBL algorithm effectively identified various components within mixtures. In experiments, CI-SBL can achieve a qualitative accuracy of 100% for the majority of binary and multicomponent mixtures. On the other hand, the previous Raman spectroscopy analysis algorithms predominantly yield a qualitative accuracy below 80% for the same data. Additionally, CI-SBL incorporates a quantitative module to calculate the concentration of each component within the mixed samples. In the experiment, the quantification error for all substances was below 3%, with the majority of the substances exhibiting an error of approximately 1%. These experimental results illustrate that CI-SBL significantly enhances the accuracy of qualitative judgment of mixture spectra and the prediction of mixture concentrations compared with previous Raman spectroscopy analysis algorithms. Furthermore, the cross instrument module of CI-SBL allows for a flexible handling of data acquired from different instruments.
Recent advances in background-free Raman scattering for bioanalysis

Xuehui Liu,Xiaoman Liu,Pengfei Rong,Dingbin Liu

DOI: https://doi.org/10.1016/j.trac.2019.115765

IF: 14.908

2020-02-01

TrAC Trends in Analytical Chemistry

Abstract:<p>With the characteristics of intrinsically free from photobleaching, blinking, and self-quenching, Raman microscopy has become a powerful platform in detecting molecular vibrations for diverse applications. In particular, Raman spectroscopy has proven very useful for bioanalysis but suffers from several challenges such as poor sensitivity, spectral overlapping, and background interference. In this review, we would like to introduce two kinds of high-fidelity imaging strategies, including background-free surface-enhanced Raman scattering (SERS) and stimulated Raman scattering (SRS) that are capable of significantly enhancing detection sensitivity and spectral resolution while minimizing background interference simultaneously. Recent advances in background-free SERS and SRS and their applications in biological detection and cellular imaging are summarized and discussed.</p>

chemistry, analytical
A Complexity Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing

Sen Jia,Yuntao Qian

DOI: https://doi.org/10.1109/tgrs.2008.2002882

IF: 8.2

2009-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Hyperspectral unmixing, as a blind source separation (BSS) problem, has been intensively studied from independence aspect in the last few years. However, independent component analysis (ICA) can not totally unmix all the materials out because the sources (abundance fractions) are not statistically independent. In this paper a complexity constrained nonnegative matrix factorization (CCNMF) for simultaneously recovering both constituent spectra and correspondent abundances is proposed. Three important facts are exploited: First, the spectral data are nonnegative; second, the variation of the material spectra and abundance images is smooth in time and space respectively; third, in most cases, both of the material spectra and abundances are localized. Experimentations on real data are provided to illustrate the algorithm's performance.
Blind Source Separation with Compressively Sensed Based on SBL

Zhichao Sha,Fengbo Lu,Weidong Sheng

DOI: https://doi.org/10.1145/3093241.3093260

2017-01-01

Abstract:In this paper an efficient method is proposed for blind separating and reconstructing signals from compressively sensed linear mixtures. We assume that all sources share a common sparse representation basis and nonzero indices of these signals are different mostly. Sparse Bayesian learning (SBL) is developed to estimate the product of mixture matrix and signal. Subsequently, we use clustering method to estimate the mixture matrix and use subspace algorithm to estimate all source signals. Numerical results show efficiency of the proposed algorithm compared to previous method.
A Sparse Semi-Blind Source Identification Method and Its Application to Raman Spectroscopy for Explosives Detection

Y. Sun,J. Xin

DOI: https://doi.org/10.48550/arXiv.1110.1432

2011-10-07

Abstract:Rapid and reliable detection and identification of unknown chemical substances is critical to homeland security. It is challenging to identify chemical components from a wide range of explosives. There are two key steps involved. One is a nondestructive and informative spectroscopic technique for data acquisition. The other is an associated library of reference features along with a computational method for feature matching and meaningful detection within or beyond the library. Recently several experimental techniques based on Raman scattering have been developed to perform standoff detection and identification of explosives, and they prove to be successful under certain idealized conditions. However data analysis is limited to standard least squares method assuming the complete knowledge of the chemical components. In this paper, we develop a new iterative method to identify unknown substances from mixture samples of Raman spectroscopy. In the first step, a constrained least squares method decomposes the data into a sum of linear combination of the known components and a non-negative residual. In the second step, a sparse and convex blind source separation method extracts components geometrically from the residuals. Verification based on the library templates or expert knowledge helps to confirm these components. If necessary, the confirmed meaningful components are fed back into step one to refine the residual and then step two extracts possibly more hidden components. The two steps may be iterated until no more components can be identified. We illustrate the proposed method in processing a set of the so called swept wavelength optical resonant Raman spectroscopy experimental data by a satisfactory blind extraction of a priori unknown chemical explosives from mixture samples.

Numerical Analysis,Data Analysis, Statistics and Probability
Raman Spectroscopic Quantitative Analysis Based on Genetic Algorithm and Linear Superposition Principle

Guo-Ji Wen,Lian-Kui Dai,Wei Liu

DOI: https://doi.org/10.19756/j.issn.0253-3820.201500

IF: 1.193

2021-01-01

Chinese Journal of Analytical Chemistry

Abstract:A Raman quantitative analysis algorithm based on genetic algorithm ( GA) and linear additive model was developed. When the Raman spectrum of one main substance in a batch of mixed samples was known, the characteristic peak position of each component could be obtained by correlation analysis. Then genetic algorithm ( GA) was used to fit and optimize the corresponding spectral matrix of the pure substance. Finally, the obtained spectral matrix was used to establish the Raman quantitative analysis model of various substances in the mixture. This method only required a large amount of calculation when optimizing model parameters in the model training process, and only needed to perform simple matrix operations in actual prediction, showing a small real-time calculation amount. The developed method was suitable for continuous online applications, and could be applied to the quantitative analysis of liquid and gas mixture. By taking natural gas as an example, when the Raman spectrum of the main component in methane was known, based on a set of natural gas training samples whose composition and Raman spectrum were known, a quantitative analysis model based on Raman spectrum for main components in natural gas ( CH4, C2H6, C3H8, CO2, N-2, H-2, CO) was developed. For the test sample set, the corresponding root mean square error ( RMSE) were 0. 488%, 0. 103%, 0. 358%, 0. 079%, 0. 087%, 0. 126% and 0. 022%, and the multiple correlation coefficient ( R-2) were 0. 995, 0. 991, 0. 990, 0. 991, 0. 998, 0. 999 and 0. 999, respectively. Although the result was just slightly inferior to the result when the spectra of all pure substances were known, the algorithm presented here provided a solution for the case when some pure substance spectra were unknown.
A Novel Pre-Processing Algorithm Based on the Wavelet Transform for Raman Spectrum

Yang Xi,Yuee Li,Zhizhen Duan,Yang Lu

DOI: https://doi.org/10.1177/0003702818789695

2018-08-02

Applied Spectroscopy

Abstract:Noise and fluorescent background are two major problems for acquiring Raman spectra from samples, which blur Raman spectra and make Raman detection or imaging difficult. In this paper, a novel algorithm based on wavelet transform that contains denoising and baseline correction is presented to automatically extract Raman signals. For the denoising section, the improved conventional-scale correlation denoising method is proposed. The baseline correction section, which is performed after denoising, basically consists of five aspects: (1) detection of the peak position; (2) approximate second derivative calculation based on continuous wavelet transform is performed using the Haar wavelet function to find peaks and background areas; (3) the threshold is estimated from the peak intensive area for identification of peaks; (4) correction of endpoints, spectral peaks, and peak position; and (5) determine the endpoints of the peak after subtracting the background. We tested this algorithm for simulated and experimental Raman spectra, and a satisfactory denoising effect and a good capability to correct background are observed. It is noteworthy that this algorithm requires few human interventions, which enables automatic denoising and background removal.

spectroscopy,instruments & instrumentation
A sparse unmixing model based on NMF and its application in Raman image.

Yifei Xu,ShuiGuang Deng,Xiaoli Li,Yong He

DOI: https://doi.org/10.1016/j.neucom.2016.03.063

IF: 6

2016-01-01

Neurocomputing

Abstract:Spectral unmixing is a critical issue in multi-spectral data processing, which has the ability to determine the composition and the structural characteristics of the Raman image. Most of current unmixing methods work well to explore the materials in an ideal scenario. However, both the noise and the requirement of the prior knowledge limit their practical application. Thus, we propose a sparse method called to unmix spectra and apply it to explore the elucidate structural and spatial distribution of the plant cell well. GRSRNMF utilizes the blind source separation technology based on NMF to determine the basis elements (abundances) and their corresponding components (endmembers) without prior knowledge. GRSRNMF incorporates graph relationship and L1/2 regularizer to improve the robustness and effectiveness. Besides, two proper indicators are designed to assess the unmixing method for Raman image when the standard spectrum library does not exist. Experiments are conducted on simulated datasets and the real-world Raman image to evaluate the performance of the proposed methods from various aspects. Experimental results illustrate that the proposed method favors sparsity and offers improved estimation accuracy compared to other methods.
Estimation of biological variance in coherent Raman microscopy data of two cell lines using chemometrics

Rajendhar Junjuri,Matteo Calvarese,MohammadSadegh Vafaeinezhad,Federico Vernuccio,Marco Ventura,Tobias Meyer-Zedler,Benedetta Gavazzoni,Dario Polli,Renzo Vanna,Italia Bongarzone,Silvia Ghislanzoni,Matteo Negro,Juergen Popp,Thomas Bocklitz

DOI: https://doi.org/10.1039/d4an00648h

2024-08-19

Abstract:Broadband Coherent Anti-Stokes Raman Scattering (BCARS) is a valuable spectroscopic imaging tool for visualizing cellular structures and lipid distributions in biomedical applications. However, the inevitable biological changes in the samples (cells/tissues/lipids) introduce spectral variations in BCARS data and make analysis challenging. In this work, we conducted a systematic study to estimate the biological variance in BCARS data of two commonly used cell lines (HEK293 and HepG2) in biomedical research. The BCARS data were acquired from two different experimental setups (Leibniz Institute of Photonics Technology (IPHT) in Jena and Politecnico di Milano (POLIMI) in Milano) to evaluate the reproducibility of results. Also, spontaneous Raman data were independently acquired at POLIMI to validate those results. First, Kramers-Kronig (KK) algorithm was utilized to retrieve Raman-like signals from the BCARS data, and a pre-processing pipeline was subsequently used to standardize the data. Principal component analysis - Linear discriminant analysis (PCA-LDA) was performed using two cross-validation (CV) methods: batch-out CV and 10-fold CV. Additionally, the analysis was repeated, considering different spectral regions of the data as input to the PCA-LDA. Finally, the classification accuracies of the two BCARS datasets were compared with the results of spontaneous Raman data. The results demonstrated that the CH band region (2770-3070 cm-1) and spectral data in the 1500-1800 cm-1 region have significantly contributed to the classification. A maximum of 100% balanced accuracies were obtained for the 10-fold CV for both BCARS setups. However, in the case of batch-out CV, it is 92.4% for the IPHT dataset and 98.8% for the POLIMI dataset. This study offers a comprehensive overview for estimating biological variance in biomedical applications. The insights gained from this analysis hold promise for improving the reliability of BCARS measurements in biomedical applications, paving the way for more accurate and meaningful spectroscopic analyses in the study of biological systems.
Spectra Data Analysis and Calibration Modeling Method Using Spectra Subspace Separation and Multiblock Independent Component Regression Strategy

Chunhui Zhao,Furong Gao,Fuli Wang

DOI: https://doi.org/10.1002/aic.12333

IF: 4.167

2010-01-01

AIChE Journal

Abstract:In this article, a spectra data analysis and calibration modeling approach is proposed for the estimation of the concentration of sources species in chemical mixture. Based on the multiplicity of underlying spectra characteristics, it designs spectra subspace separation and multiblock independent component regression modeling strategy. It is performed in two steps: The first step aims at an automatic partition of the original wavelength space into different spectra subspaces to reveal the changes of underlying spectra information. In different spectra subspaces, each being well fitted by one independent component analysis (ICA) model, it better explores the existing chemical constituent species of interest. In the second step, multiblock regression system is designed for concentration estimation. The advantage is mainly to allow for easier interpretation and enhanced understanding by zooming into different smaller specific segments and thus well tracking the wavelength-varying effects on qualities. It is theoretically and experimentally illustrated that the proposed method can result in better predictive power compared with standard ICR (SICR) modeling focusing on the full-range wavelength. (C) 2010 American Institute of Chemical Engineers AIChE J, 57: 1202-1215, 2011
Unraveling Mixtures: A Novel Underdetermined Blind Source Separation Approach via Sparse Component Analysis

Yanyang Li,Jindong Wang,Haiyang Zhao,Chang Wang,Zhichao Ma

DOI: https://doi.org/10.1109/access.2024.3349427

IF: 3.9

2024-02-03

IEEE Access

Abstract:Underdetermined blind source separation (UBSS) is a critical technique in the field of intelligent mechanical operation and maintenance that allows for the disentanglement of source signals from their mixtures without the need for prior knowledge or extensive sensor information. The accuracy of source signal recovery depends on the estimation of the mixing matrix. To promote sparsity in source signals, we employed methods such as sparse representation and sparse component analysis. Traditional approaches, such as the Short-Time Fourier Transform (STFT), often suffer from limited time-frequency resolution, motivating the adoption of the Synchronous Extraction Transformation (SET) algorithm, which closely approximates the ideal time-frequency transform. SET significantly enhances the sparsity of the signals, thus facilitating the separation of the mixed signals. In the context of sparse component analysis, we introduce an improved density peaks clustering (DPC) method that successfully resolves source number estimation issues and robustly eliminates outliers. This improvement leads to a more accurate mixing matrix estimation. To determine the cluster centers, we employed K-means clustering, further refining our source separation process. In summary, our study presents an innovative approach that combines the Synchronous Extraction Transformation (SET) with 'an improved density peaks clustering (DPC)' method and K-means for mixing matrix estimation. Source signal recovery was achieved using the shortest-path algorithm. Extensive simulations and experiments validate the effectiveness of the method, outperforming the traditional techniques. When applied to rolling bearing fault diagnosis, the proposed approach effectively separates complex signals and accurately identifies the fault characteristic frequencies.

computer science, information systems,telecommunications,engineering, electrical & electronic
A smart universal single-channel blind source separation method and applications

Qiao Zhou,Jie-Peng Yao,Jin-Hai Li,Zhong-Yi Wang,Lan Huang

DOI: https://doi.org/10.1007/s11045-022-00843-x

IF: 2.03

2022-08-14

Multidimensional Systems and Signal Processing

Abstract:In industrial, biological, medical and many more scenarios, single-channel blind source separation still remains challenges. A smart universal single-channel blind source separation method, the iterative heuristic general hybrid model with evaluation parameters feedback, Loop-BAS-VMD-ICA, is proposed and verified to recover the original sources automatically in multiple scenarios. Combined with beetle antennae search algorithm based variational mode decomposition and independent component analysis, by designing a new fitness function armed with processing effects of variational mode decomposition components and the final candidate source signals in each step of beetle antennae search algorithm, this model allows us to reconstruct a new optimized vector combining the selected components of variational mode decomposition with the original observation signal through a new scheme by loop mode with evaluation parameters feedback, and then the new vector is used to separate and extract independent source signals by iterative and heuristic calculation. Experimental results show that our method is not only smart, good versatile but also outperforms the state-of-the-art traditional time–frequency-based methods in extraction accuracy and waveform integrity. Compared with the state-of-the-art deep learning based methods, our method also demonstrates its unique advantages. It provides a better and more extensive means for the analysis and application of multicomponent signals.

engineering, electrical & electronic,computer science, theory & methods
Denoising and Baseline Correction Methods for Raman Spectroscopy Based on Convolutional Autoencoder: A Unified Solution

Ming Han,Yu Dang,Jianda Han

DOI: https://doi.org/10.3390/s24103161

IF: 3.9

2024-05-17

Sensors

Abstract:Preprocessing plays a key role in Raman spectral analysis. However, classical preprocessing algorithms often have issues with reducing Raman peak intensities and changing the peak shape when processing spectra. This paper introduces a unified solution for preprocessing based on a convolutional autoencoder to enhance Raman spectroscopy data. One is a denoising algorithm that uses a convolutional denoising autoencoder (CDAE model), and the other is a baseline correction algorithm based on a convolutional autoencoder (CAE+ model). The CDAE model incorporates two additional convolutional layers in its bottleneck layer for enhanced noise reduction. The CAE+ model not only adds convolutional layers at the bottleneck but also includes a comparison function after the decoding for effective baseline correction. The proposed models were validated using both simulated spectra and experimental spectra measured with a Raman spectrometer system. Comparing their performance with that of traditional signal processing techniques, the results of the CDAE-CAE+ model show improvements in noise reduction and Raman peak preservation.

engineering, electrical & electronic,instruments & instrumentation,chemistry, analytical
Method for Removing Spectral Contaminants to Improve Analysis of Raman Imaging Data

Xun Zhang,Sheng Chen,Zhe Ling,Xia Zhou,Da-Yong Ding,Yoon Soo Kim,Feng Xu

DOI: https://doi.org/10.1038/srep39891

IF: 4.6

2017-01-05

Scientific Reports

Abstract:The spectral contaminants are inevitable during micro-Raman measurements. A key challenge is how to remove them from the original imaging data, since they can distort further results of data analysis. Here, we propose a method named “automatic pre-processing method for Raman imaging data set (APRI)”, which includes the adaptive iteratively reweighted penalized least-squares (airPLS) algorithm and the principal component analysis (PCA). It eliminates the baseline drifts and cosmic spikes by using the spectral features themselves. The utility of APRI is illustrated by removing the spectral contaminants from a Raman imaging data set of a wood sample. In addition, APRI is computationally efficient, conceptually simple and potential to be extended to other methods of spectroscopy, such as infrared (IR), nuclear magnetic resonance (NMR), X-Ray Diffraction (XRD). With the help of our approach, a typical spectral analysis can be performed by a non-specialist user to obtain useful information from a spectroscopic imaging data set.

multidisciplinary sciences

The Internet Knowledge Manager, Dynamic Digital Libraries, and Agents You Can Understand

Automated background subtraction algorithm for raman spectra based on iterative weighted least squares

Background Subtraction of Raman Spectra Based on Iterative Polynomial Smoothing

Automated Decomposition Algorithm for Raman Spectra Based on a Voigt Line Profile Model

Background-free stimulated Raman scattering imaging by manipulating photons in the spectral domain

Blind Spectral Unmixing Based on Sparse Component Analysis for Hyperspectral Remote Sensing Imagery

Multi-Source Separation Under Two “Blind” Conditions for Fiber-Optic Distributed Acoustic Sensor

Improving Quantitative Analysis with Cross Instrument-Sparse Bayesian Learning (CI-SBL) Raman Spectroscopy Analysis Algorithm

Recent advances in background-free Raman scattering for bioanalysis

A Complexity Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing

Blind Source Separation with Compressively Sensed Based on SBL

A Sparse Semi-Blind Source Identification Method and Its Application to Raman Spectroscopy for Explosives Detection

Raman Spectroscopic Quantitative Analysis Based on Genetic Algorithm and Linear Superposition Principle

A Novel Pre-Processing Algorithm Based on the Wavelet Transform for Raman Spectrum

A sparse unmixing model based on NMF and its application in Raman image.

Estimation of biological variance in coherent Raman microscopy data of two cell lines using chemometrics

Spectra Data Analysis and Calibration Modeling Method Using Spectra Subspace Separation and Multiblock Independent Component Regression Strategy

Unraveling Mixtures: A Novel Underdetermined Blind Source Separation Approach via Sparse Component Analysis

A smart universal single-channel blind source separation method and applications

Denoising and Baseline Correction Methods for Raman Spectroscopy Based on Convolutional Autoencoder: A Unified Solution

Method for Removing Spectral Contaminants to Improve Analysis of Raman Imaging Data