Abstract:It has been well recognized that infrared spectra of microscopically heterogeneous media do not merely reflect the absorption of the sample but are influenced also by geometric factors and the wave nature of light causing scattering, reflection, interference, etc. These phenomena often occur simultaneously in complex samples like tissues and manifest themselves as intense baseline profiles, fringes, band distortion and band intensity changes in a measured IR spectrum. The information on the molecular level contained in IR spectra is thus entangled with the geometric structure of a sample and the optical model behind it, which largely hinders the data interpretation and in many cases renders the Beer-Lambert law invalid. It is required to recover the pure absorption (i.e., absorbance) of the sample from the measurement (i.e., apparent absorbance), that is, to remove the 'artefacts' caused merely by optical influences. To do so, we propose an artefact removal approach based on a deep convolutional neural network (CNN), specifically a 1-dimensional U-shape convolutional neural network (1D U-Net), and based our study on poly(methyl methacrylate) (PMMA) as materials. To start, a simulated dataset composed of apparent absorbance and absorbance pairs was generated according to the Mie-theory for PMMA spheres. After a data augmentation procedure, this dataset was utilized to train the 1D U-Net aiming to transform the input apparent absorbance into the corrected absorbance. The performance of the artefact removal was evaluated by the hit-quality-index (HQI) between the corrected and the true absorbance. Based on the prediction and the HQI of two experimental and one simulated independent testing datasets, we could demonstrate that the network was able to retrieve the absorbance very well, even in cases where the absorbance is completely overwhelmed by extremely large 'artefacts'. As the testing datasets bear different patterns of absorbance and 'artefacts' to the training data, the promising correction also indicated a good generalization performance of the 1D U-Net. Finally, the reliability and computational mechanism of the trained network were illustrated via two interpretation approaches including a direct visualization of layer-wise outputs as well as a saliency-based method.

Deep neural network for x-ray photoelectron spectroscopy data analysis

Highly sensitive 2D X-ray absorption spectroscopy via physics informed machine learning

Machine Learning Automated Analysis of Enormous Synchrotron X-ray Diffraction Datasets

Machine Learning Automated Approach for Enormous Synchrotron X-Ray Diffraction Data Interpretation

Si K edge X-ray spectrum absorption interpretation using Neural Network

Auto-Encoder Neural Network Incorporating X-Ray Fluorescence Fundamental Parameters with Machine Learning

Deep Learning for Spectroscopic X‐ray Nano‐Imaging Denoising

Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations

Accelerating Materials Discovery: Automated Identification of Prospects from X‐Ray Diffraction Data in Fast Screening Experiments

A Deep Convolutional Neural Network to Analyze Position Averaged Convergent Beam Electron Diffraction Patterns

A deep convolutional neural network for real-time full profile analysis of big powder diffraction data

Deep learning for enhanced spectral analysis of MA-XRF datasets of paintings

A probabilistic deep learning approach to automate the interpretation of multi-phase diffraction spectra

Accelerated Nuclear Magnetic Resonance Spectroscopy with Deep Learning

Image Segmentation using U-Net Architecture for Powder X-ray Diffraction Images

X-ray Scattering Image Classification Using Deep Learning

Deep learning assisted XRF spectra classification

Electron energy loss spectroscopy database synthesis and automation of core-loss edge recognition by deep-learning neural networks

Deep learning for 'artefact' removal in infrared spectroscopy

Machine-Learning X-ray Absorption Spectra to Quantitative Accuracy

A Universal Deep Learning Framework for Materials X-ray Absorption Spectra