The truth and falsities about nonlinear analysis of biosignals

W. Klonowski

Abstract:

What problem does this paper attempt to address?

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Zitong Ye,Xiaoyan Li,Yile Sun,Yuran Huang,Xu Liu,Yubing Han,Cuifang Kuang

DOI: https://doi.org/10.1364/ol.511983

IF: 3.6

2024-01-01

Optics Letters

Abstract:Structured-illumination microscopy (SIM) offers a twofold resolution enhancement beyond the optical diffraction limit. At present, SIM requires several raw structured-illumination (SI) frames to reconstruct a super-resolution (SR) image, especially the time-consuming reconstruction of speckle SIM, which requires hundreds of SI frames. Considering this, we herein propose an untrained structured-illumination reconstruction neural network (USRNN) with known illumination patterns to reduce the amount of raw data that is required for speckle SIM reconstruction by 20 times and thus improve its temporal resolution. Benefiting from the unsupervised optimizing strategy and CNNs’ structure priors, the high-frequency information is obtained from the network without the requirement of datasets; as a result, a high-fidelity SR image with approximately twofold resolution enhancement can be reconstructed using five frames or less. Experiments on reconstructing non-biological and biological samples demonstrate the high-speed and high-universality capabilities of our method.
High-sensitivity extreme-ultraviolet transient absorption spectroscopy enabled by machine learning

Tobias Heinrich,Hung-Tzu Chang,Sergey Zayko,Murat Sivis,Claus Ropers

2023-05-04

Abstract:We introduce a machine-learning-based approach to enhance the sensitivity of optical-extreme ultraviolet (XUV) transient absorption spectroscopy. A reference spectrum is used as input to a three-layer feed-forward neural network, allowing for an efficient elimination of source noise from measurement data. In pump-probe experiments using high-harmonic radiation, we show a more than tenfold improvement in noise suppression in XUV transient absorption spectra compared to conventional referencing. Utilizing strong spectral correlations in the source fluctuations, the network facilitates a pixel-wise noise reduction without the need for wavelength calibration of the reference spectrum. The presented method can be adapted to a wide range of beam lines and enables the investigation of subtle electron and lattice dynamics in the weak excitation regime, relevant for the study of photovoltaics and photoinduced phase transitions of strongly correlated materials.

Optics,Materials Science
Robust unfolding of MeV x-ray spectra from filter stack spectrometer data

C-S Wong,J Strehlow,D P Broughton,S V Luedtke,C-K Huang,A Bogale,R Fitzgarrald,R Nedbailo,J L Schmidt,T R Schmidt,J Twardowski,A Van Pelt,M Alvarado Alvarez,A Junghans,L T Mix,R E Reinovsky,D R Rusby,Z Wang,B Wolfe,B J Albright,S H Batha,S Palaniyappan,C.-S. Wong,J. Strehlow,D. P. Broughton,S. V. Luedtke,C.-K. Huang,A. Bogale,R. Fitzgarrald,R. Nedbailo,J. L. Schmidt,T. R. Schmidt,J. Twardowski,A. Van Pelt,M. Alvarado Alvarez,A. Junghans,L. T. Mix,R. E. Reinovsky,D. R. Rusby,Z. Wang,B. Wolfe,B. J. Albright,S. H. Batha,S. Palaniyappan

DOI: https://doi.org/10.1063/5.0190679

IF: 1.6

2024-02-01

Review of Scientific Instruments

Abstract:We present an inversion method capable of robustly unfolding MeV x-ray spectra from filter stack spectrometer (FSS) data without requiring an a priori specification of a spectral shape or arbitrary termination of the algorithm. Our inversion method is based upon the perturbative minimization (PM) algorithm, which has previously been shown to be capable of unfolding x-ray transmission data, albeit for a limited regime in which the x-ray mass attenuation coefficient of the filter material increases monotonically with x-ray energy. Our inversion method improves upon the PM algorithm through regular smoothing of the candidate spectrum and by adding stochasticity to the search. With these additions, the inversion method does not require a physics model for an initial guess, fitting, or user-selected termination of the search. Instead, the only assumption made by the inversion method is that the x-ray spectrum should be near a smooth curve. Testing with synthetic data shows that the inversion method can successfully recover the primary large-scale features of MeV x-ray spectra, including the number of x-rays in energy bins of several-MeV widths to within 10%. Fine-scale features, however, are more difficult to recover accurately. Examples of unfolding experimental FSS data obtained at the Texas Petawatt Laser Facility and the OMEGA EP laser facility are also presented.

instruments & instrumentation,physics, applied
Machine-Learning X-Ray Absorption Spectra to Quantitative Accuracy

Matthew R. Carbone,Mehmet Topsakal,Deyu Lu,Shinjae Yoo,and Shinjae Yoo

DOI: https://doi.org/10.1103/PhysRevLett.124.156401

IF: 8.6

2020-04-17

Physical Review Letters

Abstract:Simulations of excited state properties, such as spectral functions, are often computationally expensive and therefore not suitable for high-throughput modeling. As a proof of principle, we demonstrate that graph-based neural networks can be used to predict the x-ray absorption near-edge structure s... [Phys. Rev. Lett. 124, 156401] Published Thu Apr 16, 2020

physics, multidisciplinary
Deep neural network for x-ray photoelectron spectroscopy data analysis

G Drera,C M Kropf,L Sangaletti

DOI: https://doi.org/10.1088/2632-2153/ab5da6

2020-02-25

Machine Learning: Science and Technology

Abstract:Abstract In this work, we characterize the performance of a deep convolutional neural network designed to detect and quantify chemical elements in experimental x-ray photoelectron spectroscopy data. Given the lack of a reliable database in literature, in order to train the neural network we computed a large (<100 k) dataset of synthetic spectra, based on randomly generated materials covered with a layer of adventitious carbon. The trained net performs as well as standard methods on a test set of ≈500 well characterized experimental x-ray photoelectron spectra. Fine details about the net layout, the choice of the loss function and the quality assessment strategies are presented and discussed. Given the synthetic nature of the training set, this approach could be applied to the automatization of any photoelectron spectroscopy system, without the need of experimental reference spectra and with a low computational effort.
A Neural Network Computational Spectrometer Trained by a Small Dataset with High-Correlation Optical Filters

Haojie Liao,Lin Yang,Yuanhao Zheng,Yansong Wang

DOI: https://doi.org/10.3390/s24051553

IF: 3.9

2024-02-29

Sensors

Abstract:A computational spectrometer is a novel form of spectrometer powerful for portable in situ applications. In the encoding part of the computational spectrometer, filters with highly non-correlated properties are requisite for compressed sensing, which poses severe challenges for optical design and fabrication. In the reconstruction part of the computational spectrometer, conventional iterative reconstruction algorithms are featured with limited efficiency and accuracy, which hinders their application for real-time in situ measurements. This study proposes a neural network computational spectrometer trained by a small dataset with high-correlation optical filters. We aim to change the paradigm by which the accuracy of neural network computational spectrometers depends heavily on the amount of training data and the non-correlation property of optical filters. First, we propose a presumption about a distribution law for the common large training dataset, in which a unique widespread distribution law is shown when calculating the spectrum correlation. Based on that, we extract the original dataset according to the distribution probability and form a small training dataset. Then a fully connected neural network architecture is constructed to perform the reconstruction. After that, a group of thin film filters are introduced to work as the encoding layer. Then the neural network is trained by a small dataset under high-correlation filters and applied in simulation. Finally, the experiment is carried out and the result indicates that the neural network enabled by a small training dataset has performed very well with the thin film filters. This study may provide a reference for computational spectrometers based on high-correlation optical filters.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Highly sensitive 2D X-ray absorption spectroscopy via physics informed machine learning

Zeyuan Li,Thomas Flynn,Tongchao Liu,Sizhan Liu,Wah-Keat Lee,Ming Tang,Mingyuan Ge

DOI: https://doi.org/10.1038/s41524-024-01313-7

IF: 12.256

2024-06-19

npj Computational Materials

Abstract:Improving the spatial and spectral resolution of 2D X-ray near-edge absorption structure (XANES) has been a decade-long pursuit to probe local chemical reactions at the nanoscale. However, the poor signal-to-noise ratio in the measured images poses significant challenges in quantitative analysis, especially when the element of interest is at a low concentration. In this work, we developed a post-imaging processing method using deep neural network to reliably improve the signal-to-noise ratio in the XANES images. The proposed neural network model could be trained to adapt to new datasets by incorporating the physical features inherent in the latent space of the XANES images and self-supervised to detect new features in the images and achieve self-consistency. Two examples are presented in this work to illustrate the model's robustness in determining the valence states of Ni and Co in the LiNi x Mn y Co 1-x-y O 2 systems with high confidence.

materials science, multidisciplinary,chemistry, physical
Machine Learning Automated Approach for Enormous Synchrotron X-Ray Diffraction Data Interpretation

Xiaodong Zhao,YiXuan Luo,Juejing Liu,Wenjun Liu,Kevin M. Rosso,Xiaofeng Guo,Tong Geng,Ang Li,Xin Zhang

DOI: https://doi.org/10.1021/acs.jpcc.3c03572

2023-03-20

Abstract:Manual analysis of XRD data is usually laborious and time consuming. The deep neural network (DNN) based models trained by synthetic XRD patterns are proved to be an automatic, accurate, and high throughput method to analysis common XRD data collected from solid sample in ambient environment. However, it remains unknown that whether synthetic XRD based models are capable to solve u-XRD mapping data for in-situ experiments involving liquid phase exhibiting lower quality with significant artifacts. In this study, we collected u-XRD mapping data from an LaCl3-calcite hydrothermal fluid system and trained two categories of models to solve the experimental XRD patterns. The models trained by synthetic XRD patterns show low accuracy (as low as 64%) when solving experimental u-XRD mapping data. The accuracy of the DNN models was significantly improved (90% or above) when training them with the dataset containing both synthetic and small number of labeled experimental u-XRD patterns. This study highlighted the importance of labeled experimental patterns on the training of DNN models to solve u-XRD mapping data from in-situ experiments involving liquid phase.

Disordered Systems and Neural Networks,Machine Learning
Efficient prediction of attosecond two-colour pulses from an X-ray free-electron laser with machine learning

Karim K. Alaa El-Din,Oliver G. Alexander,Leszek J. Frasinski,Florian Mintert,Zhaoheng Guo,Joseph Duris,Zhen Zhang,David B. Cesar,Paris Franz,Taran Driver,Peter Walter,James P. Cryan,Agostino Marinelli,Jon P. Marangos,Rick Mukherjee

2024-03-26

Abstract:X-ray free-electron lasers are sources of coherent, high-intensity X-rays with numerous applications in ultra-fast measurements and dynamic structural imaging. Due to the stochastic nature of the self-amplified spontaneous emission process and the difficulty in controlling injection of electrons, output pulses exhibit significant noise and limited temporal coherence. Standard measurement techniques used for characterizing two-coloured X-ray pulses are challenging, as they are either invasive or diagnostically expensive. In this work, we employ machine learning methods such as neural networks and decision trees to predict the central photon energies of pairs of attosecond fundamental and second harmonic pulses using parameters that are easily recorded at the high-repetition rate of a single shot. Using real experimental data, we apply a detailed feature analysis on the input parameters while optimizing the training time of the machine learning methods. Our predictive models are able to make predictions of central photon energy for one of the pulses without measuring the other pulse, thereby leveraging the use of the spectrometer without having to extend its detection window. We anticipate applications in X-ray spectroscopy using XFELs, such as in time-resolved X-ray absorption and photoemission spectroscopy, where improved measurement of input spectra will lead to better experimental outcomes.

Accelerator Physics,Optics
Hopfield Neural Network Approach for Supervised Nonlinear Spectral Unmixing

Jing Li,Xiaorun Li,Bormin Huang,Liaoying Zhao

DOI: https://doi.org/10.1109/lgrs.2016.2560222

IF: 5.343

2016-01-01

IEEE Geoscience and Remote Sensing Letters

Abstract:Nonlinear unmixing, which has attracted considerable interest from researchers and developers, has been successfully applied in many real-world hyperspectral imaging scenarios. Hopfield neural network (HNN) machine learning has already proven successful in solving the linear mixture model; this study utilized an HNN machine learning approach to solve the generalized bilinearmodel (GBM) optimization problem. Two HNNs were constructed in a successive manner to solve respective seminon-negative matrix factorization problems intended for abundance and nonlinear coefficient estimation. In the proposed HNN-based GBM unmixing method, both HNNs evolve to stable states after a number of iterations to obtain unmixing results related to the states of neurons. In experiments on synthetic data, the proposed method showed more efficient performance in regard to abundance estimation accuracy than other GBM optimization algorithms, especially when given reliable endmember spectra. The proposed method was also applied to real hyperspectral data and still demonstrated notable advantages despite the obvious increase in unmixing difficulty.
Automated spectrometer alignment via machine learning

Peter Feuer-Forson,Gregor Hartmann,Rolf Mitzner,Peter Baumgärtel,Christian Weniger,Marcus Agåker,David Meier,Phillipe Wernet,Jens Viefhaus

DOI: https://doi.org/10.1107/s1600577524003850

IF: 2.557

2024-06-22

Journal of Synchrotron Radiation

Abstract:The application of a machine learning approach for the automated alignment of a soft X‐ray spectrometer is showcased. Our method has been validated with experimental data at the beamline and significantly reduces the alignment time from approximately one hour to just a few minutes.During beam time at a research facility, alignment and optimization of instrumentation, such as spectrometers, is a time‐intensive task and often needs to be performed multiple times throughout the operation of an experiment. Despite the motorization of individual components, automated alignment solutions are not always available. In this study, a novel approach that combines optimisers with neural network surrogate models to significantly reduce the alignment overhead for a mobile soft X‐ray spectrometer is proposed. Neural networks were trained exclusively using simulated ray‐tracing data, and the disparity between experiment and simulation was obtained through parameter optimization. Real‐time validation of this process was performed using experimental data collected at the beamline. The results demonstrate the ability to reduce alignment time from one hour to approximately five minutes. This method can also be generalized beyond spectrometers, for example, towards the alignment of optical elements at beamlines, making it applicable to a broad spectrum of research facilities.

optics,physics, applied,instruments & instrumentation
Unfolding X-ray Spectral Data: Conditions and Applications

Sean J. Gunderson,David P. Huenemoerder

DOI: https://doi.org/10.3847/1538-3881/ad86b8v

2024-10-29

Abstract:We present conditions for which X-ray spectra can be ``unfolded'' to present accurate representation of the true source spectra. The method we use to unfold the data is implemented in the \textit{Interactive Spectral Interpretation Software} \citep{Houck2000} and distinguishes itself as being model-independent. We find that this method of unfolding makes accurate representations of the true source spectra (1) The detector is high-resolution and (2) The spectrum is not steeply sloped. These criteria are not simple conditions that give concrete determinations; each detector and spectrum must be judged individually. We find that both grating and imaging detectors can be unfolded with minimal distortions as compared to both continuum and local spectral features; the latter CCD detectors being much more energy dependent. We also provide example use cases for unfolding in the context of current generation X-ray observatories and important caveats.

Instrumentation and Methods for Astrophysics,High Energy Astrophysical Phenomena
Graft evidence for H-Y transplantation antigen similarity in different mouse strains

B. Mintz,W. Silvers

DOI: https://doi.org/10.1007/BF00696876

Immunogenetics

Abstract:
Auto-Encoder Neural Network Incorporating X-Ray Fluorescence Fundamental Parameters with Machine Learning

Matthew Dirks,David Poole

DOI: https://doi.org/10.1002/xrs.3340

2023-03-22

Abstract:We consider energy-dispersive X-ray Fluorescence (EDXRF) applications where the fundamental parameters method is impractical such as when instrument parameters are unavailable. For example, on a mining shovel or conveyor belt, rocks are constantly moving (leading to varying angles of incidence and distances) and there may be other factors not accounted for (like dust). Neural networks do not require instrument and fundamental parameters but training neural networks requires XRF spectra labelled with elemental composition, which is often limited because of its expense. We develop a neural network model that learns from limited labelled data and also benefits from domain knowledge by learning to invert a forward model. The forward model uses transition energies and probabilities of all elements and parameterized distributions to approximate other fundamental and instrument parameters. We evaluate the model and baseline models on a rock dataset from a lithium mineral exploration project. Our model works particularly well for some low-Z elements (Li, Mg, Al, and K) as well as some high-Z elements (Sn and Pb) despite these elements being outside the suitable range for common spectrometers to directly measure, likely owing to the ability of neural networks to learn correlations and non-linear relationships.

Machine Learning
Statistical data analysis of x-ray spectroscopy data enabled by neural network accelerated Bayesian inference

M. J. MacDonald,B. A. Hammel,B. Bachmann,M. Bitter,P. Efthimion,J. A. Gaffney,L. Gao,B. D. Hammel,K. W. Hill,B. F. Kraus,A. G. MacPhee,L. Peterson,M. B. Schneider,H. A. Scott,D. B. Thorn,C. B. Yeamans

DOI: https://doi.org/10.1063/5.0219464

IF: 1.6

2024-08-01

Review of Scientific Instruments

Abstract:Bayesian inference applied to x-ray spectroscopy data analysis enables uncertainty quantification necessary to rigorously test theoretical models. However, when comparing to data, detailed atomic physics and radiation transfer calculations of x-ray emission from non-uniform plasma conditions are typically too slow to be performed in line with statistical sampling methods, such as Markov Chain Monte Carlo sampling. Furthermore, differences in transition energies and x-ray opacities often make direct comparisons between simulated and measured spectra unreliable. We present a spectral decomposition method that allows for corrections to line positions and bound–bound opacities to best fit experimental data, with the goal of providing quantitative feedback to improve the underlying theoretical models and guide future experiments. In this work, we use a neural network (NN) surrogate model to replace spectral calculations of isobaric hot-spots created in Kr-doped implosions at the National Ignition Facility. The NN was trained on calculations of x-ray spectra using an isobaric hot-spot model post-processed with Cretin, a multi-species atomic kinetics and radiation code. The speedup provided by the NN model to generate x-ray emission spectra enables statistical analysis of parameterized models with sufficient detail to accurately represent the physical system and extract the plasma parameters of interest.

instruments & instrumentation,physics, applied
Machine Learning Automated Analysis of Enormous Synchrotron X-ray Diffraction Datasets

Xiaodong Zhao,YiXuan Luo,Juejing Liu,Wenjun Liu,Kevin M. Rosso,Xiaofeng Guo,Tong Geng,Ang Li,Xin Zhang

DOI: https://doi.org/10.1021/acs.jpcc.3c03572

2023-07-23

The Journal of Physical Chemistry C

Abstract:X-ray diffraction (XRD) data analysis can be a time-consuming and laborious task. Deep neural network (DNN) based models trained with synthetic XRD patterns have been proven to be a highly efficient, accurate, and automated method for analyzing common XRD data collected from solid samples in ambient environments. However, it remains unclear whether synthetic XRD-based models can be effective in solving micro(μ)-XRD mapping data for in situ experiments involving liquid phases, which always have lower quality and significant artifacts. In this study, we collected μ-XRD mapping data from a LaCl3-calcite hydrothermal fluid system and trained two categories of models to analyze the experimental XRD patterns. The models trained solely with synthetic XRD patterns showed low accuracy (as low as 64%) when solving experimental μ-XRD mapping data. However, the accuracy of the DNN models significantly improved (90% or above) when we trained them with a data set containing both synthetic and a small number of labeled experimental μ-XRD patterns. This study highlights the importance of labeled experimental patterns in training DNN models to solve μ-XRD mapping data from in situ experiments involving liquid phases.

chemistry, physical,nanoscience & nanotechnology,materials science, multidisciplinary
Deconvolving X-ray Galaxy Cluster Spectra Using a Recurrent Inference Machine

Carter Rhea,Julie Hlavacek-Larrondo,Alexandre Adam,Ralph Kraft,Akos Bogdan,Laurence Perreault-Levasseur,Marine Prunier

2024-09-17

Abstract:Recent advances in machine learning algorithms have unlocked new insights in observational astronomy by allowing astronomers to probe new frontiers. In this article, we present a methodology to disentangle the intrinsic X-ray spectrum of galaxy clusters from the instrumental response function. Employing state-of-the-art modeling software and data mining techniques of the Chandra data archive, we construct a set of 100,000 mock Chandra spectra. We train a recurrent inference machine (RIM) to take in the instrumental response and mock observation and output the intrinsic X-ray spectrum. The RIM can recover the mock intrinsic spectrum below the 1-$\sigma$ error threshold; moreover, the RIM reconstruction of the mock observations are indistinguishable from the observations themselves. To further test the algorithm, we deconvolve extracted spectra from the central regions of the galaxy group NGC 1550, known to have a rich X-ray spectrum, and the massive galaxy clusters Abell 1795. Despite the RIM reconstructions consistently remaining below the 1-$\sigma$ noise level, the recovered intrinsic spectra did not align with modeled expectations. This discrepancy is likely attributable to the RIM's method of implicitly encoding prior information within the neural network. This approach holds promise for unlocking new possibilities in accurate spectral reconstructions and advancing our understanding of complex X-ray cosmic phenomena.

Astrophysics of Galaxies
A probabilistic deep learning approach to automate the interpretation of multi-phase diffraction spectra

Nathan J. Szymanski,Christopher J. Bartel,Yan Zeng,Qingsong Tu,Gerbrand Ceder

DOI: https://doi.org/10.1021/acs.chemmater.1c01071

2021-03-31

Abstract:Autonomous synthesis and characterization of inorganic materials requires the automatic and accurate analysis of X-ray diffraction spectra. For this task, we designed a probabilistic deep learning algorithm to identify complex multi-phase mixtures. At the core of this algorithm lies an ensemble convolutional neural network trained on simulated diffraction spectra, which are systematically augmented with physics-informed perturbations to account for artifacts that can arise during experimental sample preparation and synthesis. Larger perturbations associated with off-stoichiometry are also captured by supplementing the training set with hypothetical solid solutions. Spectra containing mixtures of materials are analyzed with a newly developed branching algorithm that utilizes the probabilistic nature of the neural network to explore suspected mixtures and identify the set of phases that maximize confidence in the prediction. Our model is benchmarked on simulated and experimentally measured diffraction spectra, showing exceptional performance with accuracies exceeding those given by previously reported methods based on profile matching and deep learning. We envision that the algorithm presented here may be integrated in experimental workflows to facilitate the high-throughput and autonomous discovery of inorganic materials.

Materials Science,Machine Learning
Iterative algorithm computational spectrometer based on a single-hidden-layer neural network

Yuanhao Zheng,Haojie Liao,Lin Yang,Yao Chen

DOI: https://doi.org/10.1364/oe.524670

IF: 3.8

2024-06-12

Optics Express

Abstract:Yuanhao Zheng, Haojie Liao, Lin Yang, Yao Chen Computational spectrometers have great application prospects in hyperspectral detection, and fast and high-precision in situ measurement is ... [Opt. Express 32, 23316-23332 (2024)]

optics

The truth and falsities about nonlinear analysis of biosignals

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

High-sensitivity extreme-ultraviolet transient absorption spectroscopy enabled by machine learning

Robust unfolding of MeV x-ray spectra from filter stack spectrometer data

Machine-Learning X-Ray Absorption Spectra to Quantitative Accuracy

Deep neural network for x-ray photoelectron spectroscopy data analysis

A Neural Network Computational Spectrometer Trained by a Small Dataset with High-Correlation Optical Filters

Highly sensitive 2D X-ray absorption spectroscopy via physics informed machine learning

Machine Learning Automated Approach for Enormous Synchrotron X-Ray Diffraction Data Interpretation

Efficient prediction of attosecond two-colour pulses from an X-ray free-electron laser with machine learning

Hopfield Neural Network Approach for Supervised Nonlinear Spectral Unmixing

Automated spectrometer alignment via machine learning

Unfolding X-ray Spectral Data: Conditions and Applications

Graft evidence for H-Y transplantation antigen similarity in different mouse strains

Auto-Encoder Neural Network Incorporating X-Ray Fluorescence Fundamental Parameters with Machine Learning

Statistical data analysis of x-ray spectroscopy data enabled by neural network accelerated Bayesian inference

Machine Learning Automated Analysis of Enormous Synchrotron X-ray Diffraction Datasets

Deconvolving X-ray Galaxy Cluster Spectra Using a Recurrent Inference Machine

A probabilistic deep learning approach to automate the interpretation of multi-phase diffraction spectra

Iterative algorithm computational spectrometer based on a single-hidden-layer neural network