Abstract:Photoacoustic imaging potentially allows for the real-time visualization of functional human tissue parameters such as oxygenation but is subject to a challenging underlying quantification problem. While in silico studies have revealed the great potential of deep learning (DL) methodology in solving this problem, the inherent lack of an efficient gold standard method for model training and validation remains a grand challenge. This work investigates whether DL can be leveraged to accurately and efficiently simulate photon propagation in biological tissue, enabling photoacoustic image synthesis. Our approach is based on estimating the initial pressure distribution of the photoacoustic waves from the underlying optical properties using a back-propagatable neural network trained on synthetic data. In proof-of-concept studies, we validated the performance of two complementary neural network architectures, namely a conventional U-Net-like model and a Fourier Neural Operator (FNO) network. Our in silico validation on multispectral human forearm images shows that DL methods can speed up image generation by a factor of 100 when compared to Monte Carlo simulations with 5×108 photons. While the FNO is slightly more accurate than the U-Net, when compared to Monte Carlo simulations performed with a reduced number of photons (5×106), both neural network architectures achieve equivalent accuracy. In contrast to Monte Carlo simulations, the proposed DL models can be used as inherently differentiable surrogate models in the photoacoustic image synthesis pipeline, allowing for back-propagation of the synthesis error and gradient-based optimization over the entire pipeline. Due to their efficiency, they have the potential to enable large-scale training data generation that can expedite the clinical application of photoacoustic imaging.

Distribution-informed and wavelength-flexible data-driven photoacoustic oximetry

Distribution-informed and wavelength-flexible data-driven photoacoustic oximetry

EDA-Net: Dense Aggregation of Deep and Shallow Information Achieves Quantitative Photoacoustic Blood Oxygenation Imaging Deep in Human Breast

O-Net: A Convolutional Neural Network for Quantitative Photoacoustic Image Segmentation and Oximetry

Estimation of blood oxygenation with learned spectral decoloring for quantitative photoacoustic imaging (LSD-qPAI)

Efficient Photoacoustic Image Synthesis with Deep Learning

A Convex Cone Method for Accurate Blood Oxygenation Photoacoustic Imaging

Photoacoustic monitoring of blood oxygenation during neurosurgical interventions

Advances in Photoacoustic Imaging Reconstruction and Quantitative Analysis for Biomedical Applications

Moving beyond simulation: data-driven quantitative photoacoustic imaging using tissue-mimicking phantoms

Enhancing synthetic training data for quantitative photoacoustic tomography with generative deep learning

Deep-Learning Image Reconstruction for Real-Time Photoacoustic System

Out of distribution detection for intra-operative functional imaging

Validation of photoacoustic/ultrasound dual imaging in evaluating blood oxygen saturation

Improved Photoacoustic-Based Oxygen Saturation Estimation With SNR-Regularized Local Fluence Correction

Simultaneous Denoising and Localization Network for Photoacoustic Target Localization

AS-Net: Fast Photoacoustic Reconstruction With Multi-Feature Fusion From Sparse Data

Multikernel positional embedding convolutional neural network for photoacoustic reconstruction with sparse data

Deep learning-based photoacoustic imaging of vascular network through thick porous media

Spatiotemporal singular value decomposition for denoising in photoacoustic imaging with low-energy excitation light source

A Spectral-Domain Model-Based Method for Simultaneous Oxygen Saturation Quantification and Contrast Agent Identification