Abstract:Photoacoustic imaging potentially allows for the real-time visualization of functional human tissue parameters such as oxygenation but is subject to a challenging underlying quantification problem. While in silico studies have revealed the great potential of deep learning (DL) methodology in solving this problem, the inherent lack of an efficient gold standard method for model training and validation remains a grand challenge. This work investigates whether DL can be leveraged to accurately and efficiently simulate photon propagation in biological tissue, enabling photoacoustic image synthesis. Our approach is based on estimating the initial pressure distribution of the photoacoustic waves from the underlying optical properties using a back-propagatable neural network trained on synthetic data. In proof-of-concept studies, we validated the performance of two complementary neural network architectures, namely a conventional U-Net-like model and a Fourier Neural Operator (FNO) network. Our in silico validation on multispectral human forearm images shows that DL methods can speed up image generation by a factor of 100 when compared to Monte Carlo simulations with 5×108 photons. While the FNO is slightly more accurate than the U-Net, when compared to Monte Carlo simulations performed with a reduced number of photons (5×106), both neural network architectures achieve equivalent accuracy. In contrast to Monte Carlo simulations, the proposed DL models can be used as inherently differentiable surrogate models in the photoacoustic image synthesis pipeline, allowing for back-propagation of the synthesis error and gradient-based optimization over the entire pipeline. Due to their efficiency, they have the potential to enable large-scale training data generation that can expedite the clinical application of photoacoustic imaging.

End-to-end Deep Neural Network for Optica L Inversion in Quantitative Photoacoustic Imaging

Quantitative Endoscopic Photoacoustic Tomography Using a Convolutional Neural Network.

O-Net: A Convolutional Neural Network for Quantitative Photoacoustic Image Segmentation and Oximetry

End-to-end Res-Unet based reconstruction algorithm for photoacoustic imaging

An iterative gradient convolutional neural network and its application in endoscopic photoacoustic image formation from incomplete acoustic measurement

Y-Net: A Hybrid Deep Learning Reconstruction Framework for Photoacoustic Imaging in vivo

Y-Net: Hybrid deep learning image reconstruction for photoacoustic tomography in vivo

UPAMNet: A unified network with deep knowledge priors for photoacoustic microscopy

Efficient Photoacoustic Image Synthesis with Deep Learning

A deep neural network for real-time optoacoustic image reconstruction with adjustable speed of sound

Simultaneous Denoising and Localization Network for Photoacoustic Target Localization

Noise‐insensitive defocused signal and resolution enhancement for optical‐resolution photoacoustic microscopy via deep learning

QOCT-Net: A Physics-Informed Neural Network for Intravascular Optical Coherence Tomography Attenuation Imaging

Reconstructing undersampled photoacoustic microscopy images using deep learning

Ultracompact Deep Neural Network for Ultrafast Optical Property Extraction in Spatial Frequency Domain Imaging (SFDI)

Unsupervised denoising of photoacoustic images based on the Noise2Noise network

Multikernel positional embedding convolutional neural network for photoacoustic reconstruction with sparse data

Deep learning-based photoacoustic imaging of vascular network through thick porous media

Efficient Deep Model-Based Optoacoustic Image Reconstruction

Deep-Learning Image Reconstruction for Real-Time Photoacoustic System

Reconstructing the Photoacoustic Image with High Quality using the Deep Neural Network Model