Abstract:Photoacoustic (PA) computed tomography (PACT) reconstructs the initial pressure distribution from raw PA signals. The standard reconstruction of medical image could cause the artifacts due to interferences or ill-posed setup. Recently, deep learning has been used to reconstruct the PA image with ill-posed conditions. Most works remove the artifacts from image domain, and compensate the limited-view from dataset. In this paper, we propose a jointed feature fusion framework (JEFF-Net) based on deep learning to reconstruct the PA image using limited-view data. The cross-domain features from limited-view position-wise data and the reconstructed image are fused by a backtracked supervision. Specifically, our results could generate superior performance, whose artifacts are drastically reduced in the output compared to ground-truth (full-view reconstructed result). In this paper, a quarter position-wise data (32 channels) is fed into model, which outputs another 3-quarters-view data (96 channels). Moreover, two novel losses are designed to restrain the artifacts by sufficiently manipulating superposed data. The numerical and in-vivo results have demonstrated the superior performance of our method to reconstruct the full-view image without artifacts. Finally, quantitative evaluations show that our proposed method outperformed the ground-truth in some metrics.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the image reconstruction problem of photoacoustic computed tomography (PACT) under the limited - view condition. Standard reconstruction algorithms often lead to poor image quality, blurriness and artifacts when dealing with data from limited - view or limited - detection units due to incomplete data. These problems limit the performance of PACT in clinical and pre - clinical applications. Specifically, the paper proposes a joint feature fusion network (JEFF - Net) based on deep learning, aiming to reconstruct high - quality photoacoustic images using limited - view data (such as quarter - view data) and reduce artifacts in the reconstruction process. The paper further optimizes the model by designing two novel loss functions (response loss and superposition loss), which can effectively suppress artifacts and improve the quality of reconstructed images. The main contributions of the paper include: 1. For the first time, a method using deep learning to solve the limited - view problem in PACT is proposed, with only quarter - view data as input. 2. Two new loss functions are designed to reduce artifacts in the full - view reconstruction results. 3. The effectiveness of the proposed method is verified on synthetic data and in - vivo experimental data, and compared with existing methods. 4. The model code and mouse data set are made public so that other researchers can reproduce and train their deep - learning models. Through these innovations, the paper not only improves the quality of PACT image reconstruction under the limited - view condition, but also provides a new research direction for future photoacoustic imaging technologies.

A Jointed Feature Fusion Framework for Photoacoustic Reconstruction

AS-Net: Fast Photoacoustic Reconstruction With Multi-Feature Fusion From Sparse Data

Masked cross-domain self-supervised deep learning framework for photoacoustic computed tomography reconstruction

Y-Net: A Hybrid Deep Learning Reconstruction Framework for Photoacoustic Imaging in vivo

Deep learning enabled real-time photoacoustic tomography system via single data acquisition channel

Cross-domain Self-supervised Framework for Photoacoustic Computed Tomography Image Reconstruction

Domain Transform Network for Photoacoustic Tomography from Limited-view and Sparsely Sampled Data

Neural Fields for Adaptive Photoacoustic Computed Tomography

Y-Net: Hybrid deep learning image reconstruction for photoacoustic tomography in vivo

Implicit Neural Representation for Sparse-view Photoacoustic Computed Tomography

Imaging Enhancement for Acoustic-Resolution Photoacoustic Microscopy by Deep Learning

Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning

Deep Learning Regularized Acceleration for Photoacoustic Image Reconstruction

PA-NeRF, a neural radiance field model for 3D photoacoustic tomography reconstruction from limited Bscan data

Deep-Learning Image Reconstruction for Real-Time Photoacoustic System

Learned Regularization for Image Reconstruction in Sparse-View Photoacoustic Tomography

Cross-Domain Self-Supervised Reconstruction for Photoacoustic Computed Tomography

Limited-view Photoacoustic Imaging Reconstruction With Dual Domain Inputs Under Mutual Information Constraint

Multikernel positional embedding convolutional neural network for photoacoustic reconstruction with sparse data

MSD-Net: Multi-scale dense convolutional neural network for photoacoustic image reconstruction with sparse data

Machine-learning enhanced photoacoustic computed tomography in a limited view configuration