Abstract:Photoacoustic imaging (PAI) is an emerging modality that has generated increasing interest for its uses in clinical research and translation. To fully exploit its potential for various preclinical and clinical applications, it is necessary to develop systems that offer high imaging speed, reasonable cost, and manageable data flow. Currently, a significant challenge lies in the fabrication of ultrasound arrays, as many of them are not densely populated enough to fully sample the signals. Ideally, the pitch of the arrays should be half of the center ultrasonic wavelength to prevent spatial undersampling and the subsequent reconstruction artifacts, such as aliasing artifacts and structural deformation. Here, a novel photoacoustic sparse sampling Transformer-CNN coupling network (passFormer) is proposed to decouple target details and spatial under-sampling artifacts from high-frequency image information in a heterogeneous feature-aware manner. To be specific, we first decompose the sparse sampling (SS) photoacoustic (PA) images into 2 parts: high-frequency(HF) and low-frequency(LF) compositions. Our methodology incorporates two bridging modules, the LF modules and the HF modules. The LF coupling module extracts content features (X-c) and latent texture feature (X-tex), and the HF coupling module extracts high-frequency embedding (X-emb) containing the target details features (X-detail) and under-sampling artifacts (X-art). We feed X-t and X-emb into a modified transformer with three encoders and decoders to obtain well-refined HF texture features. At last, we combine the refined HF texture features with pre-extracted X-c by pixel-wise summation reconstruction. Experimental results on publicly available full and sparse reconstruction datasets of mouse and phantom PA images highlight the superior performance of our method, particularly in live mouse imaging. This new approach enables accelerated data acquisition and image reconstruction, facilitating the development of practical and cost-effective imaging systems.

Passformer: Heterogeneous Feature-Aware CNN-transformer Coupling Network for Sparse Sampling Photoacoustic Tomography

Quantitative Endoscopic Photoacoustic Tomography Using a Convolutional Neural Network.

AS-Net: Fast Photoacoustic Reconstruction With Multi-Feature Fusion From Sparse Data

Spread Spectrum Photoacoustic Tomography With Image Optimization.

Imaging Enhancement for Acoustic-Resolution Photoacoustic Microscopy by Deep Learning

Deep learning enabled real-time photoacoustic tomography system via single data acquisition channel

Sparse-view reconstruction for photoacoustic tomography combining diffusion model with model-based iteration

Neural Fields for Adaptive Photoacoustic Computed Tomography

Ultra-Sparse Reconstruction for Photoacoustic Tomography: Sinogram Domain Prior-Guided Method Exploiting Enhanced Score-Based Diffusion Model

Accelerated High-Resolution Photoacoustic Tomography via Compressed Sensing

Photoacoustic microscopy with sparse data by convolutional neural networks

Spiral Scanning and Self-Supervised Image Reconstruction Enable Ultra-Sparse Sampling Multispectral Photoacoustic Tomography

Adaptive Multi-Sample-Based Photoacoustic Tomography with Imaging Quality Optimization

Superiorized Photo-Acoustic Non-NEgative Reconstruction (SPANNER) for Clinical Photoacoustic Imaging

Domain Transform Network for Photoacoustic Tomography from Limited-view and Sparsely Sampled Data

Photoacoustic Microscopy with Sparse Data Enabled by Convolutional Neural Networks for Fast Imaging

Reconstructing the Photoacoustic Image with High Quality using the Deep Neural Network Model

Multispectral interlaced sparse sampling photoacoustic tomography based on directional total variation

Y-Net: A Hybrid Deep Learning Reconstruction Framework for Photoacoustic Imaging in vivo

Accelerated model‐based iterative reconstruction strategy for sparse‐view photoacoustic tomography aided by multi‐channel autoencoder priors

Sparse-view Signal-domain Photoacoustic Tomography Reconstruction Method Based on Neural Representation