Abstract:Photoacoustic imaging (PAI) is an emerging modality that has generated increasing interest for its uses in clinical research and translation. To fully exploit its potential for various preclinical and clinical applications, it is necessary to develop systems that offer high imaging speed, reasonable cost, and manageable data flow. Currently, a significant challenge lies in the fabrication of ultrasound arrays, as many of them are not densely populated enough to fully sample the signals. Ideally, the pitch of the arrays should be half of the center ultrasonic wavelength to prevent spatial undersampling and the subsequent reconstruction artifacts, such as aliasing artifacts and structural deformation. Here, a novel photoacoustic sparse sampling Transformer-CNN coupling network (passFormer) is proposed to decouple target details and spatial under-sampling artifacts from high-frequency image information in a heterogeneous feature-aware manner. To be specific, we first decompose the sparse sampling (SS) photoacoustic (PA) images into 2 parts: high-frequency(HF) and low-frequency(LF) compositions. Our methodology incorporates two bridging modules, the LF modules and the HF modules. The LF coupling module extracts content features (X-c) and latent texture feature (X-tex), and the HF coupling module extracts high-frequency embedding (X-emb) containing the target details features (X-detail) and under-sampling artifacts (X-art). We feed X-t and X-emb into a modified transformer with three encoders and decoders to obtain well-refined HF texture features. At last, we combine the refined HF texture features with pre-extracted X-c by pixel-wise summation reconstruction. Experimental results on publicly available full and sparse reconstruction datasets of mouse and phantom PA images highlight the superior performance of our method, particularly in live mouse imaging. This new approach enables accelerated data acquisition and image reconstruction, facilitating the development of practical and cost-effective imaging systems.

Streamlined photoacoustic image processing with foundation models: A training-free solution

Streamlined Photoacoustic Image Processing with Foundation Models: A Training-Free Solution

Advances in Photoacoustic Imaging Reconstruction and Quantitative Analysis for Biomedical Applications

Imaging Enhancement for Acoustic-Resolution Photoacoustic Microscopy by Deep Learning

Image enhancement in acoustic-resolution photoacoustic microscopy enabled by a novel directional algorithm

Photoacoustic imaging with limited sampling: a review of machine learning approaches

Unsupervised Learning for Enhanced Computed Photoacoustic Microscopy

Freehand scanning photoacoustic microscopy with simultaneous localization and mapping

Passformer: Heterogeneous Feature-Aware CNN-transformer Coupling Network for Sparse Sampling Photoacoustic Tomography

Sparse-view reconstruction for photoacoustic tomography combining diffusion model with model-based iteration

Ultra-Sparse Reconstruction for Photoacoustic Tomography: Sinogram Domain Prior-Guided Method Exploiting Enhanced Score-Based Diffusion Model

Foundation versus Domain-Specific Model for Cardiac Ultrasound Segmentation

Accelerating photoacoustic microscopy by reconstructing undersampled images using diffusion models

Photoacoustic Imaging Optimization with Raw Signal Deconvolution and Empirical Mode Decomposition

Resolution Enhancement of Under-sampled Photoacoustic Microscopy Images using Implicit Neural Representations

Resolution Enhancement Strategies in Photoacoustic Microscopy: A Comprehensive Review

Sparse‐View Photoacoustic Reconstruction Method for Diabetic Retinopathy Using Feature Fusion Network

Efficient Discrete Cosine Transform Model–based Algorithm for Photoacoustic Image Reconstruction

Adaptive Multi-Sample-Based Photoacoustic Tomography with Imaging Quality Optimization

UltraSam: A Foundation Model for Ultrasound using Large Open-Access Segmentation Datasets

Foundation Models for Biomedical Image Segmentation: A Survey