Abstract:Photoacoustic tomography (PAT) images contain inherent distortions due to the imaging system and heterogeneous tissue properties. Improving image quality requires the removal of these system distortions. While model-based approaches and data-driven techniques have been proposed for PAT image restoration, achieving accurate and robust image recovery remains challenging. Recently, deep-learning-based image deconvolution approaches have shown promise for image recovery. However, PAT imaging presents unique challenges, including spatially varying resolution and the absence of ground truth data. Consequently, there is a pressing need for a novel learning strategy specifically tailored for PAT imaging. Herein, we propose a configurable network model named Deep hybrid Image-PSF Prior (DIPP) that builds upon the physical image degradation model of PAT. DIPP is an unsupervised and deeply learned network model that aims to extract the ideal PAT image from complex system degradation. Our DIPP framework captures the degraded information solely from the acquired PAT image, without relying on ground truth or labeled data for network training. Additionally, we can incorporate the experimentally measured Point Spread Functions (PSFs) of the specific PAT system as a reference to further enhance performance. To evaluate the algorithm's effectiveness in addressing multiple degradations in PAT, we conduct extensive experiments using simulation images, publicly available datasets, phantom images, and in vivo small animal imaging data. Comparative analyses with classical analytical methods and state-of-the-art deep learning models demonstrate that our DIPP approach achieves significantly improved restoration results in terms of image details and contrast.

Patching-based Deep Learning model for the Inpainting of Bragg Coherent Diffraction patterns affected by detectors' gaps

Patching‐based deep‐learning model for the inpainting of Bragg coherent diffraction patterns affected by detector gaps

Thermal Infrared Image Inpainting Via Edge-Aware Guidance

Depth-Aided Inpainting for Disocclusion Restoration of Multi-View Images Using Depth-Image-Based Rendering

Diffusion-Based Audio Inpainting

Patch-Based Denoising Diffusion Probabilistic Model for Sparse-View CT Reconstruction

Enhanced Wavelet Scattering Network for image inpainting detection

Conditional GAN-based Deep Network for Seamless Large-Fov Imaging by Camera Array

BraggNN: Fast X-ray Bragg Peak Analysis Using Deep Learning

Patch-Based Diffusion Models Beat Whole-Image Models for Mismatched Distribution Inverse Problems

<i>DeepPatch</i>: A Patching-Based Method for Repairing Deep Neural Networks

Deep learning-based conditional inpainting for restoration of artifact-affected 4D CT images

Diffusion Models with Anisotropic Gaussian Splatting for Image Inpainting

Sparse recovery of undersampled intensity patterns for coherent diffraction imaging at high X-ray energies

AutoPhaseNN: unsupervised physics-aware deep learning of 3D nanoscale Bragg coherent diffraction imaging

DiffPAD: Denoising Diffusion-based Adversarial Patch Decontamination

Three-dimensional coherent X-ray diffraction imaging via deep convolutional neural networks

Physics Constrained Unsupervised Deep Learning for Rapid, High Resolution Scanning Coherent Diffraction Reconstruction

Adaptive 3D convolutional neural network-based reconstruction method for 3D coherent diffraction imaging

Learning Spatially Variant Degradation for Unsupervised Blind Photoacoustic Tomography Image Restoration