Super-Resolution Photoacoustic Angiography Assisted by Images Forged from Hand-Drawn Graffiti

Yuanzheng Ma,Xun Guan

DOI: https://doi.org/10.1364/cleo_at.2023.jtu2a.51

2023-01-01

Abstract:We have developed a diffusion model trained from 216 photoacoustic angiography images. The model can generate blood vessel images from simple graffiti, with superior performance to real images on training super-resolution photoacoustic angiography models.

What problem does this paper attempt to address?

Self-similarity-based super-resolution of photoacoustic angiography from hand-drawn doodles

Yuanzheng Ma,Wangting Zhou,Rui Ma,Sihua Yang,Yansong Tang,Xun Guan

2023-05-02

Abstract:Deep-learning-based super-resolution photoacoustic angiography (PAA) is a powerful tool that restores blood vessel images from under-sampled images to facilitate disease diagnosis. Nonetheless, due to the scarcity of training samples, PAA super-resolution models often exhibit inadequate generalization capabilities, particularly in the context of continuous monitoring tasks. To address this challenge, we propose a novel approach that employs a super-resolution PAA method trained with forged PAA images. We start by generating realistic PAA images of human lips from hand-drawn curves using a diffusion-based image generation model. Subsequently, we train a self-similarity-based super-resolution model with these forged PAA images. Experimental results show that our method outperforms the super-resolution model trained with authentic PAA images in both original-domain and cross-domain tests. Specially, our approach boosts the quality of super-resolution reconstruction using the images forged by the deep learning model, indicating that the collaboration between deep learning models can facilitate generalization, despite limited initial dataset. This approach shows promising potential for exploring zero-shot learning neural networks for vision tasks.

Image and Video Processing,Computer Vision and Pattern Recognition,Optics
Super-resolution Reconstruction Algorithms Based on Fusion of Deep Learning Mechanism and Wavelet

Qi Zhang,Huafeng Wang,Tao Du,Sichen Yang,Yuehai Wang,Zhiqiang Xing,Wenle Bai,Yang Yi

DOI: https://doi.org/10.1145/3357254.3358600

2019-01-01

Abstract:In this paper, we consider the problem of super-resolution reconstruction. This is a hot topic because super-resolution reconstruction has a wide range of applications in the medical field, remote sensing monitoring, and criminal investigation. Compared with traditional algorithms, the current super-resolution reconstruction algorithm based on deep learning greatly improves the clarity of reconstructed pictures. Existing work like Super-Resolution Using a Generative Adversarial Network (SRGAN) can effectively restore the texture details of the image. However, experimentally verified that the texture details of the image recovered by the SRGAN are not robust. In order to get super-resolution reconstructed images with richer high-frequency details, we improve the network structure and propose a super-resolution reconstruction algorithm combining wavelet transform and Generative Adversarial Network. The proposed algorithm can efficiently reconstruct high-resolution images with rich global information and local texture details. We have trained our model by PyTorch framework and VOC2012 dataset, and tested it by Set5, Set14, BSD100 and Urban100 test datasets.
DOVE: Doodled vessel enhancement for photoacoustic angiography super resolution

Yuanzheng Ma,Wangting Zhou,Rui Ma,Erqi Wang,Sihua Yang,Yansong Tang,Xiao-Ping Zhang,Xun Guan

DOI: https://doi.org/10.1016/j.media.2024.103106

IF: 10.9

2024-02-15

Medical Image Analysis

Abstract:Deep-learning-based super-resolution photoacoustic angiography (PAA) has emerged as a valuable tool for enhancing the resolution of blood vessel images and aiding in disease diagnosis. However, due to the scarcity of training samples, PAA super-resolution models do not generalize well, especially in the challenging in-vivo imaging of organs with deep tissue penetration. Furthermore, prolonged exposure to high laser intensity during the image acquisition process can lead to tissue damage and secondary infections. To address these challenges, we propose an approach doodled vessel enhancement (DOVE) that utilizes hand-drawn doodles to train a PAA super-resolution model. With a training dataset consisting of only 32 real PAA images, we construct a diffusion model that interprets hand-drawn doodles as low-resolution images. DOVE enables us to generate a large number of realistic PAA images, achieving a 49.375% fool rate, even among experts in photoacoustic imaging. Subsequently, we employ these generated images to train a self-similarity-based model for super-resolution. During cross-domain tests, our method, trained solely on generated images, achieves a structural similarity value of 0.8591, surpassing the scores of all other models trained with real high-resolution images. DOVE successfully overcomes the limitation of insufficient training samples and unlocks the clinic application potential of super-resolution-based biomedical imaging.

engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging
RECONSTRUCTION OF HIGH-RESOLUTION HEPATIC TUMOR CT IMAGES USING AN AUGMENTATION-BASED SUPER-RESOLUTION TECHNIQUE

Moslem Farhadi,Amir Hossein Foruzan,Mina Esfandiarkhani,Yen-Wei Chen,Hongjie Hu

DOI: https://doi.org/10.4015/s1016237221500265

2021-01-01

Abstract:Improving the resolution of medical images is crucial in diagnosis, feature extraction, and data retrieval. A significant group of super-resolution algorithms is multi-frame techniques. However, they are not appropriate to medical data since they need several frames of the same scene, which bring a high risk of radiation or require a considerable acquisition time. We propose a new data augmentation technique and employ it in a multi-frame image reconstruction algorithm to improve the resolution of pathologic liver CT images. The input to our algorithm is a 3D CT-scan of the abdominal region. Neighboring slices are considered to increase the resolution of a single slice. Augmented slices are prepared using the nearby slices and the interpolation approach. The new data is aligned to the original slice, and it is used as an augmented version of the data. Then, a multi-frame scheme is utilized to reconstruct the high-resolution image. Our method’s novelty is to remove the need for multiple scans of a patent to employ multi-resolution techniques in medical applications. The results reveal that the proposed method is superior to conventional interpolation methods and available augmentation techniques. Compared to the tricubic interpolation, the proposed method improved the PSNR by 3.1. Concerning conventional augmentation techniques, it enhanced the SSIM measure by 0.06. The proposed algorithm improved the SSIM by 0.11 compared to traditional interpolation techniques and 0.1 for recent researches. Therefore, a multi-frame super-resolution technique has the potential to reconstruct medical data better.
Unsupervised arterial spin labeling image superresolution via multiscale generative adversarial network

Jianan Cui,Kuang Gong,Paul Han,Huafeng Liu,Quanzheng Li

DOI: https://doi.org/10.1002/mp.15468

IF: 4.506

2022-01-01

Medical Physics

Abstract:Purpose Arterial spin labeling (ASL) magnetic resonance imaging (MRI) is an advanced noninvasive imaging technology that can measure cerebral blood flow (CBF) quantitatively without a contrast agent injection or radiation exposure. However, because of the weak labeling, conventional ASL images usually suffer from low signal-to-noise ratio (SNR), poor spatial resolution, and long acquisition time. Therefore, a method that can simultaneously improve the spatial resolution and SNR is needed. Methods In this work, we proposed an unsupervised superresolution (SR) method to improve ASL image resolution based on a pyramid of generative adversarial networks (GAN). Through layer-by-layer training, the generators can learn features from the coarsest to the finest. The last layer's generator that contains fine details and textures was used to generate the final SR ASL images. In our proposed framework, the corresponding T1-weighted MR image was supplied as a second-channel input of the generators to provide high-resolution prior information. In addition, a low-pass-filter loss term was included to suppress the noise of the original ASL images. To evaluate the performance of the proposed framework, a simulation study and two real-patient experiments based on the in vivo datasets obtained from three healthy subjects on a 3T MR scanner were conducted, regarding the low-resolution (LR) to normal-resolution (NR) and the NR-to-SR tasks. The proposed method was compared to the nearest neighbor interpolation, trilinear interpolation, third-order B-splines interpolation methods, and deep image prior (DIP) with the peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) as the quantification metrics. The averaged ASL images acquired with 44 min acquisition time were used as the ground truth for real-patient LR-to-NR study. The ablation studies of low-pass-filter loss term and T1-weighted MR image were performed based on simulation data. Results For the simulation study, results show that the proposed method achieved significantly higher PSNR (p$p$-value <$ 0.05) and SSIM (p$p$-value <$ 0.05) than the nearest neighbor interpolation, trilinear interpolation, third-order B-splines interpolation, and DIP methods. For the real-patient LR-to-NR experiment, results show that the proposed method can generate high-quality SR ASL images with clearer structure boundaries and low noise levels and has the highest mean PSNR and SSIM. For real-patient NR-to-SR tasks, the structure of the results using the proposed method is sharper and clearer, which are the most similar to the structure of the reference 44 min acquisition image than other methods. The proposed method also shows the ability to remove artifacts in the NR image while superresolution. The ablation study verified that the low-pass-filter loss term and T1-weighted MR image are necessary for the proposed method. Conclusions The proposed unsupervised multiscale GAN framework can simultaneously improve spatial resolution and reduce image noise. Experiment results from simulation data and three healthy subjects show that the proposed method achieves better performance than the nearest neighbor interpolation, the trilinear interpolation, the third-order B-splines interpolation, and DIP methods.
Cascade neural approximating for few-shot super-resolution photoacoustic angiography

Yuanzheng Ma,Kedi Xiong,Xuefei Hou,Wuyu Zhang,Xin Chen,Ling Li,Sihua Yang

DOI: https://doi.org/10.1063/5.0100424

IF: 4

2022-01-01

Applied Physics Letters

Abstract:High-resolution photoacoustic angiography images are reconstructed from undersampled images with the help of a super-resolution deep neural network, enhancing the ability of the photoacoustic angiography systems to image dynamic processes in living tissues. However, image degradations are difficult to estimate due to a lack of knowledge of the point spread function and noise sources, resulting in poor generalization capability of the trained super-resolution model. In this work, a high-order residual cascade neural network was developed to reconstruct high-resolution vascular images, which is a neural approximating approach used to remove image degradations of photoacoustic angiography. To handle overfitting in training super-resolution model with a limited dataset, we proposed a BicycleGAN based image synthesis method in data preparation, achieving a strong regularization by forging realistic photoacoustic vascular images that act to essentially increase the training dataset. The quantitative analysis of the reconstructed results shows that the high-order residual cascade neural network surpassed the other residual super-resolution neural networks. Most importantly, we demonstrated that the generalized model could be achieved despite the limited training dataset, promising to be a methodology for few-shot super-resolution photoacoustic angiography.
Sparse-view reconstruction for photoacoustic tomography combining diffusion model with model-based iteration

Xianlin Song,Guijun Wang,Wenhua Zhong,Kangjun Guo,Zilong Li,Xuan Liu,Jiaqing Dong,Qiegen Liu

DOI: https://doi.org/10.1016/j.pacs.2023.100558

IF: 9.656

2023-09-16

Photoacoustics

Abstract:As a non-invasive hybrid biomedical imaging technology, photoacoustic tomography combines high contrast of optical imaging and high penetration of acoustic imaging. However, the conventional standard reconstruction under sparse view could result in low-quality image in photoacoustic tomography. Here, a novel model-based sparse reconstruction method for photoacoustic tomography via diffusion model was proposed. A score-based diffusion model is designed for learning the prior information of the data distribution. The learned prior information is utilized as a constraint for the data consistency term of an optimization problem based on the least-square method in the model-based iterative reconstruction, aiming to achieve the optimal solution. Blood vessels simulation data and the animal in vivo experimental data were used to evaluate the performance of the proposed method. The results demonstrate that the proposed method achieves higher-quality sparse reconstruction compared with conventional reconstruction methods and U-Net. In particular, under the extreme sparse projection (e.g., 32 projections), the proposed method achieves an improvement of ∼ 260 % in structural similarity and ∼ 30 % in peak signal-to-noise ratio for in vivo data, compared with the conventional delay-and-sum method. This method has the potential to reduce the acquisition time and cost of photoacoustic tomography, which will further expand the application range.
Artificial vascular image generation using blood vessel texture maps

Adriano Dos Reis Carvalho,Matheus Viana da Silva,Cesar H Comin

DOI: https://doi.org/10.1016/j.compbiomed.2024.109226

Abstract:Background: Current methods for identifying blood vessels in digital images typically involve training neural networks on pixel-wise annotated data. However, manually outlining whole vessel trees in images tends to be very costly. One approach for reducing the amount of manual annotation is to pre-train networks on artificially generated vessel images. Recent pre-training approaches focus on generating proper artificial geometries for the vessels, while the appearance of the vessels is defined using general statistics of the real samples or generative networks requiring an additional training procedure to be defined. In contrast, we propose a methodology for generating blood vessels with realistic textures extracted directly from manually annotated vessel segments from real samples. The method allows the generation of artificial images having blood vessels with similar geometry and texture to the real samples using only a handful of manually annotated vessels. Methods: The first step of the method is the manual annotation of the borders of a small vessel segment, which takes only a few seconds. The annotation is then used for creating a reference image containing the texture of the vessel, called a texture map. A procedure is then defined to allow texture maps to be placed on top of any smooth curve using a piecewise linear transformation. Artificial images are then created by generating a set of vessel geometries using Bézier curves and assigning vessel texture maps to the curves. Results: The method is validated on a fluorescence microscopy (CORTEX) and a fundus photography (DRIVE) dataset. We show that manually annotating only 0.03% of the vessels in the CORTEX dataset allows pre-training a network to reach, on average, a Dice score of 0.87 ± 0.02, which is close to the baseline score of 0.92 obtained when all vessels of the training split of the dataset are annotated. For the DRIVE dataset, on average, a Dice score of 0.74 ± 0.02 is obtained by annotating only 0.29% of the vessels, which is also close to the baseline Dice score of 0.81 obtained when all vessels are annotated. Conclusion: The proposed method can be used for disentangling the geometry and texture of blood vessels, which allows a significant improvement of network pre-training performance when compared to other pre-training methods commonly used in the literature.
Ultra-Sparse Reconstruction for Photoacoustic Tomography: Sinogram Domain Prior-Guided Method Exploiting Enhanced Score-Based Diffusion Model

Zilong Li,Jiabin Lin,Yiguang Wang,Jiahong Li,Yubin Cao,Xuan Liu,Wenbo Wan,Qiegen Liu,Xianlin Song

DOI: https://doi.org/10.1016/j.pacs.2024.100670

IF: 9.656

2025-01-01

Photoacoustics

Abstract:Photoacoustic tomography, a novel non-invasive imaging modality, combines the principles of optical and acoustic imaging for use in biomedical applications. In scenarios where photoacoustic signal acquisition is insufficient due to sparse-view sampling, conventional direct reconstruction methods significantly degrade image resolution and generate numerous artifacts. To mitigate these constraints, a novel sinogram-domain priors guided extremely sparse-view reconstruction method for photoacoustic tomography boosted by enhanced diffusion model is proposed. The model learns prior information from the data distribution of sinograms under full-ring, 512-projections. In iterative reconstruction, the prior information serves as a constraint in least-squares optimization, facilitating convergence towards more plausible solutions. The performance of the method is evaluated using blood vessel simulation, phantoms, and in vivo experimental data. Subsequently, the transformation of the reconstructed sinograms into the image domain is achieved through the delay-and-sum method, enabling a thorough assessment of the proposed method. The results show that the proposed method demonstrates superior performance compared to the U-Net method, yielding images of markedly higher quality. Notably, for in vivo data under 32 projections, the sinogram structural similarity improved by ~21% over U-Net, and the image structural similarity increased by ~51% and ~84% compared to U-Net and delay-and-sum methods, respectively. The reconstruction in the sinogram domain for photoacoustic tomography enhances sparse-view imaging capabilities, potentially expanding the applications of photoacoustic tomography.
Super-Resolution on Rotationally Scanned Photoacoustic Microscopy Images Incorporating Scanning Prior

Kai Pan,Linyang Li,Li Lin,Pujin Cheng,Junyan Lyu,Lei Xi,Xiaoyin Tang

2023-12-12

Abstract:Photoacoustic Microscopy (PAM) images integrating the advantages of optical contrast and acoustic resolution have been widely used in brain studies. However, there exists a trade-off between scanning speed and image resolution. Compared with traditional raster scanning, rotational scanning provides good opportunities for fast PAM imaging by optimizing the scanning mechanism. Recently, there is a trend to incorporate deep learning into the scanning process to further increase the scanning speed.Yet, most such attempts are performed for raster scanning while those for rotational scanning are relatively rare. In this study, we propose a novel and well-performing super-resolution framework for rotational scanning-based PAM imaging. To eliminate adjacent rows' displacements due to subject motion or high-frequency scanning distortion,we introduce a registration module across odd and even rows in the preprocessing and incorporate displacement degradation in the training. Besides, gradient-based patch selection is proposed to increase the probability of blood vessel patches being selected for training. A Transformer-based network with a global receptive field is applied for better performance. Experimental results on both synthetic and real datasets demonstrate the effectiveness and generalizability of our proposed framework for rotationally scanned PAM images'super-resolution, both quantitatively and qualitatively. Code is available at <a class="link-external link-https" href="https://github.com/11710615/PAMSR.git" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
Parallel Diffusion Models Promote High Detail-Fidelity Photoacoustic Microscopy in Sparse Sampling.

Jie Wu,Kaipeng Zhang,Chengeng Huang,Yuanzheng Ma,Rui Ma,Xin Chen,Ting Guo,Sihua Yang,Zhen Yuan,Zhenhui Zhang

DOI: https://doi.org/10.1364/oe.528474

IF: 3.8

2024-01-01

Optics Express

Abstract:Reconstructing sparsely sampled data is fundamental for achieving high spatiotemporal resolution photoacoustic microscopy (PAM) of microvascular morphology in vivo. Convolutional networks (CNN) and generative adversarial networks (GAN) have been introduced to high-speed PAM, but due to the use of upsampling in CNN-based networks to restore details and the instability in GAN training, they struggle to learn the entangled microvascular network structure and vascular texture features, resulting in only achieving low detail-fidelity imaging of microvascular. The diffusion models is richly sampled and can generate high-quality images, which is very helpful for the complex vascular features in PAM. Here, we propose an approach named parallel diffusion models (PDM) with parallel learning of Noise task and Image task, where the Noise task optimizes through variational lower bounds to generate microvascular structures that are visually realistic, and the Image task improves the fidelity of the generated microvascular details through image-based loss. With only 1.56% of fully sampled pixels from photoacoustic human oral data, PDM achieves an LPIPS of 0.199. Additionally, using PDM in high-speed 16x PAM prevents breathing artifacts and image distortion issues caused by low-speed sampling, reduces the standard deviation of the Row-wise Self-Correlation Coefficient, and maintains high image quality. It achieves high confidence in reconstructing detailed information from sparsely sampled data and will promote the application of reconstructed sparsely sampled data in realizing high spatiotemporal resolution PAM.
Image enhancement in acoustic-resolution photoacoustic microscopy enabled by a novel directional algorithm

Fei Feng,Siqi Liang,Sung-Liang Chen

DOI: https://doi.org/10.1364/boe.452017

IF: 3.4

2022-01-28

Biomedical Optics Express

Abstract:By considering the line pattern of acoustic-resolution photoacoustic microscopy (AR-PAM) vessel images, we develop modified algorithms for synthetic aperture focusing technique (SAFT) and deconvolution based on a directional approach to enhance images. The modified algorithms consist of Fourier accumulation SAFT (FA-SAFT) and directional model-based (D-MB) deconvolution. To evaluate the performance of our algorithms, we conduct a series of imaging experiments and apply our algorithms, and existing SAFT and deconvolution algorithms are also applied for side-by-side comparison. By imaging tungsten wire phantom, our algorithms enable full width at half maximum of 26 - 31 µm over depth of focus of 1.8 mm and minimum resolvable distance of 46 - 49 µm, besting existing SAFT and deconvolution algorithms. Imaging of leaf skeleton phantom and <i>in vivo</i> imaging of mouse blood vessels also prove that our algorithm is capable of providing high-resolution, high-signal-to-noise ratio, and good-fidelity results for complex structures and for <i>in vivo</i> applications, especially for the images with the line pattern. The proposed directional approach can not only be used in AR-PAM but also in other imaging modalities to deal with the line pattern, such as FA-SAFT for ultrasound imaging and D-MB deconvolution for optical coherence tomography angiography.

radiology, nuclear medicine & medical imaging,biochemical research methods,optics
Resolution Enhancement of Under-sampled Photoacoustic Microscopy Images using Implicit Neural Representations

Youshen Xiao,Sheng Liao,Xuanyang Tian,Fan Zhang,Xinlong Dong,Yunhui Jiang,Xiyu Chen,Ruixi Sun,Yuyao Zhang,Fei Gao

2024-10-15

Abstract:Acoustic-Resolution Photoacoustic Microscopy (AR-PAM) is promising for subcutaneous vascular imaging, but its spatial resolution is constrained by the Point Spread Function (PSF). Traditional deconvolution methods like Richardson-Lucy and model-based deconvolution use the PSF to improve resolution. However, accurately measuring the PSF is difficult, leading to reliance on less accurate blind deconvolution techniques. Additionally, AR-PAM suffers from long scanning times, which can be reduced via down-sampling, but this necessitates effective image recovery from under-sampled data, a task where traditional interpolation methods fall short, particularly at high under-sampling rates. To address these challenges, we propose an approach based on Implicit Neural Representations (INR). This method learns a continuous mapping from spatial coordinates to initial acoustic pressure, overcoming the limitations of discrete imaging and enhancing AR-PAM's resolution. By treating the PSF as a learnable parameter within the INR framework, our technique mitigates inaccuracies associated with PSF estimation. We evaluated our method on simulated vascular data, showing significant improvements in Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM) over conventional methods. Qualitative enhancements were also observed in leaf vein and in vivo mouse brain microvasculature images. When applied to a custom AR-PAM system, experiments with pencil lead demonstrated that our method delivers sharper, higher-resolution results, indicating its potential to advance photoacoustic microscopy.

Computer Vision and Pattern Recognition
Super Resolution of Arterial Spin Labeling MR Imaging Using Unsupervised Multi-Scale Generative Adversarial Network

Jianan Cui,Kuang Gong,Paul Han,Huafeng Liu,Quanzheng Li

DOI: https://doi.org/10.48550/arXiv.2009.06129

2020-09-14

Abstract:Arterial spin labeling (ASL) magnetic resonance imaging (MRI) is a powerful imaging technology that can measure cerebral blood flow (CBF) quantitatively. However, since only a small portion of blood is labeled compared to the whole tissue volume, conventional ASL suffers from low signal-to-noise ratio (SNR), poor spatial resolution, and long acquisition time. In this paper, we proposed a super-resolution method based on a multi-scale generative adversarial network (GAN) through unsupervised training. The network only needs the low-resolution (LR) ASL image itself for training and the T1-weighted image as the anatomical prior. No training pairs or pre-training are needed. A low-pass filter guided item was added as an additional loss to suppress the noise interference from the LR ASL image. After the network was trained, the super-resolution (SR) image was generated by supplying the upsampled LR ASL image and corresponding T1-weighted image to the generator of the last layer. Performance of the proposed method was evaluated by comparing the peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) using normal-resolution (NR) ASL image (5.5 min acquisition) and high-resolution (HR) ASL image (44 min acquisition) as the ground truth. Compared to the nearest, linear, and spline interpolation methods, the proposed method recovers more detailed structure information, reduces the image noise visually, and achieves the highest PSNR and SSIM when using HR ASL image as the ground-truth.

Image and Video Processing,Machine Learning,Medical Physics
Deep-Learning Image Reconstruction for Real-Time Photoacoustic System

MinWoo Kim,Geng-Shi Jeng,Ivan Pelivanov,Matthew O’Donnell,Matthew O'Donnell

DOI: https://doi.org/10.1109/tmi.2020.2993835

IF: 10.6

2020-11-01

IEEE Transactions on Medical Imaging

Abstract:Recent advances in photoacoustic (PA) imaging have enabled detailed images of microvascular structure and quantitative measurement of blood oxygenation or perfusion. Standard reconstruction methods for PA imaging are based on solving an inverse problem using appropriate signal and system models. For handheld scanners, however, the ill-posed conditions of limited detection view and bandwidth yield low image contrast and severe structure loss in most instances. In this paper, we propose a practical reconstruction method based on a deep convolutional neural network (CNN) to overcome those problems. It is designed for real-time clinical applications and trained by large-scale synthetic data mimicking typical microvessel networks. Experimental results using synthetic and real datasets confirm that the deep-learning approach provides superior reconstructions compared to conventional methods.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
Imaging Enhancement for Acoustic-Resolution Photoacoustic Microscopy by Deep Learning

Chenyao Wen,Xi Liu,Xing Long,Changhui Li

DOI: https://doi.org/10.1109/nbec58134.2023.10352587

2023-01-01

Abstract:Photoacoustic (PA) imaging is a biomedical imaging technique that combines the principles of both optics and acoustics to visualize tissues and structures inside the body. It involves the generation of acoustic waves by the absorption of pulsed laser light in tissues, and the subsequent detection of these acoustic waves to form images. The acoustic-resolution photoacoustic microscopy (AR-PAM) is a simple but powerful photoacoustic imaging method. However, there are two major challenges for AR-PAM existed: the quickly degrading in spatial resolution in the out-of-focus region and the image reconstruction artefacts due to the limited-view issue. Those two limitations were caused by the strong scattering of optical-acoustic phenomenon. To enhance the image quality, we reported that the deep learning (DL) convolutional neural network (CNN) can not only significantly enhance the resolution of AR-PAM but also help correcting reconstruction artifacts. Simulated PA data are used to train the network to approximate the real physical structures from scanned images. Not only finished the simulation study, we also validated our method by both phantom and in vivo animal studies. Phantoms are used to verify the full width half maximum of object in out-of-focus area can be significantly enhanced, while that in the focal area are also improved. In the animal studies, a rat’s abdomen was also input into the network for prediction. The result indicates that in animal images, utilizing repeated the DL processing twice, three-dimensional structural information can gain the clarity. Our results demonstrated that DL could play an important role of the imaging enhancement and 3D structural defuzzification for AR-PAM system.
Adversarial Deep-Unfolding Network for MA-XRF Super-Resolution on Old Master Paintings Using Minimal Training Data

Herman Verinaz-Jadan,Su Yan,Catherine Higgitt,Pier Luigi Dragotti

2024-09-15

Abstract:High-quality element distribution maps enable precise analysis of the material composition and condition of Old Master paintings. These maps are typically produced from data acquired through Macro X-ray fluorescence (MA-XRF) scanning, a non-invasive technique that collects spectral information. However, MA-XRF is often limited by a trade-off between acquisition time and resolution. Achieving higher resolution requires longer scanning times, which can be impractical for detailed analysis of large artworks. Super-resolution MA-XRF provides an alternative solution by enhancing the quality of MA-XRF scans while reducing the need for extended scanning sessions. This paper introduces a tailored super-resolution approach to improve MA-XRF analysis of Old Master paintings. Our method proposes a novel adversarial neural network architecture for MA-XRF, inspired by the Learned Iterative Shrinkage-Thresholding Algorithm. It is specifically designed to work in an unsupervised manner, making efficient use of the limited available data. This design avoids the need for extensive datasets or pre-trained networks, allowing it to be trained using just a single high-resolution RGB image alongside low-resolution MA-XRF data. Numerical results demonstrate that our method outperforms existing state-of-the-art super-resolution techniques for MA-XRF scans of Old Master paintings.

Image and Video Processing
Model-based super-resolution reconstruction for pseudo-continuous Arterial Spin Labeling

Q. Beirinckx,P. Bladt,M.C.E. van der Plas,M.J.P. van Osch,B. Jeurissen,A.J. den Dekker,J. Sijbers

DOI: https://doi.org/10.1016/j.neuroimage.2024.120506

IF: 5.7

2024-01-09

NeuroImage

Abstract:Arterial spin labeling (ASL) is a promising, non-invasive perfusion magnetic resonance imaging technique for quantifying cerebral blood flow (CBF). Unfortunately, ASL suffers from an inherently low signal-to-noise ratio (SNR) and spatial resolution, undermining its potential. Increasing spatial resolution without significantly sacrificing SNR or scan time represents a critical challenge towards routine clinical use. In this work, we propose a model-based super-resolution reconstruction (SRR)...

radiology, nuclear medicine & medical imaging,neurosciences,neuroimaging
Deep-learning-based super-resolution reconstruction of high-speed imaging in fluids

Zhibo Wang,Xiangru Li,Luhan Liu,Xuecheng Wu,Pengfei Hao,Xiwen Zhang,Feng He

DOI: https://doi.org/10.1063/5.0078644

IF: 4.6

2022-03-01

Physics of Fluids

Abstract:In many fluid experiments, we can only obtain low-spatial high-temporal resolution flow images and high-spatial low-temporal resolution flow images due to the limitation of high-speed imaging systems. To solve this problem, we proposed a degradation and super-resolution attention model (D-SRA) using unsupervised machine learning to super-resolution reconstruct high resolution (HR) time-resolved fluid images from coarse data. Unlike the prior research to increase the resolution of coarse data artificially generated by simple bilinear down-sampling, our model that consists of a degradation neural network and a super-resolution neural network aims to learn the mappings between experimental low-resolution data and corresponding HR data. What is more, channel and spatial attention modules are also adopted in D-SRA to facilitate the restoration of abundant and critical details of flow fields. The proposed model is validated by two high-speed schlieren experiments of under-expanded impinging supersonic jets. The comprehensive capability of D-SRA is statistically analyzed based on the synthetic unpaired schlieren images. The spatial-resolution of coarse images can be successfully augmented by [Formula: see text] times and [Formula: see text] times with most physical details recovered perfectly, which outperforms the existing method. The D-SRA also exhibits considerable generalization and robustness against unknown-degenerated schlieren images. Moreover, the practicability of the proposed method is also further explored on real unpaired jets schlieren images. It is convincingly demonstrated that the present study successfully surpasses the performance limitations of high-speed cameras and has significant applications in various fluid experiments to obtain flow images with high spatial and temporal resolution.

mechanics,physics, fluids & plasmas
Accelerating Super-Resolution Ultrasound Localization Microscopy Using Generative Adversarial Net

Sui Yi-Hui,Guo Xing-Yi,Yu Jun-Jin,Alexander A. Solovev,Ta De-An,Xu Kai-Liang

DOI: https://doi.org/10.7498/aps.71.20220954

2022-01-01

Abstract:Ultrafast ultrasound localization microscopy (uULM) has broken through the fundamental acoustic diffraction limit by accumulating thousands of sub-wavelength microbubble localisation points and improved the spatial resolution by more than one order of magnitude, which is conducive to clinical diagnosis. By localizing individually injected microbubbles and tracking their movement with a subwavelength resolution, the vasculature microscopy can be achieved with micrometer scale. However, the reconstruction of a uULM image often requires tens or even hundreds of seconds of continuous long-range image acquisition, which limits its clinical application. In order to solve this problem, a generative adversarial network (GAN) based deep learning method is proposed to reconstruct the super-resolution ultrasound localization microscopy. In vivo uULM ultrasound datasets are used to train the network to reconstruct dense vascular networks via localized microbubbles. This approach is validated by using another in-vivo dataset obtained in a rat brain. Results show that GAN based ultrafast ultrasound localization microscopy (GAN-uULM) can resolve micro vessels smaller than 10 μm. Besides, GAN-uULM is able to distinguish small vessels that cannot be continuously reconstructed by using a standard uULM reconstruction method. Saturation parameter based on counting the number of explored pixels is used to evaluate the reconstruction quality. The proposed reconstruction approach reduces the data requirement by half and thus significantly accelerates the uULM imaging. It is illustrasted that for a dataset of 292 s ultrafast acquisition, the saturation of standard uULM image is 33%, while that of GAN-uULM can reach 46%. Fourier ring correlation (FRC) method is utilized to measure the spatial resolution in uULM. Resolutions of the images obtained by standard uULM and GAN-ULM are 7.8 μm and 8.9 μm, respectively.In conclusion, the developed deep learning model is able to connect trajectories with less computational complexity and avoids manual tuning and trajectory screening, providing an effective solution for accelerating ultrasound localization microscopy.

Super-Resolution Photoacoustic Angiography Assisted by Images Forged from Hand-Drawn Graffiti

Self-similarity-based super-resolution of photoacoustic angiography from hand-drawn doodles

Super-resolution Reconstruction Algorithms Based on Fusion of Deep Learning Mechanism and Wavelet

DOVE: Doodled vessel enhancement for photoacoustic angiography super resolution

RECONSTRUCTION OF HIGH-RESOLUTION HEPATIC TUMOR CT IMAGES USING AN AUGMENTATION-BASED SUPER-RESOLUTION TECHNIQUE

Unsupervised arterial spin labeling image superresolution via multiscale generative adversarial network

Cascade neural approximating for few-shot super-resolution photoacoustic angiography

Sparse-view reconstruction for photoacoustic tomography combining diffusion model with model-based iteration

Artificial vascular image generation using blood vessel texture maps

Ultra-Sparse Reconstruction for Photoacoustic Tomography: Sinogram Domain Prior-Guided Method Exploiting Enhanced Score-Based Diffusion Model

Super-Resolution on Rotationally Scanned Photoacoustic Microscopy Images Incorporating Scanning Prior

Parallel Diffusion Models Promote High Detail-Fidelity Photoacoustic Microscopy in Sparse Sampling.

Image enhancement in acoustic-resolution photoacoustic microscopy enabled by a novel directional algorithm

Resolution Enhancement of Under-sampled Photoacoustic Microscopy Images using Implicit Neural Representations

Super Resolution of Arterial Spin Labeling MR Imaging Using Unsupervised Multi-Scale Generative Adversarial Network

Deep-Learning Image Reconstruction for Real-Time Photoacoustic System

Imaging Enhancement for Acoustic-Resolution Photoacoustic Microscopy by Deep Learning

Adversarial Deep-Unfolding Network for MA-XRF Super-Resolution on Old Master Paintings Using Minimal Training Data

Model-based super-resolution reconstruction for pseudo-continuous Arterial Spin Labeling

Deep-learning-based super-resolution reconstruction of high-speed imaging in fluids

Accelerating Super-Resolution Ultrasound Localization Microscopy Using Generative Adversarial Net