Immunotherapy for prostate cancer using prostatic acid phosphatase loaded antigen presenting cells.

A. Lin,R. Hershberg,E. Small

DOI: https://doi.org/10.1016/J.UROLONC.2005.08.010

2006-09-01

Abstract:

What problem does this paper attempt to address?

De-Noising of Photoacoustic Microscopy Images by Deep Learning

Da He,Jiasheng Zhou,Xiaoyu Shang,Jiajia Luo,Sung-Liang Chen

DOI: https://doi.org/10.48550/arXiv.2201.04302

2022-01-12

Image and Video Processing

Abstract:As a hybrid imaging technology, photoacoustic microscopy (PAM) imaging suffers from noise due to the maximum permissible exposure of laser intensity, attenuation of ultrasound in the tissue, and the inherent noise of the transducer. De-noising is a post-processing method to reduce noise, and PAM image quality can be recovered. However, previous de-noising techniques usually heavily rely on mathematical priors as well as manually selected parameters, resulting in unsatisfactory and slow de-noising performance for different noisy images, which greatly hinders practical and clinical applications. In this work, we propose a deep learning-based method to remove complex noise from PAM images without mathematical priors and manual selection of settings for different input images. An attention enhanced generative adversarial network is used to extract image features and remove various noises. The proposed method is demonstrated on both synthetic and real datasets, including phantom (leaf veins) and in vivo (mouse ear blood vessels and zebrafish pigment) experiments. The results show that compared with previous PAM de-noising methods, our method exhibits good performance in recovering images qualitatively and quantitatively. In addition, the de-noising speed of 0.016 s is achieved for an image with $256\times256$ pixels. Our approach is effective and practical for the de-noising of PAM images.
De-Noising of Photoacoustic Microscopy Images by Attentive Generative Adversarial Network

Da He,Jiasheng Zhou,Xiaoyu Shang,Xingye Tang,Jiajia Luo,Sung-Liang Chen

DOI: https://doi.org/10.1109/TMI.2022.3227105

IF: 10.6

2023-01-01

IEEE Transactions on Medical Imaging

Abstract:As a hybrid imaging technology, photoacoustic microscopy (PAM) imaging suffers from noise due to the maximum permissible exposure of laser intensity, attenuation of ultrasound in the tissue, and the inherent noise of the transducer. De-noising is an image processing method to reduce noise, and PAM image quality can be recovered. However, previous de-noising techniques usually heavily rely on manually selected parameters, resulting in unsatisfactory and slow de-noising performance for different noisy images, which greatly hinders practical and clinical applications. In this work, we propose a deep learning-based method to remove noise from PAM images without manual selection of settings for different noisy images. An attention enhanced generative adversarial network is used to extract image features and adaptively remove various levels of Gaussian, Poisson, and Rayleigh noise. The proposed method is demonstrated on both synthetic and real datasets, including phantom (leaf veins) and in vivo (mouse ear blood vessels and zebrafish pigment) experiments. In the in vivo experiments using synthetic datasets, our method achieves the improvement of 6.53 dB and 0.26 in peak signal-to-noise ratio and structural similarity metrics, respectively. The results show that compared with previous PAM de-noising methods, ourmethod exhibits good performance in recovering images qualitatively and quantitatively. In addition, the de-noising processing speed of 0.016 s is achieved for an image with 256 x 256 pixels, which has the potential for real-time applications. Our approach is effective and practical for the de-noising of PAM images.
Denoising convolutional neural networks for photoacoustic microscopy

Xianlin Song,Kanggao Tang,Jianshuang Wei,Lingfang Song

DOI: https://doi.org/10.48550/arXiv.2009.13913

2020-09-29

Image and Video Processing

Abstract:Photoacoustic imaging is a new imaging technology in recent years, which combines the advantages of high resolution and rich contrast of optical imaging with the advantages of high penetration depth of acoustic imaging. Photoacoustic imaging has been widely used in biomedical fields, such as brain imaging, tumor detection and so on. The signal-to-noise ratio (SNR) of image signals in photoacoustic imaging is generally low due to the limitation of laser pulse energy, electromagnetic interference in the external environment and system noise. In order to solve the problem of low SNR of photoacoustic images, we use feedforward denoising convolutional neural network to further process the obtained images, so as to obtain higher SNR images and improve image quality. We use Python language to manage the referenced Python external library through Anaconda, and build a feedforward noise-reducing convolutional neural network on Pycharm platform.We first processed and segmated a training set containing 400 images, and then used it for network training. Finally, we tested it with a series of cerebrovascular photoacoustic microscopy images.The results show that the peak signal-to-noise ratio (PSNR) of the image increases significantly before and after denoising.The experimental results verify that the feed-forward noise reduction convolutional neural network can effectively improve the quality of photoacoustic microscopic images, which provides a good foundation for the subsequent biomedical research.
Simultaneous Denoising and Localization Network for Photoacoustic Target Localization

Amirsaeed Yazdani,Sumit Agrawal,Kerrick Johnstonbaugh,Sri-Rajasekhar Kothapalli,Vishal Monga

DOI: https://doi.org/10.48550/arXiv.2104.14713

2021-04-30

Abstract:A significant research problem of recent interest is the localization of targets like vessels, surgical needles, and tumors in photoacoustic (PA) images. To achieve accurate localization, a high photoacoustic signal-to-noise ratio (SNR) is required. However, this is not guaranteed for deep targets, as optical scattering causes an exponential decay in optical fluence with respect to tissue depth. To address this, we develop a novel deep learning method designed to explicitly exhibit robustness to noise present in photoacoustic radio-frequency (RF) data. More precisely, we describe and evaluate a deep neural network architecture consisting of a shared encoder and two parallel decoders. One decoder extracts the target coordinates from the input RF data while the other boosts the SNR and estimates clean RF data. The joint optimization of the shared encoder and dual decoders lends significant noise robustness to the features extracted by the encoder, which in turn enables the network to contain detailed information about deep targets that may be obscured by noise. Additional custom layers and newly proposed regularizers in the training loss function (designed based on observed RF data signal and noise behavior) serve to increase the SNR in the cleaned RF output and improve model performance. To account for depth-dependent strong optical scattering, our network was trained with simulated photoacoustic datasets of targets embedded at different depths inside tissue media of different scattering levels. The network trained on this novel dataset accurately locates targets in experimental PA data that is clinically relevant with respect to the localization of vessels, needles, or brachytherapy seeds. We verify the merits of the proposed architecture by outperforming the state of the art on both simulated and experimental datasets.

Image and Video Processing
Noise‐insensitive defocused signal and resolution enhancement for optical‐resolution photoacoustic microscopy via deep learning

Rui Wang,Zhipeng Zhang,Ruiyi Chen,Xiaohai Yu,Hongyu Zhang,Gang Hu,Qiegen Liu,Xianlin Song

DOI: https://doi.org/10.1002/jbio.202300149

IF: 3.3899

2023-07-27

Journal of Biophotonics

Abstract:Optical‐resolution photoacoustic microscopy suffers from narrow depth of field and a significant deterioration in defocused signal intensity and spatial resolution. Here, a method based on deep learning was proposed to enhance the defocused resolution and signal‐to‐noise ratio. A virtual optical‐resolution photoacoustic microscopy based on k‐Wave was used to obtain the datasets of deep learning with different noise levels. A fully dense U‐Net was trained with randomly distributed sources to improve the quality of photoacoustic images. The results show that the PSNR of defocused signal was enhanced by more than 1.2 times. An over 2.6‐fold enhancement in lateral resolution and an over 3.4‐fold enhancement in axial resolution of defocused regions were achieved. The large volumetric and high‐resolution imaging of blood vessels further verified that the proposed method can effectively overcome the deterioration of the signal and the spatial resolution due to the narrow depth of field of optical‐resolution photoacoustic microscopy. This article is protected by copyright. All rights reserved.

optics,biochemical research methods,biophysics
Shot Noise Reduction in Radiographic and Tomographic Multi-Channel Imaging with Self-Supervised Deep Learning

Yaroslav Zharov,Evelina Ametova,Rebecca Spiecker,Tilo Baumbach,Genoveva Burca,Vincent Heuveline

2023-03-25

Abstract:Noise is an important issue for radiographic and tomographic imaging techniques. It becomes particularly critical in applications where additional constraints force a strong reduction of the Signal-to-Noise Ratio (SNR) per image. These constraints may result from limitations on the maximum available flux or permissible dose and the associated restriction on exposure time. Often, a high SNR per image is traded for the ability to distribute a given total exposure capacity per pixel over multiple channels, thus obtaining additional information about the object by the same total exposure time. These can be energy channels in the case of spectroscopic imaging or time channels in the case of time-resolved imaging. In this paper, we report on a method for improving the quality of noisy multi-channel (time or energy-resolved) imaging datasets. The method relies on the recent Noise2Noise (N2N) self-supervised denoising approach that learns to predict a noise-free signal without access to noise-free data. N2N in turn requires drawing pairs of samples from a data distribution sharing identical signals while being exposed to different samples of random noise. The method is applicable if adjacent channels share enough information to provide images with similar enough information but independent noise. We demonstrate several representative case studies, namely spectroscopic (k-edge) X-ray tomography, in vivo X-ray cine-radiography, and energy-dispersive (Bragg edge) neutron tomography. In all cases, the N2N method shows dramatic improvement and outperforms conventional denoising methods. For such imaging techniques, the method can therefore significantly improve image quality, or maintain image quality with further reduced exposure time per image.

Computer Vision and Pattern Recognition
Neighboring Slice Noise2Noise: Self-Supervised Medical Image Denoising from Single Noisy Image Volume

Langrui Zhou,Ziteng Zhou,Xinyu Huang,Xiangyu Zhang,Huiru Wang,Guang Li

2024-12-02

Abstract:In the last few years, with the rapid development of deep learning technologies, supervised methods based on convolutional neural networks have greatly enhanced the performance of medical image denoising. However, these methods require large quantities of noisy-clean image pairs for training, which greatly limits their practicality. Although some researchers have attempted to train denoising networks using only single noisy images, existing self-supervised methods, including blind-spot-based and data-splitting-based methods, heavily rely on the assumption that noise is pixel-wise independent. However, this assumption often does not hold in real-world medical images. Therefore, in the field of medical imaging, there remains a lack of simple and practical denoising methods that can achieve high-quality denoising performance using only single noisy images. In this paper, we propose a novel self-supervised medical image denoising method, Neighboring Slice Noise2Noise (NS-N2N). The proposed method utilizes neighboring slices within a single noisy image volume to construct weighted training data, and then trains the denoising network using a self-supervised scheme with regional consistency loss and inter-slice continuity loss. NS-N2N only requires a single noisy image volume obtained from one medical imaging procedure to achieve high-quality denoising of the image volume itself. Extensive experiments demonstrate that the proposed method outperforms state-of-the-art self-supervised denoising methods in both denoising performance and processing efficiency. Furthermore, since NS-N2N operates solely in the image domain, it is free from device-specific issues such as reconstruction geometry, making it easier to apply in various clinical practices.

Image and Video Processing,Computer Vision and Pattern Recognition
Unified Noise-aware Network for Low-count PET Denoising

Huidong Xie,Qiong Liu,Bo Zhou,Xiongchao Chen,Xueqi Guo,Chi Liu

2023-04-28

Abstract:As PET imaging is accompanied by substantial radiation exposure and cancer risk, reducing radiation dose in PET scans is an important topic. However, low-count PET scans often suffer from high image noise, which can negatively impact image quality and diagnostic performance. Recent advances in deep learning have shown great potential for recovering underlying signal from noisy counterparts. However, neural networks trained on a specific noise level cannot be easily generalized to other noise levels due to different noise amplitude and variances. To obtain optimal denoised results, we may need to train multiple networks using data with different noise levels. But this approach may be infeasible in reality due to limited data availability. Denoising dynamic PET images presents additional challenge due to tracer decay and continuously changing noise levels across dynamic frames. To address these issues, we propose a Unified Noise-aware Network (UNN) that combines multiple sub-networks with varying denoising power to generate optimal denoised results regardless of the input noise levels. Evaluated using large-scale data from two medical centers with different vendors, presented results showed that the UNN can consistently produce promising denoised results regardless of input noise levels, and demonstrate superior performance over networks trained on single noise level data, especially for extremely low-count data.

Image and Video Processing
Denoising for Optical-Resolution Photoacoustic Microscopy Via a Score-Based Diffusion Generative Model

Wenkang Gong,Yubin Cao,Yiguang Wang,Xianlin Song

DOI: https://doi.org/10.1117/12.3022561

2024-01-01

Abstract:Photoacoustic microscopy is a hybrid imaging technique that capitalizes on the photoacoustic effect to enhance imaging processes, achieving precise image reconstruction by eliminating noise within photoacoustic signals. This study introduces an innovative deep learning denoising algorithm based on score-based diffusion generative models. During the forward propagation process, the model acquires a score representation of the prior noise distribution resulting from the diffusion of the photoacoustic image. In the reverse reconstruction process, the noisy photoacoustic image serves as input. Following multiple iterations by the solver, a noise-free photoacoustic image is generated as the output. A predictor-corrector framework, trained during the forward propagation process, is employed to rectify the reverse evolution. This algorithm effectively reduces noise and demonstrates its efficacy in complex denoising challenges, thereby significantly improving the quality of photoacoustic imaging.
Comparative Study of Deep Neural Networks with Unsupervised Noise2Noise Strategy for Noise Reduction of Optical Coherence Tomography Images.

Bin Qiu,Shuang Zeng,Xiangxi Meng,Zhe Jiang,Yunfei You,Mufeng Geng,Ziyuan Li,Yicheng Hu,Zhiyu Huang,Chuanqing Zhou,Qiushi Ren,Yanye Lu

DOI: https://doi.org/10.1002/jbio.202100151

IF: 3.3899

2021-01-01

Journal of Biophotonics

Abstract:As a powerful diagnostic tool, optical coherence tomography (OCT) has been widely used in various clinical setting. However, OCT images are susceptible to inherent speckle noise that may contaminate subtle structure information, due to low-coherence interferometric imaging procedure. Many supervised learning-based models have achieved impressive performance in reducing speckle noise of OCT images trained with a large number of noisy-clean paired OCT images, which are not commonly feasible in clinical practice. In this article, we conducted a comparative study to investigate the denoising performance of OCT images over different deep neural networks through an unsupervised Noise2Noise (N2N) strategy, which only trained with noisy OCT samples. Four representative network architectures including U-shaped model, multi-information stream model, straight-information stream model and GAN-based model were investigated on an OCT image dataset acquired from healthy human eyes. The results demonstrated all four unsupervised N2N models offered denoised OCT images with a performance comparable with that of supervised learning models, illustrating the effectiveness of unsupervised N2N models in denoising OCT images. Furthermore, U-shaped models and GAN-based models using UNet network as generator are two preferred and suitable architectures for reducing speckle noise of OCT images and preserving fine structure information of retinal layers under unsupervised N2N circumstances.
Ultrasonic Image's Annotation Removal: A Self-supervised Noise2Noise Approach

Yuanheng Zhang,Nan Jiang,Zhaoheng Xie,Junying Cao,Yueyang Teng

2023-07-09

Abstract:Accurately annotated ultrasonic images are vital components of a high-quality medical report. Hospitals often have strict guidelines on the types of annotations that should appear on imaging results. However, manually inspecting these images can be a cumbersome task. While a neural network could potentially automate the process, training such a model typically requires a dataset of paired input and target images, which in turn involves significant human labour. This study introduces an automated approach for detecting annotations in images. This is achieved by treating the annotations as noise, creating a self-supervised pretext task and using a model trained under the Noise2Noise scheme to restore the image to a clean state. We tested a variety of model structures on the denoising task against different types of annotation, including body marker annotation, radial line annotation, etc. Our results demonstrate that most models trained under the Noise2Noise scheme outperformed their counterparts trained with noisy-clean data pairs. The costumed U-Net yielded the most optimal outcome on the body marker annotation dataset, with high scores on segmentation precision and reconstruction similarity. We released our code at <a class="link-external link-https" href="https://github.com/GrandArth/UltrasonicImage-N2N-Approach" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
Deep learning-based photoacoustic imaging of vascular network through thick porous media

Ya Gao,Wenyi Xu,Yiming Chen,Weiya Xie,Qian Cheng

DOI: https://doi.org/10.1109/TMI.2022.3158474

2022-08-15

Abstract:Photoacoustic imaging (PAI) is a promising approach to realize in vivo transcranial cerebral vascular imaging. However, the strong attenuation and distortion of the photoacoustic wave caused by the thick porous skull greatly affect the imaging quality. In this study, we designed a convolutional neural network (CNN) with a U-Net architecture to extract the effective photoacoustic information hidden in the speckle patterns; obtained vascular network images datasets under porous media through simulation and experiment, and trained the network weights respectively. The results show that the proposed neural network can learn the mapping relationship between the speckle pattern and the target; extract the photoacoustic signals of some vessels submerged in noise to reconstruct high-quality images with a sharp outline of the vessel and clean background. Compared with the traditional photoacoustic reconstruction method, the deep learning-based reconstruction algorithms can achieve better performance, the mean absolute error (MAE), Structural SIMilarity (SSIM) and peak signal-to-noise ratio (PSNR) of reconstructed images have been greatly improved. In conclusion, the proposed neural network can effectively extract valid information from highly blurred speckle patterns for the rapid reconstruction of target images, which offers promising applications in transcranial photoacoustic imaging.

Medical Physics
UPAMNet: A unified network with deep knowledge priors for photoacoustic microscopy

Yuxuan Liu,Jiasheng Zhou,Yating Luo,Jinkai Li,Sung-Liang Chen,Yao Guo,Guang-Zhong Yang

DOI: https://doi.org/10.1016/j.pacs.2024.100608

IF: 9.656

2024-04-27

Photoacoustics

Abstract:Photoacoustic microscopy (PAM) has gained increasing popularity in biomedical imaging, providing new opportunities for tissue monitoring and characterization. With the development of deep learning techniques, convolutional neural networks have been used for PAM image resolution enhancement and denoising. However, there exist several inherent challenges for this approach. This work presents a U nified P hoto A coustic M icroscopy image reconstruction Net work (UPAMNet) for both PAM image super-resolution and denoising. The proposed method takes advantage of deep image priors by incorporating three effective attention-based modules and a mixed training constraint at both pixel and perception levels. The generalization ability of the model is evaluated in details and experimental results on different PAM datasets demonstrate the superior performance of the method. Experimental results show improvements of 0.59 dB and 1.37 dB, respectively, for 1/4 and 1/16 sparse image reconstruction, and 3.9 dB for image denoising in peak signal-to-noise ratio.

engineering, biomedical,radiology, nuclear medicine & medical imaging,instruments & instrumentation
Reconstructing the Photoacoustic Image with High Quality using the Deep Neural Network Model

Anitha Gopalan,O. Vignesh,R. Anusuya,K. P. Senthilkumar,V. S. Nishok,T. Helan Vidhya,Florin Wilfred

DOI: https://doi.org/10.1155/2023/1172473

2023-05-16

Abstract:The range of diagnostic equipment has been widened and improved by the quick development of biomedical research technologies. The creation of multifunctional instruments that become essential for biomedical operations has been discovered by several research organizations to be made possible by optical imaging, acoustic image analysis, and magnetic resonance imaging. One of the most crucial tools is hyperspectral photoacoustic (PA) imaging, which combines optical and ultrasonic technology. In this study, the reconstruction of the PA pictures employs a new deployment of deep learning methods. This enabled us to train and evaluate our deep-learning approach under several imaging situations in addition to firmly establishing the contextual information. This study presents an optimization approach that blends multispectral optical acoustic imaging with detailed transfer learning-based diagnostic imaging. The particle swarm-convolutional neural network (PS-CNN) technique aims to reconstruct and categorize the presence of cancer using ultrasonic pictures. In image processing, the technique of bilateral filtration (BF) is commonly employed to remove noise. Additionally, the biological images are separated using portable LED Net frameworks. It is also possible to employ a feature extraction technique with the PS optimization methodology. Last but not least, biological images employ a CNN model to assign suitable classification. Using a standard dataset, the PS-CNN technology's efficacy is confirmed, and testing findings revealed that it performs superior to other methods.

radiology, nuclear medicine & medical imaging
Spatiotemporal singular value decomposition for denoising in photoacoustic imaging with low-energy excitation light source

Mengjie Shi,Tom Vercauteren,Wenfeng Xia

DOI: https://doi.org/10.1364/BOE.471198

2022-07-09

Abstract:Photoacoustic (PA) imaging is an emerging hybrid imaging modality that combines rich optical spectroscopic contrast and high ultrasonic resolution and thus holds tremendous promise for a wide range of pre-clinical and clinical applications. Compact and affordable light sources such as light-emitting diodes (LEDs) and laser diodes (LDs) are promising alternatives to bulky and expensive solid-state laser systems that are commonly used as PA light sources. These could accelerate the clinical translation of PA technology. However, PA signals generated with these light sources are readily degraded by noise due to the low optical fluence, leading to decreased signal-to-noise ratio (SNR) in PA images. In this work, a spatiotemporal singular value decomposition (SVD) based PA denoising method was investigated for these light sources that usually have low fluence and high repetition rates. The proposed method leverages both spatial and temporal correlations between radiofrequency (RF) data frames. Validation was performed on simulations and in vivo PA data acquired from human fingers (2D) and forearm (3D) using a LED-based system. Spatiotemporal SVD greatly enhanced the PA signals of blood vessels corrupted by noise while preserving a high temporal resolution to slow motions, improving the SNR of in vivo PA images by 1.1, 0.7, and 1.9 times compared to single frame-based wavelet denoising, averaging across 200 frames, and single frame without denoising, respectively. The proposed method demonstrated a processing time of around 50 \mus per frame with SVD acceleration and GPU. Thus, spatiotemporal SVD is well suited to PA imaging systems with low-energy excitation light sources for real-time in vivo applications.

Image and Video Processing,Signal Processing,Medical Physics
Jack Peter Green, 1925–2007

K. Davis,D. Charney

DOI: https://doi.org/10.1038/SJ.NPP.1301517

2007-09-17

Neuropsychopharmacology

Abstract:
Imaging Enhancement for Acoustic-Resolution Photoacoustic Microscopy by Deep Learning

Chenyao Wen,Xi Liu,Xing Long,Changhui Li

DOI: https://doi.org/10.1109/nbec58134.2023.10352587

2023-01-01

Abstract:Photoacoustic (PA) imaging is a biomedical imaging technique that combines the principles of both optics and acoustics to visualize tissues and structures inside the body. It involves the generation of acoustic waves by the absorption of pulsed laser light in tissues, and the subsequent detection of these acoustic waves to form images. The acoustic-resolution photoacoustic microscopy (AR-PAM) is a simple but powerful photoacoustic imaging method. However, there are two major challenges for AR-PAM existed: the quickly degrading in spatial resolution in the out-of-focus region and the image reconstruction artefacts due to the limited-view issue. Those two limitations were caused by the strong scattering of optical-acoustic phenomenon. To enhance the image quality, we reported that the deep learning (DL) convolutional neural network (CNN) can not only significantly enhance the resolution of AR-PAM but also help correcting reconstruction artifacts. Simulated PA data are used to train the network to approximate the real physical structures from scanned images. Not only finished the simulation study, we also validated our method by both phantom and in vivo animal studies. Phantoms are used to verify the full width half maximum of object in out-of-focus area can be significantly enhanced, while that in the focal area are also improved. In the animal studies, a rat’s abdomen was also input into the network for prediction. The result indicates that in animal images, utilizing repeated the DL processing twice, three-dimensional structural information can gain the clarity. Our results demonstrated that DL could play an important role of the imaging enhancement and 3D structural defuzzification for AR-PAM system.
Deep-Learning-Based Algorithm for the Removal of Electromagnetic Interference Noise in Photoacoustic Endoscopic Image Processing

Oleksandra Gulenko,Hyunmo Yang,KiSik Kim,Jin Young Youm,Minjae Kim,Yunho Kim,Woonggyu Jung,Joon-Mo Yang

DOI: https://doi.org/10.3390/s22103961

IF: 3.9

2022-05-24

Sensors

Abstract:Despite all the expectations for photoacoustic endoscopy (PAE), there are still several technical issues that must be resolved before the technique can be successfully translated into clinics. Among these, electromagnetic interference (EMI) noise, in addition to the limited signal-to-noise ratio (SNR), have hindered the rapid development of related technologies. Unlike endoscopic ultrasound, in which the SNR can be increased by simply applying a higher pulsing voltage, there is a fundamental limitation in leveraging the SNR of PAE signals because they are mostly determined by the optical pulse energy applied, which must be within the safety limits. Moreover, a typical PAE hardware situation requires a wide separation between the ultrasonic sensor and the amplifier, meaning that it is not easy to build an ideal PAE system that would be unaffected by EMI noise. With the intention of expediting the progress of related research, in this study, we investigated the feasibility of deep-learning-based EMI noise removal involved in PAE image processing. In particular, we selected four fully convolutional neural network architectures, U-Net, Segnet, FCN-16s, and FCN-8s, and observed that a modified U-Net architecture outperformed the other architectures in the EMI noise removal. Classical filter methods were also compared to confirm the superiority of the deep-learning-based approach. Still, it was by the U-Net architecture that we were able to successfully produce a denoised 3D vasculature map that could even depict the mesh-like capillary networks distributed in the wall of a rat colorectum. As the development of a low-cost laser diode or LED-based photoacoustic tomography (PAT) system is now emerging as one of the important topics in PAT, we expect that the presented AI strategy for the removal of EMI noise could be broadly applicable to many areas of PAT, in which the ability to apply a hardware-based prevention method is limited and thus EMI noise appears more prominently due to poor SNR.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Emulating Low-Dose PCCT Image Pairs with Independent Noise for Self-Supervised Spectral Image Denoising

Sen Wang,Yirong Yang,Grant M Stevens,Zhye Yin,Adam S Wang

DOI: https://doi.org/10.1109/TMI.2024.3449817

2024-08-28

Abstract:Photon counting CT (PCCT) acquires spectral measurements and enables generation of material decomposition (MD) images that provide distinct advantages in various clinical situations. However, noise amplification is observed in MD images, and denoising is typically applied. Clean or high-quality references are rare in clinical scans, often making supervised learning (Noise2Clean) impractical. Noise2Noise is a self-supervised counterpart, using noisy images and corresponding noisy references with zero-mean, independent noise. PCCT counts transmitted photons separately, and raw measurements are assumed to follow a Poisson distribution in each energy bin, providing the possibility to create noise-independent pairs. The approach is to use binomial selection to split the counts into two low-dose scans with independent noise. We prove that the reconstructed spectral images inherit the noise independence from counts domain through noise propagation analysis and also validated it in numerical simulation and experimental phantom scans. The method offers the flexibility to split measurements into desired dose levels while ensuring the reconstructed images share identical underlying features, thereby strengthening the model's robustness for input dose levels and capability of preserving fine details. In both numerical simulation and experimental phantom scans, we demonstrated that Noise2Noise with binomial selection outperforms other common self-supervised learning methods based on different presumptive conditions.
Reconstructing undersampled photoacoustic microscopy images using deep learning

Anthony DiSpirito III,Daiwei Li,Tri Vu,Maomao Chen,Dong Zhang,Jianwen Luo,Roarke Horstmeyer,Junjie Yao

DOI: https://doi.org/10.48550/arXiv.2006.00251

2020-05-30

Abstract:One primary technical challenge in photoacoustic microscopy (PAM) is the necessary compromise between spatial resolution and imaging speed. In this study, we propose a novel application of deep learning principles to reconstruct undersampled PAM images and transcend the trade-off between spatial resolution and imaging speed. We compared various convolutional neural network (CNN) architectures, and selected a fully dense U-net (FD U-net) model that produced the best results. To mimic various undersampling conditions in practice, we artificially downsampled fully-sampled PAM images of mouse brain vasculature at different ratios. This allowed us to not only definitively establish the ground truth, but also train and test our deep learning model at various imaging conditions. Our results and numerical analysis have collectively demonstrated the robust performance of our model to reconstruct PAM images with as few as 2% of the original pixels, which may effectively shorten the imaging time without substantially sacrificing the image quality.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning

Immunotherapy for prostate cancer using prostatic acid phosphatase loaded antigen presenting cells.

De-Noising of Photoacoustic Microscopy Images by Deep Learning

De-Noising of Photoacoustic Microscopy Images by Attentive Generative Adversarial Network

Denoising convolutional neural networks for photoacoustic microscopy

Simultaneous Denoising and Localization Network for Photoacoustic Target Localization

Noise‐insensitive defocused signal and resolution enhancement for optical‐resolution photoacoustic microscopy via deep learning

Shot Noise Reduction in Radiographic and Tomographic Multi-Channel Imaging with Self-Supervised Deep Learning

Neighboring Slice Noise2Noise: Self-Supervised Medical Image Denoising from Single Noisy Image Volume

Unified Noise-aware Network for Low-count PET Denoising

Denoising for Optical-Resolution Photoacoustic Microscopy Via a Score-Based Diffusion Generative Model

Comparative Study of Deep Neural Networks with Unsupervised Noise2Noise Strategy for Noise Reduction of Optical Coherence Tomography Images.

Ultrasonic Image's Annotation Removal: A Self-supervised Noise2Noise Approach

Deep learning-based photoacoustic imaging of vascular network through thick porous media

UPAMNet: A unified network with deep knowledge priors for photoacoustic microscopy

Reconstructing the Photoacoustic Image with High Quality using the Deep Neural Network Model

Spatiotemporal singular value decomposition for denoising in photoacoustic imaging with low-energy excitation light source

Jack Peter Green, 1925–2007

Imaging Enhancement for Acoustic-Resolution Photoacoustic Microscopy by Deep Learning

Deep-Learning-Based Algorithm for the Removal of Electromagnetic Interference Noise in Photoacoustic Endoscopic Image Processing

Emulating Low-Dose PCCT Image Pairs with Independent Noise for Self-Supervised Spectral Image Denoising

Reconstructing undersampled photoacoustic microscopy images using deep learning