PE-INeR: prior-embedded implicit neural representation for sparse-view CBCT reconstruction

Jiaying Yang,Shipeng Xie

DOI: https://doi.org/10.1364/ao.534352

IF: 1.9

2024-12-05

Applied Optics

Abstract:Jiaying Yang, Shipeng Xie Conventional methods for reconstructing cone-beam computed tomography (CBCT) often suffer from artifacts and blurring in the presence of ... [Appl. Opt. 63, 8907-8916 (2024)]

optics

What problem does this paper attempt to address?

Deep Fusion Network Based Sparse View CT Reconstructions for Clinical Diagnostic Scanners

Yangdi Xu,Jingsong Li,Hongxiang Lin

DOI: https://doi.org/10.1109/embc40787.2023.10341175

2023-01-01

Abstract:Sparse view CT scan has the advantage of reducing radiation exposure and scanning time in clinical diagnosis. However, the limited number of x-ray projections can make the reconstruction problem ill posed and result in image artifacts. To tackle the problem, we propose a novel model-based deep fusion network(DFN) satisfying the clinical set-up. It extracts fused features encoded from both the sinogram and the preliminary reconstructed image generated by filtered back projection (FBP) to improve the quality of reconstruction. The preliminary reconstructed image endows fused features with prior knowledge that facilitate the convergence of neural network to high-quality reconstruction images. We design a custom loss for training that enforces the network to learn both the pixel value and the integrity of the tissue structure. A synthetic sparse view breast CT dataset from American Association of Physicists in Medicine(AAPM) is used for training, validation and testing. The qualitative and quantitative evaluations show that the DFN reconstruction algorithm significantly improves in balancing between the image quality and reconstruction speed, hence enables fast and high quality CT reconstruction despite the sparse view limitations.
Implicit Neural Representations for Robust Joint Sparse-View CT Reconstruction

Jiayang Shi,Junyi Zhu,Daniel M. Pelt,K. Joost Batenburg,Matthew B. Blaschko

2024-05-04

Abstract:Computed Tomography (CT) is pivotal in industrial quality control and medical diagnostics. Sparse-view CT, offering reduced ionizing radiation, faces challenges due to its under-sampled nature, leading to ill-posed reconstruction problems. Recent advancements in Implicit Neural Representations (INRs) have shown promise in addressing sparse-view CT reconstruction. Recognizing that CT often involves scanning similar subjects, we propose a novel approach to improve reconstruction quality through joint reconstruction of multiple objects using INRs. This approach can potentially leverage both the strengths of INRs and the statistical regularities across multiple objects. While current INR joint reconstruction techniques primarily focus on accelerating convergence via meta-initialization, they are not specifically tailored to enhance reconstruction quality. To address this gap, we introduce a novel INR-based Bayesian framework integrating latent variables to capture the inter-object relationships. These variables serve as a dynamic reference throughout the optimization, thereby enhancing individual reconstruction fidelity. Our extensive experiments, which assess various key factors such as reconstruction quality, resistance to overfitting, and generalizability, demonstrate significant improvements over baselines in common numerical metrics. This underscores a notable advancement in CT reconstruction methods.

Computer Vision and Pattern Recognition,Artificial Intelligence
Implicit Neural Representation for Sparse-view Photoacoustic Computed Tomography

Bowei Yao,Shilong Cui,Haizhao Dai,Qing Wu,Youshen Xiao,Fei Gao,Jingyi Yu,Yuyao Zhang,Xiran Cai

2024-09-04

Abstract:High-quality imaging in photoacoustic computed tomography (PACT) usually requires a high-channel count system for dense spatial sampling around the object to avoid aliasing-related artefacts. To reduce system complexity, various image reconstruction approaches, such as model-based (MB) and deep learning based methods, have been explored to mitigate the artefacts associated with sparse-view acquisition. However, the explored methods formulated the reconstruction problem in a discrete framework, making it prone to measurement errors, discretization errors, and the extend of the ill-poseness of the problem scales with the discretization resolution. In this work, an implicit neural representation (INR) framework is proposed for image reconstruction in PACT with ring transducer arrays to address these issues. pecially, the initial heat distribution is represented as a continuous function of spatial coordinates using a multi-layer perceptron (MLP). The weights of the MLP are then determined by a training process in a self-supervised manner, by minimizing the errors between the measured and model predicted PA signals. After training, PA images can be mapped by feeding the coordinates to the network. Simulation and phantom experiments showed that the INR method performed best in preserving image fidelity and in artefacts suppression for the same acquisition condition, compared to universal back-projection and MB methods.

Image and Video Processing
DPER: Diffusion Prior Driven Neural Representation for Limited Angle and Sparse View CT Reconstruction

Chenhe Du,Xiyue Lin,Qing Wu,Xuanyu Tian,Ying Su,Zhe Luo,Rui Zheng,Yang Chen,Hongjiang Wei,S. Kevin Zhou,Jingyi Yu,Yuyao Zhang

2024-07-19

Abstract:Limited-angle and sparse-view computed tomography (LACT and SVCT) are crucial for expanding the scope of X-ray CT applications. However, they face challenges due to incomplete data acquisition, resulting in diverse artifacts in the reconstructed CT images. Emerging implicit neural representation (INR) techniques, such as NeRF, NeAT, and NeRP, have shown promise in under-determined CT imaging reconstruction tasks. However, the unsupervised nature of INR architecture imposes limited constraints on the solution space, particularly for the highly ill-posed reconstruction task posed by LACT and ultra-SVCT. In this study, we introduce the Diffusion Prior Driven Neural Representation (DPER), an advanced unsupervised framework designed to address the exceptionally ill-posed CT reconstruction inverse problems. DPER adopts the Half Quadratic Splitting (HQS) algorithm to decompose the inverse problem into data fidelity and distribution prior sub-problems. The two sub-problems are respectively addressed by INR reconstruction scheme and pre-trained score-based diffusion model. This combination first injects the implicit image local consistency prior from INR. Additionally, it effectively augments the feasibility of the solution space for the inverse problem through the generative diffusion model, resulting in increased stability and precision in the solutions. We conduct comprehensive experiments to evaluate the performance of DPER on LACT and ultra-SVCT reconstruction with two public datasets (AAPM and LIDC), an in-house clinical COVID-19 dataset and a public raw projection dataset created by Mayo Clinic. The results show that our method outperforms the state-of-the-art reconstruction methods on in-domain datasets, while achieving significant performance improvements on out-of-domain (OOD) datasets.

Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition
Pirple: A Penalized-Likelihood Framework for Incorporation of Prior Images in Ct Reconstruction

J. Webster Stayman,Hao Dang,Yifu Ding,Jeffrey H. Siewerdsen

DOI: https://doi.org/10.1088/0031-9155/58/21/7563

2013-01-01

Abstract:Over the course of diagnosis and treatment, it is common for a number of imaging studies to be acquired. Such imaging sequences can provide substantial patient-specific prior knowledge about the anatomy that can be incorporated into a prior-image-based tomographic reconstruction for improved image quality and better dose utilization. We present a general methodology using a model-based reconstruction approach including formulations of the measurement noise that also integrates prior images. This penalized-likelihood technique adopts a sparsity enforcing penalty that incorporates prior information yet allows for change between the current reconstruction and the prior image. Moreover, since prior images are generally not registered with the current image volume, we present a modified model-based approach that seeks a joint registration of the prior image in addition to the reconstruction of projection data. We demonstrate that the combined prior-image-and model-based technique outperforms methods that ignore the prior data or lack a noise model. Moreover, we demonstrate the importance of registration for prior-image-based reconstruction methods and show that the prior-image-registered penalized-likelihood estimation (PIRPLE) approach can maintain a high level of image quality in the presence of noisy and undersampled projection data.
AC-IND: Sparse CT reconstruction based on attenuation coefficient estimation and implicit neural distribution

Wangduo Xie,Richard Schoonhoven,Tristan van Leeuwen,Matthew B. Blaschko

2024-09-11

Abstract:Computed tomography (CT) reconstruction plays a crucial role in industrial nondestructive testing and medical diagnosis. Sparse view CT reconstruction aims to reconstruct high-quality CT images while only using a small number of projections, which helps to improve the detection speed of industrial assembly lines and is also meaningful for reducing radiation in medical scenarios. Sparse CT reconstruction methods based on implicit neural representations (INRs) have recently shown promising performance, but still produce artifacts because of the difficulty of obtaining useful prior information. In this work, we incorporate a powerful prior: the total number of material categories of objects. To utilize the prior, we design AC-IND, a self-supervised method based on Attenuation Coefficient Estimation and Implicit Neural Distribution. Specifically, our method first transforms the traditional INR from scalar mapping to probability distribution mapping. Then we design a compact attenuation coefficient estimator initialized with values from a rough reconstruction and fast segmentation. Finally, our algorithm finishes the CT reconstruction by jointly optimizing the estimator and the generated distribution. Through experiments, we find that our method not only outperforms the comparative methods in sparse CT reconstruction but also can automatically generate semantic segmentation maps.

Image and Video Processing,Computer Vision and Pattern Recognition
Sparse-view and limited-angle CT reconstruction with untrained networks and deep image prior

Ziyu Shu,Alireza Entezari

DOI: https://doi.org/10.1016/j.cmpb.2022.107167

IF: 6.1

2022-11-01

Computer Methods and Programs in Biomedicine

Abstract:Background and objective: Neural network based image reconstruction methods are becoming increasingly popular. However, limited training data and the lack of theoretical guarantees for generalizability raised concerns, especially in biomedical imaging applications. These challenges are known to lead to an unstable reconstruction process that poses significant problems in biomedical image reconstruction. In this paper, we present a new framework that uses untrained generator networks to tackle this challenge, leveraging the structure of deep networks for regularizing solutions based on a technique known as Deep Image Prior (DIP).Methods: To achieve a high reconstruction accuracy, we propose a framework optimizing both the latent vector and the weights of a generator network during the reconstruction process. We also propose the corresponding reconstruction strategies to improve the stability and convergent performance of the proposed framework. Furthermore, instead of calculating forward projection in each iteration, we propose implementing its normal operator as a convolutional kernel under parallel beam geometry, thus greatly accelerating the calculation.Results: Our experiments show that the proposed framework has significant improvements over other state-of-the-art conventional, pre-trained, and untrained methods under sparse-view, limited-angle, and low-dose conditions.Conclusions: Applying to parallel beam X-ray imaging, our framework shows advantages in speed, accuracy, and stability of the reconstruction process. We also show that the proposed framework is compatible with all differentiable regularizations that are commonly used in biomedical image reconstruction literature. Our framework can also be used as a post-processing technique to further improve the reconstruction generated by any other reconstruction methods. Furthermore, the proposed framework requires no training data and can be adjusted on-demand to adapt to different conditions (e.g. noise level, geometry, and imaged object).

engineering, biomedical,computer science, interdisciplinary applications,medical informatics, theory & methods
Implicit Neural Representation for MRI Parallel Imaging Reconstruction

Hao Li,Yusheng Zhou,Jianan Liu,Xiling Liu,Tao Huang,Zhihan Lv,Weidong Cai

2024-04-10

Abstract:Magnetic resonance imaging (MRI) usually faces lengthy acquisition times, prompting the exploration of strategies such as parallel imaging (PI) to alleviate this problem by periodically skipping specific K-space lines and subsequently reconstructing high-quality images from the undersampled K-space. Implicit neural representation (INR) has recently emerged as a promising deep learning technique, characterizing objects as continuous functions of spatial coordinates typically parameterized by a multilayer perceptron (MLP). In this study, we propose a novel MRI PI reconstruction method that uses INR. Our approach represents reconstructed fully-sampled images as functions of voxel coordinates and prior feature vectors from undersampled images, addressing the generalization challenges of INR. Specifically, we introduce a scale-embedded encoder to generate scale-independent, voxel-specific features from MR images across various undersampling scales. These features are then concatenated with coordinate vectors to reconstruct fully-sampled MR images, facilitating multiple-scale reconstructions. To evaluate our method's performance, we conducted experiments using publicly available MRI datasets, comparing it with alternative reconstruction techniques. Our quantitative assessment demonstrates the superiority of our proposed method.

Image and Video Processing,Computer Vision and Pattern Recognition,Medical Physics
Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstruction

Yiqun Lin,Zhongjin Luo,Wei Zhao,Xiaomeng Li

2023-08-31

Abstract:Sparse-view cone-beam CT (CBCT) reconstruction is an important direction to reduce radiation dose and benefit clinical applications. Previous voxel-based generation methods represent the CT as discrete voxels, resulting in high memory requirements and limited spatial resolution due to the use of 3D decoders. In this paper, we formulate the CT volume as a continuous intensity field and develop a novel DIF-Net to perform high-quality CBCT reconstruction from extremely sparse (fewer than 10) projection views at an ultrafast speed. The intensity field of a CT can be regarded as a continuous function of 3D spatial points. Therefore, the reconstruction can be reformulated as regressing the intensity value of an arbitrary 3D point from given sparse projections. Specifically, for a point, DIF-Net extracts its view-specific features from different 2D projection views. These features are subsequently aggregated by a fusion module for intensity estimation. Notably, thousands of points can be processed in parallel to improve efficiency during training and testing. In practice, we collect a knee CBCT dataset to train and evaluate DIF-Net. Extensive experiments show that our approach can reconstruct CBCT with high image quality and high spatial resolution from extremely sparse views within 1.6 seconds, significantly outperforming state-of-the-art methods. Our code will be available at <a class="link-external link-https" href="https://github.com/xmed-lab/DIF-Net" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
APRF: Anti-Aliasing Projection Representation Field for Inverse Problem in Imaging

Zixuan Chen,Lingxiao Yang,Jianhuang Lai,Xiaohua Xie

2023-07-11

Abstract:Sparse-view Computed Tomography (SVCT) reconstruction is an ill-posed inverse problem in imaging that aims to acquire high-quality CT images based on sparsely-sampled measurements. Recent works use Implicit Neural Representations (INRs) to build the coordinate-based mapping between sinograms and CT images. However, these methods have not considered the correlation between adjacent projection views, resulting in aliasing artifacts on SV sinograms. To address this issue, we propose a self-supervised SVCT reconstruction method -- Anti-Aliasing Projection Representation Field (APRF), which can build the continuous representation between adjacent projection views via the spatial constraints. Specifically, APRF only needs SV sinograms for training, which first employs a line-segment sampling module to estimate the distribution of projection views in a local region, and then synthesizes the corresponding sinogram values using center-based line integral module. After training APRF on a single SV sinogram itself, it can synthesize the corresponding dense-view (DV) sinogram with consistent continuity. High-quality CT images can be obtained by applying re-projection techniques on the predicted DV sinograms. Extensive experiments on CT images demonstrate that APRF outperforms state-of-the-art methods, yielding more accurate details and fewer artifacts. Our code will be publicly available soon.

Image and Video Processing,Computer Vision and Pattern Recognition
Geometry-Aware Attenuation Learning for Sparse-View CBCT Reconstruction

Zhentao Liu,Yu Fang,Changjian Li,Han Wu,Yuan Liu,Dinggang Shen,Zhiming Cui

2024-10-02

Abstract:Cone Beam Computed Tomography (CBCT) plays a vital role in clinical imaging. Traditional methods typically require hundreds of 2D X-ray projections to reconstruct a high-quality 3D CBCT image, leading to considerable radiation exposure. This has led to a growing interest in sparse-view CBCT reconstruction to reduce radiation doses. While recent advances, including deep learning and neural rendering algorithms, have made strides in this area, these methods either produce unsatisfactory results or suffer from time inefficiency of individual optimization. In this paper, we introduce a novel geometry-aware encoder-decoder framework to solve this problem. Our framework starts by encoding multi-view 2D features from various 2D X-ray projections with a 2D CNN encoder. Leveraging the geometry of CBCT scanning, it then back-projects the multi-view 2D features into the 3D space to formulate a comprehensive volumetric feature map, followed by a 3D CNN decoder to recover 3D CBCT image. Importantly, our approach respects the geometric relationship between 3D CBCT image and its 2D X-ray projections during feature back projection stage, and enjoys the prior knowledge learned from the data population. This ensures its adaptability in dealing with extremly sparse view inputs without individual training, such as scenarios with only 5 or 10 X-ray projections. Extensive evaluations on two simulated datasets and one real-world dataset demonstrate exceptional reconstruction quality and time efficiency of our method.

Image and Video Processing,Computer Vision and Pattern Recognition
Iterative reconstruction for limited-angle CT using implicit neural representation

Jooho Lee,Jongduk Baek

DOI: https://doi.org/10.1088/1361-6560/ad3c8e

IF: 3.5

2024-04-11

Physics in Medicine and Biology

Abstract:Objective. Limited-angle computed tomography (CT) presents a challenge due to its ill-posed nature. In such scenarios, analytical reconstruction methods often exhibit severe artifacts. To tackle this inverse problem, several supervised deep learning-based approaches have been proposed. However, they are constrained by limitations such as generalization issue and the difficulty of acquiring a large amount of paired CT images. Approach. In this work, we propose an iterative neural reconstruction framework designed for limited-angle CT. By leveraging a coordinate-based neural representation, we formulate tomographic reconstruction as a convex optimization problem involving a deep neural network. We then employ differentiable projection layer to optimize this network by minimizing the discrepancy between the predicted and measured projection data. In addition, we introduce a prior-based weight initialization method to ensure the network starts optimization with an informed initial guess. This strategic initialization significantly improves the quality of iterative reconstruction by stabilizing the divergent behavior in ill-posed neural fields. Our method operates in a self-supervised manner, thereby eliminating the need for extensive data. Main results. The proposed method outperforms other iterative and learning-based methods. Experimental results on XCAT and Mayo Clinic datasets demonstrate the effectiveness of our approach in restoring anatomical features as well as structures. This finding was substantiated by visual inspections and quantitative evaluations using NRMSE, PSNR, and SSIM. Moreover, we conduct a comprehensive investigation into the divergent behavior of iterative neural reconstruction, thus revealing its suboptimal convergence when starting from scratch. In contrast, our method consistently produced accurate images by incorporating an initial estimate as informed initialization. Significance. This work showcases the feasibility to reconstruct high-fidelity CT images from limited-angle X-ray projections. The proposed methodology introduces a novel data-free approach to enhance medical imaging, holding promise across various clinical applications.

engineering, biomedical,radiology, nuclear medicine & medical imaging
SU‐E‐I‐40: Reconstruction of Sparse Images from Few‐View Cone‐Beam Data

xujun han,junguo bian,diane r eaker,timothy l kline,emil y sidky,erik l ritman,xiaochuan pan

DOI: https://doi.org/10.1118/1.3611613

IF: 4.506

2011-01-01

Medical Physics

Abstract:Purpose: In current cone‐beam CTimaging, one acquires data at hundreds of views, at the cost of a non‐negligible amount of radiation dose as well as prolonged scanning time. Enabled by advanced, iterative algorithms, progress has recently been made on image reconstruction from sparse‐view data, which can potentially reduce imaging radiation dose and scanning time. For cases where data are highly sparse, such as when only a few (e.g. <10) projections are available, accurate image reconstruction becomes challenging. However, prior knowledge of the imaged subject such as sparse structures may be utilized to improve reconstruction fidelity. In this work, we investigated the incorporation of image sparsity into the framework of novel iterative algorithms for few‐view image reconstruction of sparse objects. Methods: We incorporated image sparsity by combining the hard‐thresholding technique into the framework of the adaptive‐steepest‐descent‐POCS (ASD‐POCS) algorithm. We performed simulation studies by using a numerical artery phantom, and real‐data studies by using micro‐CT data of a human coronary artery specimen. The number of projections under study ranged from 3 to 10. A number of quantitative metrics were used to evaluate the image‐reconstruction performance. Results: Images of numerical phantoms and the real coronary artery specimen were accurately reconstructed from as few as <5 projections. Quantitative metrics showed that the quality of few‐view image reconstruction using the proposed algorithm is comparable to that of image reconstruction using existing algorithms from data acquired at 360 to 720 views. Conclusions: We have demonstrated that by incorporating appropriate image‐sparsity information into novel iterative algorithms, CBCTimages can be reconstructed accurately from a few projections. The proposed technique may potentially be used for in‐vivo and in‐vitro coronary arteryimaging.
Evaluation of sparse-view reconstruction from flat-panel-detector cone-beam CT.

Junguo Bian,Jeffrey H Siewerdsen,Xiao Han,Emil Y Sidky,Jerry L Prince,Charles A Pelizzari,Xiaochuan Pan

DOI: https://doi.org/10.1088/0031-9155/55/22/001

IF: 3.5

2010-01-01

Physics in Medicine and Biology

Abstract:Flat-panel-detector x-ray cone-beam computed tomography (CBCT) is used in a rapidly increasing host of imaging applications, including image-guided surgery and radiotherapy. The purpose of the work is to investigate and evaluate image reconstruction from data collected at projection views significantly fewer than what is used in current CBCT imaging. Specifically, we carried out imaging experiments using a bench-top CBCT system that was designed to mimic imaging conditions in image-guided surgery and radiotherapy; we applied an image reconstruction algorithm based on constrained total-variation (TV)-minimization to data acquired with sparsely sampled view-angles and conducted extensive evaluation of algorithm performance. Results of the evaluation studies demonstrate that, depending upon scanning conditions and imaging tasks, algorithms based on constrained TV-minimization can reconstruct images of potential utility from a small fraction of the data used in typical, current CBCT applications. A practical implication of the study is that the optimization of algorithm design and implementation can be exploited for considerably reducing imaging effort and radiation dose in CBCT.
INeAT: an artifact-suppressed and resolution-enhanced computed tomography through iterative neural adaptive tomography

Bo Xiong,Changqing Su,Zihan Lin,You Zhou,Zhaofei Yu

DOI: https://doi.org/10.1364/oe.532255

IF: 3.8

2024-08-26

Optics Express

Abstract:Bo Xiong, Changqing Su, Zihan Lin, You Zhou, Zhaofei Yu Computed tomography (CT) with its remarkable capability for three-dimensional imaging from multiple projections, enjoys a broad range of ... [Opt. Express 32, 32336-32353 (2024)]

optics
Learning 3D Gaussians for Extremely Sparse-View Cone-Beam CT Reconstruction

Yiqun Lin,Hualiang Wang,Jixiang Chen,Xiaomeng Li

2024-07-07

Abstract:Cone-Beam Computed Tomography (CBCT) is an indispensable technique in medical imaging, yet the associated radiation exposure raises concerns in clinical practice. To mitigate these risks, sparse-view reconstruction has emerged as an essential research direction, aiming to reduce the radiation dose by utilizing fewer projections for CT reconstruction. Although implicit neural representations have been introduced for sparse-view CBCT reconstruction, existing methods primarily focus on local 2D features queried from sparse projections, which is insufficient to process the more complicated anatomical structures, such as the chest. To this end, we propose a novel reconstruction framework, namely DIF-Gaussian, which leverages 3D Gaussians to represent the feature distribution in the 3D space, offering additional 3D spatial information to facilitate the estimation of attenuation coefficients. Furthermore, we incorporate test-time optimization during inference to further improve the generalization capability of the model. We evaluate DIF-Gaussian on two public datasets, showing significantly superior reconstruction performance than previous state-of-the-art methods.

Image and Video Processing,Computer Vision and Pattern Recognition
Compact Implicit Neural Representations for Plane Wave Images

Mathilde Monvoisin,Yuxin Zhang,Diana Mateus

2024-09-18

Abstract:Ultrafast Plane-Wave (PW) imaging often produces artifacts and shadows that vary with insonification angles. We propose a novel approach using Implicit Neural Representations (INRs) to compactly encode multi-planar sequences while preserving crucial orientation-dependent information. To our knowledge, this is the first application of INRs for PW angular interpolation. Our method employs a Multi-Layer Perceptron (MLP)-based model with a concise physics-enhanced rendering technique. Quantitative evaluations using SSIM, PSNR, and standard ultrasound metrics, along with qualitative visual assessments, confirm the effectiveness of our approach. Additionally, our method demonstrates significant storage efficiency, with model weights requiring 530 KB compared to 8 MB for directly storing the 75 PW images, achieving a notable compression ratio of approximately 15:1.

Image and Video Processing,Computer Vision and Pattern Recognition
Few-view Cone-Beam CT Reconstruction with Deformed Prior Image.

Hua Zhang,Luo Ouyang,Jing Huang,Jianhua Ma,Wufan Chen,Jing Wang

DOI: https://doi.org/10.1118/1.4901265

2014-01-01

Abstract:Purpose:Prior images can be incorporated into the image reconstruction process to improve the quality of subsequent cone‐beam CT (CBCT) images from sparse‐view or low‐dose projections. The purpose of this work is to develop a deformed prior image‐based reconstruction (DPIR) strategy to mitigate the deformation between the prior image and the target image.Methods:The deformed prior image is obtained by a projection‐based registration approach. Specifically, the deformation vector fields used to deform the prior image are estimated through iteratively matching the forward projection of the deformed prior image and the measured on‐treatment projections. The deformed prior image is then used as the prior image in the standard prior image constrained compressed sensing (PICCS) algorithm. A simulation study on an XCAT phantom and a clinical study on a head‐and‐neck cancer patient were conducted to evaluate the performance of the proposed DPIR strategy.Results:The deformed prior image matches the geometry of the on‐treatment CBCT more closely as compared to the original prior image. Consequently, the performance of the DPIR strategy from few‐view projections is improved in comparison to the standard PICCS algorithm, based on both visual inspection and quantitative measures. In the XCAT phantom study using 20 projections, the average root mean squared error is reduced from 14% in PICCS to 10% in DPIR, and the average universal quality index increases from 0.88 in PICCS to 0.92 in DPIR.Conclusions:The present DPIR approach provides a practical solution to the mismatch problem between the prior image and target image, which improves the performance of the original PICCS algorithm for CBCT reconstruction from few‐view or low‐dose projections.
PRIOR: Prior-Regularized Iterative Optimization Reconstruction For 4D CBCT

Dianlin Hu,Yikun Zhang,Jin Liu,Yi Zhang,Jean Louis Coatrieux,Yang Chen

DOI: https://doi.org/10.1109/jbhi.2022.3201232

IF: 7.7

2022-11-01

IEEE Journal of Biomedical and Health Informatics

Abstract:4D cone-beam computed tomography (CBCT) is an important imaging modality in image-guided radiation therapy to address the motion-induced artifacts caused by organ movements during the respiratory process. However, due to the extremely sparse projection data for each temporal phase, 4D CBCT reconstructions will suffer from severe streaking artifacts. Therefore, to tackle the streak artifacts and provide high-quality images, we proposed a framework termed Prior-Regularized Iterative Optimization Reconstruction (PRIOR) for 4D CBCT. The PRIOR framework combines the physics-based model and data-driven method simultaneously, with powerful feature extracting capacity, significantly promoting the image quality compared to single model-based or deep learning-based methods. Besides, we designed a specialized deep learning model named PRIOR-Net, which can effectively excavate the static information in the prior image reconstructed from the fully-sampled projections at the encoding stage to improve the reconstruction performance for individual phase-resolved images. Both the simulated and clinical 4D CBCT datasets were performed to evaluate the performance of the PRIOR-Net and the PRIOR framework. Compared with the advanced 4D CBCT reconstruction methods, the proposed methods achieve promising results quantitatively and qualitatively in streak artifact suppression, soft tissue restoration, and tiny detail preservation.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems
Deep Radon Prior: A Fully Unsupervised Framework for Sparse-View CT Reconstruction

Shuo Xu,Yucheng Zhang,Gang Chen,Xincheng Xiang,Peng Cong,Yuewen Sun

2023-12-30

Abstract:Although sparse-view computed tomography (CT) has significantly reduced radiation dose, it also introduces severe artifacts which degrade the image quality. In recent years, deep learning-based methods for inverse problems have made remarkable progress and have become increasingly popular in CT reconstruction. However, most of these methods suffer several limitations: dependence on high-quality training data, weak interpretability, etc. In this study, we propose a fully unsupervised framework called Deep Radon Prior (DRP), inspired by Deep Image Prior (DIP), to address the aforementioned limitations. DRP introduces a neural network as an implicit prior into the iterative method, thereby realizing cross-domain gradient feedback. During the reconstruction process, the neural network is progressively optimized in multiple stages to narrow the solution space in radon domain for the under-constrained imaging protocol, and the convergence of the proposed method has been discussed in this work. Compared with the popular pre-trained method, the proposed framework requires no dataset and exhibits superior interpretability and generalization ability. The experimental results demonstrate that the proposed method can generate detailed images while effectively suppressing image artifacts.Meanwhile, DRP achieves comparable or better performance than the supervised methods.

Image and Video Processing,Computer Vision and Pattern Recognition

PE-INeR: prior-embedded implicit neural representation for sparse-view CBCT reconstruction

Deep Fusion Network Based Sparse View CT Reconstructions for Clinical Diagnostic Scanners

Implicit Neural Representations for Robust Joint Sparse-View CT Reconstruction

Implicit Neural Representation for Sparse-view Photoacoustic Computed Tomography

DPER: Diffusion Prior Driven Neural Representation for Limited Angle and Sparse View CT Reconstruction

Pirple: A Penalized-Likelihood Framework for Incorporation of Prior Images in Ct Reconstruction

AC-IND: Sparse CT reconstruction based on attenuation coefficient estimation and implicit neural distribution

Sparse-view and limited-angle CT reconstruction with untrained networks and deep image prior

Implicit Neural Representation for MRI Parallel Imaging Reconstruction

Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstruction

APRF: Anti-Aliasing Projection Representation Field for Inverse Problem in Imaging

Geometry-Aware Attenuation Learning for Sparse-View CBCT Reconstruction

Iterative reconstruction for limited-angle CT using implicit neural representation

SU‐E‐I‐40: Reconstruction of Sparse Images from Few‐View Cone‐Beam Data

Evaluation of sparse-view reconstruction from flat-panel-detector cone-beam CT.

INeAT: an artifact-suppressed and resolution-enhanced computed tomography through iterative neural adaptive tomography

Learning 3D Gaussians for Extremely Sparse-View Cone-Beam CT Reconstruction

Compact Implicit Neural Representations for Plane Wave Images

Few-view Cone-Beam CT Reconstruction with Deformed Prior Image.

PRIOR: Prior-Regularized Iterative Optimization Reconstruction For 4D CBCT

Deep Radon Prior: A Fully Unsupervised Framework for Sparse-View CT Reconstruction