Abstract:<section class="article-section__content"><h3 class="article-section__sub-title section1"> Purpose</h3><p>Cone‐beam CT (CBCT) is a common on‐treatment imaging widely used in image‐guided radiotherapy. Fast and accurate registration between the on‐treatment CBCT and planning CT is significant for and precise adaptive radiotherapy treatment (ART). However, existing CT‐CBCT registration methods, which are mostly affine or time‐consuming intensity‐ based deformation registration, still need further study due to the considerable CT‐CBCT intensity discrepancy and the artifacts in low‐quality CBCT images. In this paper, we propose a deep learning based CT‐CBCT registration model to promote rapid and accurate CT‐CBCT registration for radiotherapy.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Methods</h3><p>The proposed CT‐CBCT registration model consists of a registration network and an innovative deep similarity metric network. The registration network is a novel FCN adapted specially for patch‐wise CT‐CBCT registration. The metric network, going beyond intensity, automatically evaluates the high‐dimensional attribute‐based dissimilarity between the registered CT and CBCT images. In addition, considering the artifacts in low‐quality CBCT images, we add spatial weighting (SW) block to adaptively attach more importance to those informative voxels while inhibit the interference of artifact regions. Such SW‐based metric network is expected to extract the most meaningful and discriminative deep features, and form a more reliable CT‐CBCT similarity measure to train the registration network.</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Results</h3><p>We evaluate the proposed method on clinical thoracic CBCT and CT dataset, and compare the registration results with some other common image similarity metrics and some state‐of‐the‐art registration algorithms. The proposed method provides the highest Structural Similarity index (86.17±5.09), minimum Target Registration Error of landmarks (2.37±0.32 mm), and the best DSC coefficient (78.71±10.95) of tumor volumes. Moreover, our model also obtains comparable distance error of lung surfaces (1.75±0.35 mm).</p></section><section class="article-section__content"><h3 class="article-section__sub-title section1"> Conclusion</h3><p>The proposed model shows both efficiency and efficacy for reliable thoracic CT‐CBCT registration, and can generate the matched CT and CBCT images within few seconds, which is of great significance to clinical radiotherapy.</p></section>

Multimodal Deformable Registration Based on Unsupervised Learning

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Unsupervised Multi-Modal Medical Image Registration Via Discriminator-Free Image-to-Image Translation.

An Unsupervised Convolution Neural Network for Deformable Registration of Mono/Multi-Modality Medical Images

Unsupervised Registration for Liver CT-MR Images Based on the Multiscale Integrated Spatial-Weight Module and Dual Similarity Guidance.

Contextual Reinforcement Learning for Unsupervised Deformable Multimodal Medical Images Registration

Multimodal MR Image Registration Using Weakly Supervised Constrained Affine Network

Unsupervised deep learning registration model for multimodal brain images

Deep learning-based 3D brain multimodal medical image registration

Multi-strategy Mutual Learning Network for Deformable Medical Image Registration

Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registration

A Novel Unsupervised Learning Model for Diffeomorphic Image Registration

Label-driven weakly-supervised learning for multimodal deformable image registration

Unsupervised Multimodal 3D Medical Image Registration with Multilevel Correlation Balanced Optimization

Multimodal image registration with joint structure tensor and local entropy

Unsupervised Multimodal Image Registration with Adaptative Gradient Guidance

Unsupervised Multi-parametric MRI Registration Using Neural Optimal Transport

A Multi-Scale Unsupervised Learning for Deformable Image Registration

Unsupervised learning for deformable registration of thoracic CT and cone‐beam CT based on multiscale features matching with spatially adaptive weighting

Modality-Agnostic Structural Image Representation Learning for Deformable Multi-Modality Medical Image Registration

Macjnet: Weakly-Supervised Multimodal Image Deformable Registration Using Joint Learning Framework and Multi-Sampling Cascaded MIND