Abstract:Background Radiation therapy requires precision to target and escalate the doses to affected regions while reducing the adjacent normal tissue exposed to high radiotherapy doses. Image guidance has become the start of the art in the treating process. Registering the digital radiographs megavoltage x ray (MV-DRs) and the kilovoltage digital reconstructed radiographs (KV-DRRs) is difficult because of the poor quality of MV-DRs. We simplify the problem by registering between landmarks instead of entire image information, thence we propose a model to estimate the landmark accurately. Methods After doctors’ analysis, it is proved that it is effective to register through several physiological features such as spinous process, tracheal bifurcation, Louis angle. We propose the LandmarkNet, a novel keypoint estimation architecture, can automatically detect keypoints in blurred medical images. The method applies the idea of Feature Pyramid Network (FPN) twice to merge the cross-scale and cross-layer features for feature extraction and landmark estimation successively. Intermediate supervision is used at the end of the first FPN to ensure that the underlying parameters are updated normally. The network finally produces heatmap to display the approximate location of landmarks and we obtain accurate position estimation after non-maximum suppression (NMS) processing. Results Our method could obtain accurate landmark estimation in the dataset provided by several cancer hospitals and labeled by ourselves. The standard percentage of correct keypoints (PCK) within 8 pixels of estimation for the spinous process, tracheal bifurcation and Louis angle is 81.24%, 98.95% and 85.61% respectively. For the above three landmarks, the mean deviation between the predicted location of each landmark and corresponding ground truth is 2.38, 0.98 and 2.64 pixels respectively. Conclusion Landmark estimation based on LandmarkNet has high accuracy for different kinds of landmarks. Our model estimates the location of tracheal bifurcation especially accurately because of its obvious features. For the spinous process, our model performs well in quantity estimation as well as in position estimation. The wide application of our method assists doctors in image-guided radiotherapy (IGRT) and provides the possibility of precise treatment in the true sense.

FDGR-Net: Feature Decouple and Gated Recalibration Network for Medical Image Landmark Detection

FDN: Feature Decoupling Network for Head Pose Estimation.

Super-resolution landmark detection networks for medical images

Learn Fine-Grained Adaptive Loss for Multiple Anatomical Landmark Detection in Medical Images

Deep Learning-Based Regression and Classification for Automatic Landmark Localization in Medical Images

Automated Anatomical Landmark Detection Ondistal Femur Surface Using Convolutional Neural Network

Automatic Localization of Landmarks in Craniomaxillofacial CBCT Images Using a Local Attention-Based Graph Convolution Network.

Anatomical Landmark Detection Using a Feature-Sharing Knowledge Distillation-Based Neural Network

CAMLD: Contrast-Agnostic Medical Landmark Detection with Consistency-Based Regularization

LandmarkNet: a 2D Digital Radiograph Landmark Estimator for Registration

Landmark detection in Cardiac Magnetic Resonance Imaging Using A Convolutional Neural Network

HYATT-Net is Grand: A Hybrid Attention Network for Performant Anatomical Landmark Detection

Feature Aggregation and Refinement Network for 2D Anatomical Landmark Detection

You Only Learn Once: Universal Anatomical Landmark Detection

Facial Landmark Localization by Enhanced Convolutional Neural Network.

A Cascade Regression Model For Anatomical Landmark Detection

Fast and Robust Detection of Anatomical Landmarks Using Cascaded 3D Convolutional Networks Guided by Linear Square Regression.

A universal medically assisted model for anatomical landmark detection in radioactive images

CNN-based Landmark Detection in Cardiac CTA Scans

Spine Landmark Localization with combining of Heatmap Regression and Direct Coordinate Regression

Landmark Localization for Cephalometric Analysis Using Multiscale Image Patch-Based Graph Convolutional Networks