Abstract:Background Radiation therapy requires precision to target and escalate the doses to affected regions while reducing the adjacent normal tissue exposed to high radiotherapy doses. Image guidance has become the start of the art in the treating process. Registering the digital radiographs megavoltage x ray (MV-DRs) and the kilovoltage digital reconstructed radiographs (KV-DRRs) is difficult because of the poor quality of MV-DRs. We simplify the problem by registering between landmarks instead of entire image information, thence we propose a model to estimate the landmark accurately. Methods After doctors’ analysis, it is proved that it is effective to register through several physiological features such as spinous process, tracheal bifurcation, Louis angle. We propose the LandmarkNet, a novel keypoint estimation architecture, can automatically detect keypoints in blurred medical images. The method applies the idea of Feature Pyramid Network (FPN) twice to merge the cross-scale and cross-layer features for feature extraction and landmark estimation successively. Intermediate supervision is used at the end of the first FPN to ensure that the underlying parameters are updated normally. The network finally produces heatmap to display the approximate location of landmarks and we obtain accurate position estimation after non-maximum suppression (NMS) processing. Results Our method could obtain accurate landmark estimation in the dataset provided by several cancer hospitals and labeled by ourselves. The standard percentage of correct keypoints (PCK) within 8 pixels of estimation for the spinous process, tracheal bifurcation and Louis angle is 81.24%, 98.95% and 85.61% respectively. For the above three landmarks, the mean deviation between the predicted location of each landmark and corresponding ground truth is 2.38, 0.98 and 2.64 pixels respectively. Conclusion Landmark estimation based on LandmarkNet has high accuracy for different kinds of landmarks. Our model estimates the location of tracheal bifurcation especially accurately because of its obvious features. For the spinous process, our model performs well in quantity estimation as well as in position estimation. The wide application of our method assists doctors in image-guided radiotherapy (IGRT) and provides the possibility of precise treatment in the true sense.

PELE scores: pelvic X-ray landmark detection with pelvis extraction and enhancement

PELE scores: Pelvic X-ray Landmark Detection by Pelvis Extraction and Enhancement

Learning-based landmark detection in pelvis x-rays with attention mechanism: data from the osteoarthritis initiative

Fully automatic segmentation of AP pelvis X-rays via random forest regression with efficient feature selection and hierarchical sparse shape composition

A scalable physician-level deep learning algorithm detects universal trauma on pelvic radiographs

Fully Automatic Segmentation Of Ap Pelvis X-Rays Via Random Forest Regression And Hierarchical Sparse Shape Composition

Multi-Scale Semantic Fusion of a Large Receptive Field for Irregular Pelvic X-Ray Landmark Detection

Weakly Supervised Universal Fracture Detection in Pelvic X-rays

Prior Active Shape Model for Detecting Pelvic Landmarks

Assessment of Pelvic Tilt in Anteroposterior Radiographs by Area Ratio Based on Deep Learning

Pelphix: Surgical Phase Recognition from X-ray Images in Percutaneous Pelvic Fixation

Anatomical landmark detection on bi-planar radiographs for predicting spinopelvic parameters

Landet: an efficient physics-informed deep learning approach for automatic detection of anatomical landmarks and measurement of spinopelvic alignment

RayEmb: Arbitrary Landmark Detection in X-Ray Images Using Ray Embedding Subspace

Comparison of pelvic incidence measurement using lateral x-ray, standard ct versus ct with 3d reconstruction

Automatic Hip Detection in Anteroposterior Pelvic Radiographs—A Labelless Practical Framework

Misshapen Pelvis Landmark Detection With Local-Global Feature Learning for Diagnosing Developmental Dysplasia of the Hip.

Misshapen Pelvis Landmark Detection by Spatial Local Correlation Mining for Diagnosing Developmental Dysplasia of the Hip

3DPX: Single Panoramic X-ray Analysis Guided by 3D Oral Structure Reconstruction

LandmarkNet: a 2D Digital Radiograph Landmark Estimator for Registration

Automatic X-ray Landmark Detection and Shape Segmentation Via Data-Driven Joint Estimation of Image Displacements.