Abstract:Motion estimation is a fundamental step in dynamic medical image processing for the assessment of target organ anatomy and function. However, existing image-based motion estimation methods, which optimize the motion field by evaluating the local image similarity, are prone to produce implausible estimation, especially in the presence of large motion. In addition, the correct anatomical topology is difficult to be preserved as the image global context is not well incorporated into motion estimation. In this study, we provide a novel motion estimation framework of dense-sparse-dense (DSD), which comprises two stages. In the first stage, we process the raw dense image to extract sparse landmarks to represent the target organ's anatomical topology, and discard the redundant information that is unnecessary for motion estimation. For this purpose, we introduce an unsupervised 3-D landmark detection network to extract spatially sparse but representative landmarks for the target organ's motion estimation. In the second stage, we derive the sparse motion displacement from the extracted sparse landmarks of two images of different time points. Then, we present a motion reconstruction network to construct the motion field by projecting the sparse landmarks' displacement back into the dense image domain. Furthermore, we employ the estimated motion field from our two-stage DSD framework as initialization and boost the motion estimation quality in light-weight yet effective iterative optimization. We evaluate our method on two dynamic medical imaging tasks to model cardiac motion and lung respiratory motion, respectively. Our method has produced superior motion estimation accuracy compared to the existing comparative methods. Besides, the extensive experimental results demonstrate that our solution can extract well-representative anatomical landmarks without any requirement of manual annotation. Our code is publicly available online: https://github.com/yyguo-sjtu/DSD-3D-Unsupervised-Landmark-Detection-Based-Motion-Estimation.

Unsupervised 4D Cardiac Motion Tracking with Spatiotemporal Optical Flow Networks

Recurrent Graph Optimal Transport for Learning 3D Flow Motion in Particle Tracking

Optical Flow Networks for Heartbeat Estimation in 4D Ultrasound Images

Spatiotemporal Strategies for Joint Segmentation and Motion Tracking from Cardiac Image Sequences

Endocardium Tracking by Fusing Optical Flows in Straightened Images with Learning Based Detections

Unsupervised Landmark Detection-Based Spatiotemporal Motion Estimation for 4-D Dynamic Medical Images

Flow network tracking for spatiotemporal and periodic point matching: Applied to cardiac motion analysis

Unsupervised Landmark Detection Based Spatiotemporal Motion Estimation for 4D Dynamic Medical Images

Continuous 3D Myocardial Motion Tracking via Echocardiography

Deep Learning Assessment of Myocardial Infarction From MR Image Sequences.

Unsupervised Deep Learning for Optical Flow Estimation.

DeepTracking-Net: 3D Tracking with Unsupervised Learning of Continuous Flow

Tracking Anything in Heart All at Once

Neural Multi-Scale Self-Supervised Registration for Echocardiogram Dense Tracking

EV-MGRFlowNet: Motion-Guided Recurrent Network for Unsupervised Event-Based Optical Flow With Hybrid Motion-Compensation Loss

Unsupervised Learning Optical Flow in Multi-frame Dynamic Environment Using Temporal Dynamic Modeling

Deep Networks for Image Motion Estimation

Anatomy-Aware Cardiac Motion Estimation

Deep Motion Network for Freehand 3D Ultrasound Reconstruction

Convolutional Neural Network-Based Speckle Tracking for Ultrasound Strain Elastography: an Unsupervised Learning Approach.

Unsupervised Optical Flow Estimation Based on Improved Feature Pyramid