Abstract:Purpose: Stereo matching methods that enable depth estimation are crucial for visualization enhancement applications in computer-assisted surgery (CAS). Learning-based stereo matching methods are promising to predict accurate results on laparoscopic images. However, they require a large amount of training data, and their performance may be degraded due to domain shifts. Methods: Maintaining robustness and improving the accuracy of learning-based methods are still open problems. To overcome the limitations of learning-based methods, we propose a disparity refinement framework consisting of a local disparity refinement method and a global disparity refinement method to improve the results of learning-based stereo matching methods in a cross-domain setting. Those learning-based stereo matching methods are pre-trained on a large public dataset of natural images and are tested on two datasets of laparoscopic images. Results: Qualitative and quantitative results suggest that our proposed disparity framework can effectively refine disparity maps when they are noise-corrupted on an unseen dataset, without compromising prediction accuracy when the network can generalize well on an unseen dataset. Conclusion: Our proposed disparity refinement framework could work with learning-based methods to achieve robust and accurate disparity prediction. Yet, as a large laparoscopic dataset for training learning-based methods does not exist and the generalization ability of networks remains to be improved, the incorporation of the proposed disparity refinement framework into existing networks will contribute to improving their overall accuracy and robustness associated with depth estimation.

Phase-based learning for micro-baseline depth estimation

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

A Learning-based Framework for Hybrid Depth-from-Defocus and Stereo Matching

Light Field from Micro-Baseline Image Pair

Learning Local Event-based Descriptor for Patch-based Stereo Matching

CRF-Based Reconstruction from Narrow-Baseline Image Sequences.

Hybrid stereo matching by dynamic programming with enhanced cost entry for real-time depth generation

Stacking Learning with Coalesced Cost Filtering for Accurate Stereo Matching

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

Depth Refinement for Improved Stereo Reconstruction

A Disparity Refinement Framework for Learning-based Stereo Matching Methods in Cross-domain Setting for Laparoscopic Images

Utilizing the ability of human visual phase discrimination for stereo vision

Unsupervised learning of depth estimation from imperfect rectified stereo laparoscopic images

Depth Estimation by Combining Binocular Stereo and Monocular Structured-Light

Stereoscopic Learning for Disparity Estimation

Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation

MC-Stereo: Multi-peak Lookup and Cascade Search Range for Stereo Matching

Deep eyes: Joint depth inference using monocular and binocular cues

Stereo Matching by Self-supervision of Multiscopic Vision.

Image Refined Disparity Our novel view Iterate Synthesized Light Field Novel view from Didyk

PlaneStereo: Plane-aware Multi-view Stereo