Abstract:Vision-based underwater autonomous systems play a significant role in marine exploration. Stereo matching is one of the most popular applications for vision-based underwater autonomous systems, which recovers the geometric information of underwater scenes via stereo disparity estimation. While stereo matching in the air has achieved great progress with the development of neural networks, it generalizes poorly to the underwater scenario due to the challenging underwater degradation. In this paper, we propose a novel Multilevel Inverse Patchmatch Network (MIPNet) to iteratively model pair-wise correlations under underwater degradation and estimate stereo disparity with both local and global refinements. Specifically, we first utilized the inverse Patchmatch module in a novel multilevel pyramid structure to recover the detailed stereo disparity from the input stereo images. Secondly, we introduced a powerful Attentional Feature Fusion module to model pair-wise correlations with global context, ensuring high-quality stereo disparity estimation for both in-air and underwater scenarios. We evaluate the proposed method on the popular real-world ETH3D benchmark, and the highly competitive performance against the popular baselines demonstrates the effectiveness of the proposed method. Moreover, with its superior performance on our real-world underwater dataset, e.g., our method outperforms the popular baseline RAFT-Stereo by 27.1%, we show the good generalization ability of our method to underwater scenarios. We finally discuss the potential challenges for underwater stereo matching via our experiments on the impact of water.

A dense stereo matching method based on optimized direction-information images for the real underwater measurement environment

Object Measurement in Real Underwater Environments Using Improved Stereo Matching with Semantic Segmentation

Reliable and Effective Stereo Matching for Underwater Scenes

Accurate Binocular Stereo Underwater Measurement Method

Model and calibration of underwater stereo vision based on the light field

Combining encoded structured light and photometric stereo for underwater 3D reconstruction

Underwater Optical 3-D Reconstruction of Photometric Stereo Considering Light Refraction and Attenuation

Underwater Refractive Stereo Vision Measurement and Simulation Imaging Model Based on Optical Path

Real-time Underwater 3D Reconstruction Method Based on Stereo Camera

Development of a Multimedia Videogrammetric Technique in Underwater Dynamic Monitoring

Underwater stereo image enhancement using a new physical model

Refractive three-dimensional reconstruction for underwater stereo digital image correlation.

Measurement Method Of Underwater Target Based On Binocular Vision

Underwater Binocular Measurement Method Based on Line-Structured Light

An underwater binocular stereo matching algorithm based on the best search domain

A 3D Label Stereo Matching Method Using Underwater Energy Function

3D Reconstruction Model of Underwater Environment in Stereo Vision System

Multilevel Inverse Patchmatch Network with Local and Global Refinement for Underwater Stereo Matching

Evaluating the Effect of Refraction on Underwater Stereo Vision

Analysis of the Influence of Refraction-Parameter Deviation on Underwater Stereo-Vision Measurement with Flat Refraction Interface

Stereo Matching for Binocular Underwater Images Using SURF Operator and Epipolar Restriction