Abstract:Modern ocean research necessitates high-precision 3-D underwater data acquisition. Photometric stereo is a critical technique for recovering high-resolution, dense surface normals of textureless objects, such as the seabed and underwater pipelines. This technique is fundamental for underwater robots engaged in ocean exploration and operational tasks. Traditional underwater photometric stereo methods account for distributed underwater media, such as light scattering. However, the deployment of devices in complex underwater environments (e.g., ocean currents) often results in misalignment and jitter among photometric stereo images. These challenges lead to inaccuracies in matching-based methods, particularly due to the lack of texture and varying illumination conditions. To address these issues, we propose the Cross-Grained Transformer Photometric Stereo (CGT-PS) Network. CGT-PS is designed to directly manage misaligned pixels caused by underwater jitter in an end-to-end manner. The proposed method consists of two main components: the local-grained and global-grained modules. The local-grained module utilizes a Shift operation to adjust pixels within a single-pixel span, effectively mitigating misalignment caused by motion without increasing computational cost. In contrast, the global-grained module performs nonlocal fusion learning, leveraging distant features to enhance the extraction of intricate structural details, cast shadows, and interreflection regions. Ablation studies confirm the efficacy of the proposed modules. Extensive experiments on photometric stereo benchmark data sets and real underwater photometric stereo samples demonstrate that our method achieves superior performance.

Combining encoded structured light and photometric stereo for underwater 3D reconstruction

Underwater Optical 3-D Reconstruction of Photometric Stereo Considering Light Refraction and Attenuation

Underwater Multi-Spectral Photometric Stereo Reconstruction From A Single Rgbd Image

Robust photometric stereo using structural light sources

Underwater 3D reconstruction using a photometric stereo with illuminance estimation

Real-time Underwater 3D Reconstruction Method Based on Stereo Camera

Underwater Surface Normal Reconstruction Via Cross-Grained Photometric Stereo Transformer

A dense stereo matching method based on optimized direction-information images for the real underwater measurement environment

Refractive Laser Triangulation and Photometric Stereo in Underwater Environment

Robust Photometric Stereo in A Scattering Medium Via Low-Rank Matrix Completion and Recovery

Structured Light-Based Underwater 3-D Reconstruction Techniques: A Comparative Study

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

Real-time Underwater 3D Reconstruction Based on Monocular Image

3D Reconstruction Model of Underwater Environment in Stereo Vision System

A Method for 3D Reconstruction Based on Photometric Stereo Image

High-Quality Depth Recovery Via Interactive Multi-view Stereo

View-based Underwater SLAM Using a Stereo Camera

Depth Acquisition with the Combination of Structured Light and Deep Learning Stereo Matching.

Combining Depth-Estimation-based Multi-Spectral Photometric Stereo and SLAM for Real-Time Dense 3D Reconstruction

Three-Dimensional Reconstruction from Single Image Base on Combination of CNN and Multi-Spectral Photometric Stereo

Reconstruction with Underwater Stereo Vision