Abstract:Acquiring high-resolution 3D surface structures is a crucial task in computer vision as it provides more detailed surface textures and clearer structures. Photometric stereo can measure per-pixel surface normals of a 3D object using various shading cues. However, obtaining high-resolution images in a linear response photometric stereo imaging system can be challenging. Additionally, photometric stereo, as a per-pixel reconstruction method, requires higher-resolution surface normal maps to accurately depict complex surface structures, particularly in regions that demand more attention and precise reconstruction. Therefore, measuring high-resolution surface normals via low-resolution photometric stereo images is of great importance. Motivated by these, we propose a Super-resolution Photometric Stereo Network, namely SR-PSN. In order to address the issues of measuring the high-resolution surface normals from low-resolution photometric images, we mainly (1) apply a dual-position threshold normalization pre-processing scheme to effectively handle the spatially-varying reflectance of non-Lambertian surfaces, (2) adopt a local affinity feature module to learn the rich structural representation by explicitly revealing the neighbor relationships, (3) employ a parallel multi-scale feature extractor, which preserves high-resolution representations and deep feature extraction, and (4) propose a shared-weight regressor to handle the multi-scale features, to prevent the model collapsing into learning non-important features related to a certain fixed scale. Extensive ablation experiments validate the effectiveness of our proposed modules. Furthermore, quantitative experiments conducted on public benchmarks demonstrate that SR-PSN outperforms state-of-the-art calibrated photometric stereo methods. Notably, SR-PSN achieves superior results while utilizing photometric stereo images with only half the resolution of other methods. It effectively restores the structure of complex surfaces, producing a high-resolution normal map.

Underwater Surface Normal Reconstruction Via Cross-Grained Photometric Stereo Transformer

Underwater Multi-Spectral Photometric Stereo Reconstruction From A Single Rgbd Image

Real-time Underwater 3D Reconstruction Based on Monocular Image

Combining encoded structured light and photometric stereo for underwater 3D reconstruction

Underwater Optical 3-D Reconstruction of Photometric Stereo Considering Light Refraction and Attenuation

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

Real-time Underwater 3D Reconstruction Method Based on Stereo Camera

GR-PSN: Learning to Estimate Surface Normal and Reconstruct Photometric Stereo Images.

Underwater 3D Reconstruction Based on Geometric Transformation of Sonar and Depth Information

Estimating High-resolution Surface Normals via Low-resolution Photometric Stereo Images

Unformer: A Transformer-Based Approach for Adaptive Multi-Scale Feature Aggregation in Underwater Image Enhancement

A Novel Learning Based Non-Lambertian Photometric Stereo Method for Pixel-Level Normal Reconstruction of Polished Surfaces

3D Surface Reconstruction of Underwater Objects

UDR-GS: Enhancing Underwater Dynamic Scene Reconstruction with Depth Regularization

Aquatic-GS: A Hybrid 3D Representation for Underwater Scenes

A Coarse-to-Fine Reconstruction Framework for Non-Lambertian Photometric Stereo

Robust Photometric Stereo in A Scattering Medium Via Low-Rank Matrix Completion and Recovery

Three-Dimensional Reconstruction from Single Image Base on Combination of CNN and Multi-Spectral Photometric Stereo

Underwater 3D reconstruction using a photometric stereo with illuminance estimation

Reliable and Effective Stereo Matching for Underwater Scenes

Advanced Underwater Measurement System for ROVs: Integrating Sonar and Stereo Vision for Enhanced Subsea Infrastructure Maintenance