Abstract:The surface normal estimation from photometric stereo becomes less reliable when the surface reflectance deviates from the Lambertian assumption. The non-Lambertian effect can be explicitly addressed by physics modeling to the reflectance function, at the cost of introducing highly nonlinear optimization. This paper proposes a numerical compensation scheme that attempts to minimize the angular error to address the non-Lambertian photometric stereo problem. Due to the multifaceted influence in the modeling of non-Lambertian reflectance in photometric stereo, directly minimizing the angular errors of surface normal is a highly complex problem. We introduce an alternating strategy, in which the estimated reflectance can be temporarily regarded as a known variable, to simplify the formulation of angular error. To reduce the impact of inaccurately estimated reflectance in this simplification, we propose a numerical compensation scheme whose compensation weight is formulated to reflect the reliability of estimated reflectance. Finally, the solution for the proposed numerical compensation scheme is efficiently computed by using cosine difference to approximate the angular difference. The experimental results show that our method can significantly improve the performance of the state-of-the-art methods on both synthetic data and real data with small additive costs. Moreover, our method initialized by results from the baseline method (least-square-based) achieves the state-of-the-art performance on both synthetic data and real data with significantly smaller overall computation, i.e., about eight times faster compared with the state-of-the-art methods.

Multi-view photometric stereo of non-Lambertian surface under general illuminations

A Non-Lambertian Photometric Stereo under Perspective Projection

Non-Lambertian photometric stereo by color and noise analysis

Robust photometric stereo using structural light sources

Photometric Stereo for General BRDFs via Reflection Sparsity Modeling

On accurate recovery of 3D surface normal using minimum 2D images

Fusing Multiview and Photometric Stereo for 3D Reconstruction under Uncalibrated Illumination

Numerical Reflectance Compensation for Non-Lambertian Photometric Stereo

A Coarse-to-Fine Reconstruction Framework for Non-Lambertian Photometric Stereo

A Method for 3D Reconstruction Based on Photometric Stereo Image

Photometric Stereo for General Reflectance and Lighting

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

Multi-view Reconstruction under Varying Illumination Conditions

Srevas: Shading Based Surface Refinement Under Varying Albedo And Specularity

Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset for Spatially Varying Isotropic Materials

A Novel Learning Based Non-Lambertian Photometric Stereo Method for Pixel-Level Normal Reconstruction of Polished Surfaces

Recovering Surface Details under General Unknown Illumination Using Shading and Coarse Multi-view Stereo

Accurate 3D reconstruction via surface-consistency

Non-Lambertian Photometric Stereo Network Based on Inverse Reflectance Model with Collocated Light.

Photometric Stereo for General Isotropic Reflectances by Spherical Linear Interpolation

Non-Lambertian Photometric Stereo Vision Based On Inverse Reflectance Model