Abstract:The surface normal estimation from photometric stereo becomes less reliable when the surface reflectance deviates from the Lambertian assumption. The non-Lambertian effect can be explicitly addressed by physics modeling to the reflectance function, at the cost of introducing highly nonlinear optimization. This paper proposes a numerical compensation scheme that attempts to minimize the angular error to address the non-Lambertian photometric stereo problem. Due to the multifaceted influence in the modeling of non-Lambertian reflectance in photometric stereo, directly minimizing the angular errors of surface normal is a highly complex problem. We introduce an alternating strategy, in which the estimated reflectance can be temporarily regarded as a known variable, to simplify the formulation of angular error. To reduce the impact of inaccurately estimated reflectance in this simplification, we propose a numerical compensation scheme whose compensation weight is formulated to reflect the reliability of estimated reflectance. Finally, the solution for the proposed numerical compensation scheme is efficiently computed by using cosine difference to approximate the angular difference. The experimental results show that our method can significantly improve the performance of the state-of-the-art methods on both synthetic data and real data with small additive costs. Moreover, our method initialized by results from the baseline method (least-square-based) achieves the state-of-the-art performance on both synthetic data and real data with significantly smaller overall computation, i.e., about eight times faster compared with the state-of-the-art methods.

A data-driven photometric stereo algorithm

Summary Study of Data-Driven Photometric Stereo Methods

Non-Lambertian photometric stereo by color and noise analysis

A Non-Lambertian Photometric Stereo under Perspective Projection

Numerical Reflectance Compensation for Non-Lambertian Photometric Stereo

Robust photometric stereo using structural light sources

Efficient Photometric Stereo Using Kernel Regression

Photometric Stereo for General BRDFs via Reflection Sparsity Modeling

DiLiGenT102: A Photometric Stereo Benchmark Dataset with Controlled Shape and Material Variation

On accurate recovery of 3D surface normal using minimum 2D images

Photometric Stereo for General Isotropic Reflectances by Spherical Linear Interpolation

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

Non-Lambertian Photometric Stereo Vision Based On Inverse Reflectance Model

An Optimal Experimental Design Approach for Light Configurations in Photometric Stereo

Photometric Stereo Applied to Diffuse Surfaces That Violate Lambert's Law.

Photometric Stereo Based on Multiple Kernel Learning

Multi-view photometric stereo of non-Lambertian surface under general illuminations

Photometric Stereo for General Reflectance and Lighting

A Method for 3D Reconstruction Based on Photometric Stereo Image

Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset for Spatially Varying Isotropic Materials

A Coarse-to-Fine Reconstruction Framework for Non-Lambertian Photometric Stereo