Abstract:The surface normal estimation from photometric stereo becomes less reliable when the surface reflectance deviates from the Lambertian assumption. The non-Lambertian effect can be explicitly addressed by physics modeling to the reflectance function, at the cost of introducing highly nonlinear optimization. This paper proposes a numerical compensation scheme that attempts to minimize the angular error to address the non-Lambertian photometric stereo problem. Due to the multifaceted influence in the modeling of non-Lambertian reflectance in photometric stereo, directly minimizing the angular errors of surface normal is a highly complex problem. We introduce an alternating strategy, in which the estimated reflectance can be temporarily regarded as a known variable, to simplify the formulation of angular error. To reduce the impact of inaccurately estimated reflectance in this simplification, we propose a numerical compensation scheme whose compensation weight is formulated to reflect the reliability of estimated reflectance. Finally, the solution for the proposed numerical compensation scheme is efficiently computed by using cosine difference to approximate the angular difference. The experimental results show that our method can significantly improve the performance of the state-of-the-art methods on both synthetic data and real data with small additive costs. Moreover, our method initialized by results from the baseline method (least-square-based) achieves the state-of-the-art performance on both synthetic data and real data with significantly smaller overall computation, i.e., about eight times faster compared with the state-of-the-art methods.

Photometric Stereo for General Isotropic Reflectances by Spherical Linear Interpolation

Photometric Stereo for General BRDFs via Reflection Sparsity Modeling

A Non-Lambertian Photometric Stereo under Perspective Projection

Robust photometric stereo using structural light sources

Numerical Reflectance Compensation for Non-Lambertian Photometric Stereo

Photometric Stereo for General Reflectance and Lighting

Non-Lambertian photometric stereo by color and noise analysis

Summary Study of Data-Driven Photometric Stereo Methods

A Microfacet-Based Model for Photometric Stereo with General Isotropic Reflectance

Elevation Angle From Reflectance Monotonicity: Photometric Stereo For General Isotropic Reflectances

On accurate recovery of 3D surface normal using minimum 2D images

Multi-view photometric stereo of non-Lambertian surface under general illuminations

NeIF: Representing General Reflectance as Neural Intrinsics Fields for Uncalibrated Photometric Stereo

Efficient Photometric Stereo Using Kernel Regression

A Microfacet-Based Reflectance Model for Photometric Stereo with Highly Specular Surfaces

Uncalibrated Photometric Stereo Under Natural Illumination

Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset for Spatially Varying Isotropic Materials

Photometric stereo for strong specular highlights

Photometric Stereo Using Internet Images.

Self-calibrating Photometric Stereo by Neural Inverse Rendering

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo