Photometric Stereo with Only Two Images: A Generative Approach

Hao Liang,Lin Qi,Shuntong Wang,Shengzhe Sun,Junyu Dong
DOI: https://doi.org/10.1109/icicsp48821.2019.8958505
2019-01-01
Abstract:Traditional photometric stereo can recover pixel-wise surface normal from at least three images captured under same viewpoint but different illumination directions. Under some special and extreme conditions, more than three images are not available. Given less than three images, the system becomes incompletely restrained and cannot be resolved in a close-form. In this paper, we propose to use a Generative Adversarial Network, named iDCGAN, to generate the third image under a novel illumination direction given only two images of the same surface. With the generated new image, photometric stereo can then be conducted to recover surface normal. We tested our proposed method on a public dataset, and the experiment results exhibit its effectiveness. Deep learning can be used to solve the restrained problem in traditional three-dimensional reconstruction fields.
What problem does this paper attempt to address?