Abstract:Photometric stereo provides an important method for high-fidelity 3D reconstruction based on multiple intensity images captured under different illumination directions. In this paper, we present a complete framework, including a multilight source illumination and acquisition hardware system and a two-stage convolutional neural network (CNN) architecture, to construct interand intraframe representations for accurate normal estimation of non-Lambertian objects. We experimentally investigate numerous network design alternatives for identifying the optimal scheme to deploy interand intraframe feature extraction modules for the photometric stereo problem. Moreover, we propose utilizing the easily obtained object mask to eliminate adverse interference from invalid background regions in intraframe spatial convolutions, thus effectively improving the accuracy of normal estimation for surfaces made of dark materials or with cast shadows. Experimental results demonstrate that the proposed masked two-stage photometric stereo CNN model (MT-PS-CNN) performs favourably against state-of-the-art photometric stereo techniques in terms of both accuracy and efficiency. In addition, the proposed method is capable of predicting accurate and rich surface normal details for non-Lambertian objects of complex geometry and performs stably given inputs captured in both sparse and dense lighting distributions.

ST-CSLBP based space-time mixed background modeling algorithm

Background modeling using mixture of Gaussians and Laplacian pyramid decomposition.

Background modeling by subspace learning on spatio-temporal patches

Online background subtraction based on sufficient statistics

Dynamic Background Subtraction Using Spatial-Color Binary Patterns

Multi-Channel Adaptive Mixture Background Model for Real-time Tracking.

Dynamic background subtraction based on appearance and motion pattern

A Novel Robust Background Modeling Algorithm for Complex Natural Scenes

Complex Background Subtraction by Pursuing Dynamic Spatio-Temporal Models

Camera Pose Estimation in Dynamic Scenes with Background Tracking

Background Subtraction Through Multiple Life Span Modeling

Detecting Moving Objects from Dynamic Background Combining Subspace Learning with Mixed Norm Approach

Co-occurrence spatial-temporal model for adaptive background initialization in high-dynamic complex scenes

An Integrated Background Model for Video Surveillance Based on Primal Sketch and 3D Scene Geometry

Background subtraction in dynamic scenes with adaptive spatial fusing.

An Improved Fast Background Modeling Method

An Iterative-Weighted-average Algorithm for Background Modeling in Surveillance Video Scenarios.

A background model estimation algorithm based on analysis of local motion for video surveillance

Nonparametric Background Generation

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

Local Histogram of Figure/Ground Segmentations for Dynamic Background Subtraction.