Abstract:Accurately estimating spectral reflectance functions from color camera images is a hot research subject that demonstrates tremendous potential for illuminating engineering and computer vision applications. However, the impact of the illumination spectrum and camera responsivity (system functions) on estimation accuracy has not been systematically studied so far, nor has the impact of a "training" spectral reflectance set. In this study, a dual imaging reflectance optimization system is used based on a neural network and optimal system functions that are respectively trained and optimized using several sample sets. Simulations showed that such optimal systems, trained and optimized with the IES TM-30 spectral reflectance set, can have a substantially higher estimation accuracy compared to "real" systems composed of commercially available projector spectra and camera responsivities and that they are sufficiently robust under small changes in system function peak wavelength and spectral width due to changes in working temperature or with passing time. An analysis of the impact of the specific sample set database adopted for neural net training on estimation accuracy showed that training with the IES set results in good and stable performance, even for other sample sets and different illumination spectra. Training with the spectrally uniform IES spectral reflectance set is therefore advised for general-purpose, high-accuracy reflectance estimation systems. A comparison with a state-of-the-art method shows that the proposed method has a higher color prediction accuracy and a significantly shorter running time for realistic images with high resolution.

Robust estimation of spectral reflectance by a projector-camera system

CCD-based system for two-dimensional measurement of color uniformity of LCD projector

Estimation of Spectral Reflectance Using Color Scanner

Robust spectral regression for face recognition

Estimating Reflectance from Multispectral Camera Responses Based on Partial Least-Squares Regression

Real-time Continuous Geometric Calibration for Projector-Camera System under Ambient Illumination

A Novel Radiometric Projector Compensation Algorithm Based on Lambertian Reflection Model

Estimation of Spectral Reflectance of Object Surfaces with the Consideration of Perceptual Color Space

Perceptual radiometric compensation for inter-reflection in immersive projection environment.

Robustness of Projection Algorithm for Under-Exposured Images

Spectral Reflectance Estimation Using Projector with Unknown Spectral Power Distribution

Pro-Cam SSfM: Projector-Camera System for Structure and Spectral Reflectance from Motion

Improved Reflectance Reconstruction for Multispectral Imaging by Combining Different Techniques.

Robust photometric stereo using structural light sources

Spectral Reconstruction Using an Iteratively Reweighted Regulated Model from Two Illumination Camera Responses

Improved and Robust Spectral Reflectance Estimation

A Real-Time Interactive System of Surface Reconstruction and Dynamic Projection Mapping with RGB-depth Sensor and Projector.

A Novel Approach for Generating Object Spectral Reflectance Functions from Digital Cameras.

Testing Methods to Estimate Spectral Reflectance Using Datasets under Different Illuminants

3D shape measurement of objects with high dynamic range of surface reflectivity

Simultaneous Localization and Appearance Estimation with a Consumer RGB-D Camera.