Abstract:With the development of digital library technology, library books made of paper can be digital released and read, and Endangered Cultural Heritages can be preserved. Traditional library's contents and functions can be greatly enhanced by digital technologies. For these new library objects, the primary key problem is precisely reconstructing their 3D models. When constructing complete 3D models, multiple color, texture maps are often necessary. A commonly encountered problem uncounted during fusing of textures from multiple color images is color distortion. Each texture of a single 3D model may be obtained under possibly different lighting conditions and color response of the camera. To remove any visible seam and improve color consistency between the textures while avoiding color distortion, we propose a new efficient algorithm to relight all the texture images globally, spread residual light difference, and recolor each image by homogeneous transformation. A relative illumination model was adopted to obtain the relighting function. We chooselaß color space with minimal correlation between channels for many natural scenes, for calculating the relighting result. Looking into two overlapped imagesA andB, we can pairwise relightB intoA's luminosity condition in two steps. We first scaleB'sl channel by thelA/lB ratio of the overlapped region. We can assumeA andB are in a same color plane now. Then a homogeneous transformation, is applied toB's α and β channels which movesB intoA's hue and saturation condition. For multiple overlapped color textures, a patch based weighted, global relighting method was proposed to minimize the total color difference. The pairwise relighting method was used between each two overlapped images, and the difference in every overlapped region after, relighting was weighted and summed up to construct an energy value. We used Nelder-Mead method to find a minimal energy value and the relighting parameters for every image. After global relighting, textures become almost coherent. We simply blended the overlapped region along the texture border to remove small visual seams and get a final result. We illustrate our method by calibrating textures of a painted sculpture acquired with laser scanner. Experimental results were realistic and reliable and showed how this method can fuse multiple textures without color distortion.

Learning optimal lighting patterns for efficient SVBRDF acquisition

SVBRDF Reconstruction by Transferring Lighting Knowledge

Learning Efficient Illumination Multiplexing for Joint Capture of Reflectance and Shape

Relighting Multiple Color Textures

Fast, Realistic Lighting and Material Design Using Nonlinear Cut Approximation

Structure-Aware Lighting Design for Volume Visualization.

Fast and Uncertainty-Aware SVBRDF Recovery from Multi-View Capture using Frequency Domain Analysis

OpenSVBRDF: A Database of Measured Spatially-Varying Reflectance

Efficient reflectance capture using an autoencoder.

Single-image SVBRDF capture with a rendering-aware deep network

Computer Graphics in China: A practical approach for real-time illumination estimation of outdoor videos

A Unified Spatial-Angular Structured Light for Single-View Acquisition of Shape and Reflectance

Deep Inverse Rendering for Practical Object Appearance Scan with Uncalibrated Illumination

Special Section on CAD/Graphics 2013

A real-time global relighting algorithm

A Statistical Method for SVBRDF Approximation from Video Sequences in General Lighting Conditions

Multi-view Gradient Consistency for SVBRDF Estimation of Complex Scenes under Natural Illumination

Flexible SVBRDF Capture with a Multi‐Image Deep Network

Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images

Learning physically based material and lighting decompositions for face editing

Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image