Abstract:Three-dimensional (3D) model with high-quality texture is a powerful way to interact between virtual and reality 3D scene. It has significant applications in digital preservation of cultural heritage, virtual reality / augmented reality (VR/AR), medical imaging and other domains. High-quality texture reconstruction is one of the essential elements for 3D model. Due to the camera pose error and inaccurate model, current texture reconstruction methods could not eliminate the artifacts like blurring, ghosting and discontinuity. In this work, multi-view high-definition images are captured for texture mapping. Normal-weight, depth-weight and edge-weight parameter are introduced to evaluate texture color confidence, respectively. The normalized weight factors are multiplied to generate a comprehensive weight parameter. By taking a weighted average of projected texture images, discontinuity of texture can be smoothed to a large extent. For large misalignment, bidirectional similarity (BDS) function, which represent the structural similarity between two images, are utilized to improve the texture image. The energy function is composed of two terms. One is Euclidean distance between target texture image and merged texture image. The other is BDS between target texture image and original texture image. By minimizing the energy function, the texture image could generate small local displacement while retaining the original structural information. The target and merged images are optimized alternately, the target image is calculated by patch-match algorithm, and the merged image is derived from weighted average of target images. The method we proposed could produce seamless texture comparing with Markov random field (MRF) algorithm. The definition could be higher than the camera parameter optimization algorithm. The experimental results show that structural similarity (SSIM) between the reconstructed images and the ground truth is higher than traditional algorithms. When dealing with inaccurate models with less than 10,000 facets, the SSIM value could be doubled compared with current algorithms.

Learning-Based Weighted Total Variation for Structure Preserving Texture Removal.

Structure-Aware Image Completion with Texture Propagation

Texture Image Denoising Algorithm Based on Structure Tensor and Total Variation

Weighted structure tensor total variation for image denoising

Weighted Nonlocal Total Variation in Image Processing.

A nonlocal weighted difference of anisotropic and isotropic total variation to regularize partition boundaries in an image

An Enhance Relative Total Variation with BF Model for Edge-preserving Image Smoothing

A Weighted Difference of Anisotropic and Isotropic Total Variation for Relaxed Mumford-Shah Color and Multiphase Image Segmentation

An Efficient Non-Convex Total Variation Approach for Image Deblurring and Denoising

Reweighted Anisotropic Total Variation Minimization for Limited-Angle CT Reconstruction

A Structure-Preserving Image Restoration Method with High-Level Ensemble Constraints

A New Algorithm for Remotely Sensed Image Texture Classification and Segmentation

An Efficient Smoothing and Thresholding Image Segmentation Framework with Weighted Anisotropic-Isotropic Total Variation

An Adaptive Texture-Preserved Image Denoising Model

High-quality texture reconstruction for three-dimensional multi-view imaging (Conference Presentation)

Total Variation Structured Total Least Squares Method for Image Restoration

Image Deblurring Via Combined Total Variation and Framelet

Weighted Tensor Low-Rankness and Learnable Analysis Sparse Representation Model for Texture Preserving Low-Dose CT Reconstruction

Removing Turbulence Effect Via Hybrid Total Variation and Deformation-Guided Kernel Regression

Thick Cloud Removal in Optical Remote Sensing Images Using a Texture Complexity Guided Self-Paced Learning Method

Denoising on Textured Image Using Total Generalized Variation With Overlapping Group Sparsity Based on Fast Split Bregman Method