Abstract:Three-dimensional (3D) model with high-quality texture is a powerful way to interact between virtual and reality 3D scene. It has significant applications in digital preservation of cultural heritage, virtual reality / augmented reality (VR/AR), medical imaging and other domains. High-quality texture reconstruction is one of the essential elements for 3D model. Due to the camera pose error and inaccurate model, current texture reconstruction methods could not eliminate the artifacts like blurring, ghosting and discontinuity. In this work, multi-view high-definition images are captured for texture mapping. Normal-weight, depth-weight and edge-weight parameter are introduced to evaluate texture color confidence, respectively. The normalized weight factors are multiplied to generate a comprehensive weight parameter. By taking a weighted average of projected texture images, discontinuity of texture can be smoothed to a large extent. For large misalignment, bidirectional similarity (BDS) function, which represent the structural similarity between two images, are utilized to improve the texture image. The energy function is composed of two terms. One is Euclidean distance between target texture image and merged texture image. The other is BDS between target texture image and original texture image. By minimizing the energy function, the texture image could generate small local displacement while retaining the original structural information. The target and merged images are optimized alternately, the target image is calculated by patch-match algorithm, and the merged image is derived from weighted average of target images. The method we proposed could produce seamless texture comparing with Markov random field (MRF) algorithm. The definition could be higher than the camera parameter optimization algorithm. The experimental results show that structural similarity (SSIM) between the reconstructed images and the ground truth is higher than traditional algorithms. When dealing with inaccurate models with less than 10,000 facets, the SSIM value could be doubled compared with current algorithms.

Iterative Projection Reconstruction for Fast and Efficient Image Upsampling

FSIS: Fast and Seamless Image Stitching of High-Resolution Dunhuang Murals

High Resolution Local Structure-Constrained Image Upsampling

Fast Image Upsampling via Adaptive Gradient Sharpening and Transformed- Texture Constraint

High-fidelity 3D Face Reconstruction with Multi-Scale Details

Detail-preserving Joint Image Upsampling

Optimizing the Quality of Fourier Single-Pixel Imaging Via Generative Adversarial Network

A Single-Image Super-Resolution Method Based on Progressive-Iterative Approximation

Robust High Quality Image Guided Depth Upsampling

Content Adaptive Constraint Based Image Upsampling.

Depth Upsampling Method Via Markov Random Fields Without Edge-Misaligned Artifacts

High-resolution Image Reconstruction Based on Independent Equations of Pixel Grey Level

Are Recent SISR Techniques Suitable for Industrial Applications at Low Magnification?

Fast Multi-Scale Joint Bilateral Texture Upsampling

Fast and Robust Image Upsampling by Local Adaptive Gradient Field Sharpening Transform

Repaint123: Fast and High-quality One Image to 3D Generation with Progressive Controllable Repainting

Robust Ultrafast Projection Pipeline for Structural and Angiography Imaging of Fourier-Domain Optical Coherence Tomography

High-quality texture reconstruction for three-dimensional multi-view imaging (Conference Presentation)

High-Quality Real-Time Rendering Using Subpixel Sampling Reconstruction

Enhanced joint trilateral up-sampling for super-resolution

Recovering Realistic Details for Magnification-Arbitrary Image Super-Resolution