Abstract:The Markov Random Field (MRF) energy function, constructed by existing OpenMVS-based 3D texture reconstruction algorithms, considers only the image label of the adjacent triangle face for the smoothness term and ignores the planar-structure information of the model. As a result, the generated texture charts results have too many fragments, leading to a serious local miscut and color discontinuity between texture charts. This paper fully utilizes the planar structure information of the mesh model and the visual information of the 3D triangle face on the image and proposes an improved, faster, and high-quality texture chart generation method based on the texture chart generation algorithm of the OpenMVS. This methodology of the proposed approach is as follows: (1) The visual quality on different visual images of each triangle face is scored using the visual information of the triangle face on each image in the mesh model. (2) A fully automatic Variational Shape Approximation (VSA) plane segmentation algorithm is used to segment the blocked 3D mesh models. The proposed fully automatic VSA-based plane segmentation algorithm is suitable for multi-threaded parallel processing, which solves the VSA framework needed to manually set the number of planes and the low computational efficiency in a large scene model. (3) The visual quality of the triangle face on different visual images is used as the data term, and the image label of adjective triangle and result of plane segmentation are utilized as the smoothness term to construct the MRF energy function. (4) An image label is assigned to each triangle by the minimizing energy function. A texture chart is generated by clustering the topologically-adjacent triangle faces with the same image label, and the jagged boundaries of the texture chart are smoothed. Three sets of data of different types were used for quantitative and qualitative evaluation. Compared with the original OpenMVS texture chart generation method, the experiments show that the proposed approach significantly reduces the number of texture charts, significantly improves miscuts and color differences between texture charts, and highly boosts the efficiency of VSA plane segmentation algorithm and OpenMVS texture reconstruction.

Random Projections and Single BoW for Fast and Robust Texture Segmentation

Rough-fuzzy set approach for color and texture based image segmentation

Multi-Level Feature Descriptor for Robust Texture Classification via Locality-Constrained Collaborative Strategy

An Improved Random Walker with Bayes Model for Volumetric Medical Image Segmentation.

Sorted Random Projections for Robust Texture Classification

Texture Segmentation Using Kernel-based Techniques

BoW-MSN: A Novel Texture Classification Approach.

Resonance Algorithm For Real-World Image Segmentation

Texture Segmentation with Wavelet Transform and Feature Weighting

Image Decomposition and Texture Segmentation Via Sparse Representation

A Novel OpenMVS-Based Texture Reconstruction Method Based on the Fully Automatic Plane Segmentation for 3D Mesh Models

Fast unsupervised texture segmentation using Texel similarity map

A Multiphase Texture Segmentation Method Based on Local Intensity Distribution and Potts Model

Review of wavelet-based unsupervised texture segmentation, advantage of adaptive wavelets

Lazy Random Walks for Superpixel Segmentation

Generating High-Fidelity Texture in RGB-D Reconstruction Using Patches Density Regularization

A Texture Segmentation Algorithm And Its Application To Target Recognition

An Efficient Texture Image Segmentation Algorithm Based on the GMRF Model for Classification of Remotely Sensed Imagery

Global and Local Texture Randomization for Synthetic-to-Real Semantic Segmentation

Learning Statistical Texture for Semantic Segmentation

Fine-grained Background Representation for Weakly Supervised Semantic Segmentation