Efficient synthesis of gradient solid textures

ZhangGuo-Xin,LaiYu-Kun,HuShi-Min

2013-01-01

Abstract:Solid textures require large storage and are computationally expensive to synthesize. In this paper, we propose a novel solid representation called gradient solids to compactly represent solid text...

What problem does this paper attempt to address?

Efficient Solid Texture Synthesis Using Gradient Solids

Guo-Xin Zhang,Yu-Kun Lai,Shi-Min Hu

DOI: https://doi.org/10.1007/978-3-642-34263-9_9

2012-01-01

Abstract:In this paper, we propose a novel solid representation called gradient solids to compactly represent solid textures, including a tricubic interpolation scheme of colors and gradients for smooth variation and a region-based approach for representing sharp boundaries. We further propose a novel approach to directly synthesize gradient solid textures from exemplars. Compared with existing methods, our approach avoids the expensive step of synthesizing the complete solid textures at voxel level and produces optimized solid textures using our representation. This avoids significant amount of unnecessary computation and storage with comparable quality to the state of the art.
Skeletal Texture Synthesis

Pan Gang,Zhang Jiawan,Zhou Xiaozhou,Sun Jizhou

DOI: https://doi.org/10.1109/CGIV.2009.52

2009-01-01

Abstract:In this paper, we present an improved synthesis algorithm for both 2D and solid textures. Based on the wavelet-based multi-resolution pyramids and the improved optimization of texture synthesis, a coarse texture was synthesized as a skeleton. By adding detail information to the coarse texture, the higher resolution results can be generated. This skeletal growth-like procedure makes the result more controllable. In addition, to make full use of the spatial relationships among texture pixels, wavelet coefficients rather than traditional RGB channels are used to search the nearest neighbor pixels. Experimental study shows that the method plays well for both 2D and solid texture synthesis.
Fast Texture Synthesis Using Multiple Seeds As Constraints

徐晓刚,于金辉,马利庄

DOI: https://doi.org/10.3969/j.issn.1006-8961.2002.10.002

2002-01-01

Abstract:To avoid noticeable seams between texture patches and minimize the stretch and distortion of the pattern when tiling a texture on surfaces, several texture synthesis methods have been proposed in the past few years, most of them however are time consuming and suitable only for part of textures. This paper presents a new approach for texture synthesis. The algorithm first selects multiple seeds from the sample image and puts them in the synthesized images as initial matching points, those points can be a line, a few lines or rectangle, the algorithm then searches for new matching points among the neighbors of the initial matching points along a spiral path and continues this process in a recursive manner until the synthesizing image is fully filled. Compared with the traditional approaches, the synthesizing process of our technique is dramatically speed up and reach to 360 quantitative grade, and the synthesizing speed can be accelerated further in the luminance space while retaining almost the same result as the image obtained in RGB space. In addition, our method can cope with the variation of the texture along different directions with ease. Experiments show that synthesizing results are quite satisfactory.
Sketch Guided Solid Texturing

Guo-Xin Zhang,Song-Pei Du,Yu-Kun Lai,Tianyun Ni,Shi-Min Hu

DOI: https://doi.org/10.1016/j.gmod.2010.10.006

IF: 1.094

2010-01-01

Graphical Models

Abstract:Compared to 2D textures, solid textures can represent not only the bounding surfaces, but also their interiors. Existing solid texture synthesis methods pay little attention to the generation of conforming textures that capture geometric structures or reflect the artists’ design intentions. In this paper, we propose a novel approach to synthesizing solid textures using 2D exemplars. The generated textures locally agree with a tensor field derived from user sketching curves. We use a deterministic approach and only a small portion of the voxels needs to be synthesized on demand. Correction is fundamental in deterministic texture synthesis. We propose a history windows representation, which is general enough to unifiedly represent various previous correction schemes, and a dual grid scheme based on it to significantly reduce the dependent voxels while still producing high quality results. Experiments demonstrate that our method produces significantly improved solid textures with a small amount of user interaction.
Texture synthesis based on minimum energy cut and its applications

Shuchang Xu,Xiuzi Ye,Yin Zhang,Sanyuan Zhang

DOI: https://doi.org/10.1007/11922162_60

2006-01-01

Abstract:In this paper, a simple but efficient texture synthesis algorithm is presented. New image is synthesized by a patch-based approach. Motivated by energy equation, the method can manipulate the overlap region perfectly. After the most reasonable cut path through overlap regions is found, satisfying resultant images whose size specified by user can be produced. As a general method, our algorithm is also applied to image composition and texture transfer—rendering a target image with given source texture image. Experiments show that our algorithm is very efficient and easy to implement....
High Quality Solid Texture Synthesis Using Position and Index Histogram Matching

Jiating Chen,Bin Wang

DOI: https://doi.org/10.1007/s00371-009-0408-3

2009-01-01

Abstract:The synthesis quality is one of the most important aspects in solid texture synthesis algorithms. In recent years several methods are proposed to generate high quality solid textures. However, these existing methods often suffer from the synthesis artifacts such as blurring, missing texture structures, introducing aberrant voxel colors, and so on. In this paper, we introduce a novel algorithm for synthesizing high quality solid textures from 2D exemplars. We first analyze the relevant factors for further improvements of the synthesis quality, and then adopt an optimization framework with the k-coherence search and the discrete solver for solid texture synthesis. The texture optimization approach is integrated with two new kinds of histogram matching methods, position and index histogram matching, which effectively cause the global statistics of the synthesized solid textures to match those of the exemplars. Experimental results show that our algorithm outperforms or at least is comparable to the previous solid texture synthesis algorithms in terms of the synthesis quality.
Dichromatic Based Rendering of Texture Images with High Color Fidelity

HL Shen,JH Xin

DOI: https://doi.org/10.2352/j.imagingsci.technol.2004.48.3.art00009

2004-01-01

Journal of Imaging Science and Technology

Abstract:In this study, an algorithm was developed for the rendering of texture images with high color fidelity. The algorithm is based on the dichromatic reflection model, which recovers the implicit geometrical information of each pixel position in the texture image by exploiting the interaction between object surface and light. Using the recovered implicit geometrical information and a target color, a new texture image can then be synthesized. The synthesized image was then further modified to give correct texture strength. The algorithm developed in this study can be used for both color and gray texture images. It is suitable for the applications in texture simulation and visualization with the advantage of high color fidelity.
Texture Synthesis with User-Guided Variance

汤颖,孙汉秋,张宏鑫,林海,鲍虎军

DOI: https://doi.org/10.3321/j.issn:1003-9775.2004.10.016

2004-01-01

Abstract:In this paper, we present a novel texture synthesis method based on user-control. This method is applicable to both arbitrary planar regions and 3D triangular mesh of any topology with convenient control of smooth changes in directions and scales shown in texture synthesis. With regard to an arbitrary planar region, we decompose it into relatively uniform triangular mesh to produce triangles as the unit for texture synthesis. Interpolation of user-provided vectors provides a smooth vector field capable of being used to guide the change of directions and scales in texture synthesis. It is natural to extend this algorithm to 3D triangular mesh and output the texture coordinates for each triangle vertex. Actually, our method provides a unified framework for 2D and 3D texture synthesis. The results show that our method can produce satisfactory effects based on user inputs.
Vector Solid Textures

Lvdi Wang,Kun Zhou,Yizhou Yu,Baining Guo

DOI: https://doi.org/10.1145/1833349.1778823

IF: 6.2

2010-01-01

ACM Transactions on Graphics

Abstract:In this paper, we introduce a compact random-access vector representation for solid textures made of intermixed regions with relatively smooth internal color variations. It is feature-preserving and resolution-independent. In this representation, a texture volume is divided into multiple regions. Region boundaries are implicitly defined using a signed distance function. Color variations within the regions are represented using compactly supported radial basis functions (RBFs). With a spatial indexing structure, such RBFs enable efficient color evaluation during real-time solid texture mapping. Effective techniques have been developed for generating such a vector representation from bitmap solid textures. Data structures and techniques have also been developed to compactly store region labels and distance values for efficient random access during boundary and color evaluation.
GPU-Based Texture Encoding and Real-Time Rendering

TANG Ying,ZHANG Hong-Xin,ZHANG Mei-Yu

DOI: https://doi.org/10.3321/j.issn:0254-4164.2007.02.014

2007-01-01

Chinese Journal of Computers

Abstract:In photorealistic rendering, multiple high-resolution texture images are needed to add details to the scene, which makes the limited texture memory exhausted soon. This paper proposes a novel encoding algorithm for texture image — incremental texture encoding algorithm, for which the compressed textures are decompressed and rendered in real-time by programmable graphics hardware. This method gradually fills in the codebook by dynamically adding in the elements when the current codebook can not encode the region of the image being processed. In this way, the method can not only produces high compression ratio for texture images with self-similarity, but also encode the image sequences in a stream-like manner due to the property of dynamically updating the codebook. Experimental results show that the method is effective and efficient in encoding and rendering still/animated textures.
Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models

Xianfang Zeng,Xin Chen,Zhongqi Qi,Wen Liu,Zibo Zhao,Zhibin Wang,Bin Fu,Yong Liu,Gang Yu

DOI: https://doi.org/10.1109/cvpr52733.2024.00407

2024-01-01

Computer Vision and Pattern Recognition

Abstract:This paper presents Paint3D, a novel coarse-to-fine generative framework that is capable of producing high-resolution, lighting-less, and diverse 2K UV texture maps for untextured 3D meshes conditioned on text or image inputs. The key challenge addressed is generating high-quality textures without embedded illumination information, which allows the textures to be re-lighted or re-edited within modern graphics pipelines. To achieve this, our method first leverages a pre-trained depth-aware 2D diffusion model to generate view-conditional images and perform multi-view texture fusion, producing an initial coarse texture map. However, as 2D models cannot fully represent 3D shapes and disable lighting effects, the coarse texture map exhibits incomplete areas and illumination artifacts. To resolve this, we train separate UV Inpainting and UVHD diffusion models specialized for the shape-aware refinement of incomplete areas and the removal of illumination artifacts. Through this coarse-to-fine process, Paint3D can produce high-quality 2K UV textures that maintain semantic consistency while being lighting-less, significantly advancing the state-of-the-art in texturing 3D objects.
Generation and placement technique for complex textures

Bao Hujun,F. Sheng,Peng Qunsheng

1996-01-01

Ruan Jian Xue Bao/Journal of Software

Abstract:A technique for painting directly on 3D surfaces is proposed to synthesize complex textures in this paper. Different from the conventional 2D paint system, the color painted by each stroke is applied as surface attributes to set up various textures and shading effects on 3D surfaces in real time. The approach allows users to continuously blend the texture on adjacent surface and blend multi-layer textures on the same surface. Results demonstrate that the method can be employed to create very complex textures.
Texture Evolution: 3D Texture Synthesis from Single 2D Growable Texture Pattern

Yisong Chen,Horace H.S. Ip

DOI: https://doi.org/10.1007/s00371-004-0262-2

2004-01-01

Abstract:An efficient model-independent 3D texture synthesis algorithm based on texture growing and texture turbulence is presented to create vivid 3D solid texture from a single 2D growable texture pattern. Given a 2D texture pattern of some growable material, our technique is able to create an anisotropic 3D volumetric texture cube to simulate the evolution of the material in 3D. An effective tiling scheme is designed to save computation and storage costs. Target objects are directly dipped into the synthesized 3D texture volume to generate creative, sculpture-like models that can be visualized with interactive speed. Our method is conceptually intuitive, computationally fast, and storage efficient compared with other solid texturing methods. As opposed to conventional 2D texture mapping work on polygonal surfaces, our approach is capable of decorating 3D point-rendering systems seamlessly. Furthermore, our combination of texture turbulence and texture growing techniques provides an attractive way to synthesize and tile natural 2D texture patterns, or generate simple but interesting motion textures.
Inverse Texture Synthesis

Li-Yi Wei,Jianwei Han,Kun Zhou,Hujun Bao,Baining Guo,Heung-Yeung Shum

DOI: https://doi.org/10.1145/1360612.1360651

2008-01-01

Abstract:The quality and speed of most texture synthesis algorithms depend on a 2D input sample that is small and contains enough texture variations. However, little research exists on how to acquire such sample. For homogeneous patterns this can be achieved via manual cropping, but no adequate solution exists for inhomogeneous or globally varying textures, i.e. patterns that are local but not stationary, such as rusting over an iron statue with appearance conditioned on varying moisture levels. We present inverse texture synthesis to address this issue. Our inverse synthesis runs in the opposite direction with respect to traditional forward synthesis: given a large globally varying texture, our algorithm automatically produces a small texture compaction that best summarizes the original. This small compaction can be used to reconstruct the original texture or to re-synthesize new textures under user-supplied controls. More important, our technique allows real-time synthesis of globally varying textures on a GPU, where the texture memory is usually too small for large textures. We propose an optimization framework for inverse texture synthesis, ensuring that each input region is properly encoded in the output compaction. Our optimization process also automatically computes orientation fields for anisotropic textures containing both low- and high-frequency regions, a situation difficult to handle via existing techniques.
A Texture Synthesis Method Based on Adaptive Patches

周刚,彭群生

DOI: https://doi.org/10.3969/j.issn.1007-130x.2004.07.016

2004-01-01

Abstract:Texture synthesis is one of the hottest research topics in computer graphics, computer vision and image processing fields. We present a novel adaptive patch-based algorithm on the basis of the MRF model and other related algorithms. We make up patches with different sizes in a globally optimized way, and give the pixels of a image the vision-related weights. The new algorithm not only gets better results than other algorithms when the synthesis speed is guaranteed, but also unifies patch-based and pixel-based texture synthesis methods together.
Fast Example-Based Surface Texture Synthesis Via Discrete Optimization.

Jianwei Han,Kun Zhou,Li-Yi Wei,Minmin Gong,Hujun Bao,Xinming Zhang,Baining Guo

DOI: https://doi.org/10.1007/s00371-006-0078-3

2006-01-01

Abstract:We synthesize and animate general texture patterns over arbitrary 3D mesh surfaces. The animation is controlled by flow fields over the target mesh, and the texture can be arbitrary user input as long it satisfies the Markov-Random-Field assumptions. We achieve this by extending the texture optimization framework over 3D mesh surfaces. We propose an efficient discrete solver inspired by k-coherence search, allowing interactive flow texture animation while avoiding the blurry blending problem for the least square solver in previous work. Our technique has potential applications ranging from simulation, visualization, and special effects.
STS-GAN: Can We Synthesize Solid Texture with High Fidelity from Arbitrary 2D Exemplar?

Xin Zhao,Jifeng Guo,Lin Wang,Fanqi Li,Jiahao Li,Junteng Zheng,Bo Yang

DOI: https://doi.org/10.24963/ijcai.2023/196

2023-08-16

Abstract:Solid texture synthesis (STS), an effective way to extend a 2D exemplar to a 3D solid volume, exhibits advantages in computational photography. However, existing methods generally fail to accurately learn arbitrary textures, which may result in the failure to synthesize solid textures with high fidelity. In this paper, we propose a novel generative adversarial nets-based framework (STS-GAN) to extend the given 2D exemplar to arbitrary 3D solid textures. In STS-GAN, multi-scale 2D texture discriminators evaluate the similarity between the given 2D exemplar and slices from the generated 3D texture, promoting the 3D texture generator synthesizing realistic solid textures. Finally, experiments demonstrate that the proposed method can generate high-fidelity solid textures with similar visual characteristics to the 2D exemplar.

Computer Vision and Pattern Recognition,Machine Learning,Image and Video Processing
Synthesizing variational direction and scale texture on planar region

Yan-Wen Guo,Xiao-Dong Xu,Xi Chen,Jin Wang,Qun-Sheng Peng

DOI: https://doi.org/10.1007/11922162_19

2006-01-01

Abstract:Traditional 2D texture synthesis methods mainly focus on seamlessly generating a big size texture, with coherent texture direction and homogeneous texture scale, from an input sample. This paper presents a method of synthesizing texture with variational direction and scale on arbitrary planar region. The user first decomposes the interest region into a set of triangles, on which a vector field is subsequently specified for controlling the direction and scale of the synthesized texture. The variational texture direction and scale are achieved by mapping a suitable texture patch found in the sample via matching a check-mask, which is rotated and zoomed according to the vector field in advance. To account for the texture discontinuity induced by not well matching or different texture directions/scales between adjacent triangles, a feature based boundary optimization technique is further developed. Experimental results show the satisfactory synthesis results.
Appearance and geometry completion with constrained texture synthesis

Chunxia Xiao,Wenting Zheng,Yongwei Miao,Yong Zhao,Qunsheng Peng

DOI: https://doi.org/10.1007/11784203_3

2006-01-01

Abstract:A novel approach for appearance and geometry completion over point-sampled geometry is presented in this paper. Based on the result of surface clustering and the given texture sample, we define a global texture energy function on the point set surface for direct texture synthesis. The color texture completion is performed by minimizing a constrained global energy using the existing texture on the surface as the input texture sample. We convert the issue of context-based geometry completion into a task of texture completion on the surface. The geometric detail is then peeled and converted into a piece of signed gray-scale texture on the base surface of the point set surface. We fill the holes on the base surface by smoothed extrapolation and the geometric details over these patches are reconstructed by a process of gray-scale texture completion. Experiments show that our method is flexible, efficient and easy to implement. It provides a practical texture synthesis and geometry completion tool for 3D point set surfaces.
Synthesis of Progressively-Variant Textures on Arbitrary Surfaces

JD Zhang,K Zhou,L Velho,BN Guo,HY Shum

DOI: https://doi.org/10.1145/1201775.882266

IF: 6.2

2003-01-01

ACM Transactions on Graphics

Abstract:We present an approach for decorating surfaces with progressively-variant textures . Unlike a homogeneous texture, a progressively-variant texture can model local texture variations, including the scale, orientation, color, and shape variations of texture elements. We describe techniques for modeling progressively-variant textures in 2D as well as for synthesizing them over surfaces. For 2D texture modeling, our feature-based warping technique allows the user to control the shape variations of texture elements, making it possible to capture complex texture variations such as those seen in animal coat patterns. In addition, our feature-based blending technique can create a smooth transition between two given homogeneous textures, with progressive changes of both shapes and colors of texture elements. For synthesizing textures over surfaces, the biggest challenge is that the synthesized texture elements tend to break apart as they progressively vary. To address this issue, we propose an algorithm based on texton masks, which mark most prominent texture elements in the 2D texture sample. By leveraging the power of texton masks, our algorithm can maintain the integrity of the synthesized texture elements on the target surface.

Efficient synthesis of gradient solid textures

Efficient Solid Texture Synthesis Using Gradient Solids

Skeletal Texture Synthesis

Fast Texture Synthesis Using Multiple Seeds As Constraints

Sketch Guided Solid Texturing

Texture synthesis based on minimum energy cut and its applications

High Quality Solid Texture Synthesis Using Position and Index Histogram Matching

Dichromatic Based Rendering of Texture Images with High Color Fidelity

Texture Synthesis with User-Guided Variance

Vector Solid Textures

GPU-Based Texture Encoding and Real-Time Rendering

Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models

Generation and placement technique for complex textures

Texture Evolution: 3D Texture Synthesis from Single 2D Growable Texture Pattern

Inverse Texture Synthesis

A Texture Synthesis Method Based on Adaptive Patches

Fast Example-Based Surface Texture Synthesis Via Discrete Optimization.

STS-GAN: Can We Synthesize Solid Texture with High Fidelity from Arbitrary 2D Exemplar?

Synthesizing variational direction and scale texture on planar region

Appearance and geometry completion with constrained texture synthesis

Synthesis of Progressively-Variant Textures on Arbitrary Surfaces