Abstract:Generating Chinese characters via few-shot font generation is an intriguing and important challenge in recent years, primarily due to the intricate and unique nature of Chinese fonts. However, the conventional GAN-based model for font generation has encountered issues such as unpredictable training and inaccurate generation. Simultaneously, in the realm of image generation, diffusion models have demonstrated remarkable success, even garnering application in AI painting commercials. Some studies have endeavored to integrate diffusion models into Few-shot Font Generation (FFG). In this paper, we present a straightforward, few-shot font generation framework utilizing a conditional diffusion model. We generate conditional embedding tokens using three encoders, which extract essential character information such as content and style. By combining these conditions into the diffusion process, we can effectively model these three pieces of information. Our model possesses three key features: i) Our model attains disentanglement of all encoders and the diffusion model. The content encoder focuses solely on extracting the content or the relative position of strokes, the style-coding provides only style features, and the diffusion model is limited to generating the target image without obscuring any content or style information. This enhances the model’s interpretability and makes the addition of new functionalities a simpler process. ii) For different fonts, our model requires fewer training steps due to the use of pre-training. We only train the style-coding on a small scale, bypassing the need for extensive training of the large-scale diffusion model. iii) Our model achieves two types of "Few-shot" training. The first type involves the same style but different characters, requiring only a few characters for training. The second type pertains to different styles, needing only a few style fonts for training. Experimental results reveal that our model outperforms previous few-font generation models in terms of quality, generation speed, and the scale of well-trained training datasets.

QT-Font: High-efficiency Font Synthesis Via Quadtree-based Diffusion Models

Diff-Font: Diffusion Model for Robust One-Shot Font Generation

VQ-Font: Few-Shot Font Generation with Structure-Aware Enhancement and Quantization

Few-shot Font Generation based on SAE and Diffusion Model

Few shot font generation via transferring similarity guided global style and quantization local style

HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution

FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generation

CF-Font: Content Fusion for Few-shot Font Generation

DiffCJK: Conditional Diffusion Model for High-Quality and Wide-coverage CJK Character Generation

Chinese Character Font Generation Based on Diffusion Model

Few-Shot Font Generation by Learning Fine-Grained Local Styles

FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learning

FontTransformer: Few-shot High-resolution Chinese Glyph Image Synthesis via Stacked Transformers

Efficiency Meets Fidelity: A Novel Quantization Framework for Stable Diffusion

Attribute2Font

FET-GAN: Font and Effect Transfer via K-shot Adaptive Instance Normalization

MA-Font: Few-Shot Font Generation by Multi-Adaptation Method

Few-shot Font Generation by Learning Style Difference and Similarity

Learning Implicit Glyph Shape Representation

MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantization

Few-shot Font Generation with Localized Style Representations and Factorization