Abstract:In this paper, we propose a novel Sequence-to-Sequence model based on metric-based meta learning for the arbitrary style transfer of online Chinese handwritings. Unlike most existing methods that treat Chinese handwritings as images and are unable to reflect the human writing process, the proposed model directly handles sequential online Chinese handwritings. Generally, our model consists of three sub-models: a content encoder, a style encoder and a decoder, which are all Recurrent Neural Networks. In order to adaptively obtain the style information, we introduce an attention-based adaptive style block which has been experimentally proven to bring considerable improvement to our model. In addition, to disentangle the latent style information from characters written by any writers effectively, we adopt metric-based meta learning and pre-train the style encoder using a carefully-designed discriminative loss function. Then, our entire model is trained in an end-to-end manner and the decoder adaptively receives the style information from the style encoder and the content information from the content encoder to synthesize the target output. Finally, by feeding the trained model with a content character and several characters written by a given user, our model can write that Chinese character in the user's handwriting style by drawing strokes one by one like humans. That is to say, as long as you write several Chinese character samples, our model can imitate your handwriting style when writing. In addition, after fine-tuning the model with a few samples, it can generate more realistic handwritings that are difficult to be distinguished from the real ones. Both qualitative and quantitative experiments demonstrate the effectiveness and superiority of our method.

Learning-Based Cursive Handwriting Synthesis

Learning-based Cursive Handwriting Synthesis

A Learning-based Approach to Cursive Handwriting Synthesis ?

Combining shape and physical modelsfor online cursive handwriting synthesis

Write Like You: Synthesizing Your Cursive Online Chinese Handwriting via Metric‐based Meta Learning

Style-preserving English Handwriting Synthesis

Generating Brush Texture for Cursive Style Calligraphy with Autoregressive and Stratified Sampling

Handwriting recognition training and synthesis

Handwritten Chinese Font Generation with Collaborative Stroke Refinement.

Realistic Synthesis of Cao Shu of Chinese Calligraphy

Style learning-based Chinese character synthesis method

CCST-GAN: Generative Adversarial Networks for Chinese Calligraphy Style Transfer

Computationally evaluating and synthesizing Chinese calligraphy.

Automatic Generation of Personalized Chinese Handwriting Characters

Model-based Persian calligraphy synthesis via learning to transfer templates to personal styles

Automatic Generation of Personal Chinese Handwriting by Capturing the Characteristics of Personal Handwriting.

Spatio-Temporal Handwriting Imitation

Generating Handwritten Chinese Characters Using CycleGAN

SLOGAN: Handwriting Style Synthesis for Arbitrary-Length and Out-of-Vocabulary Text

Automatic generation of large-scale handwriting fonts via style learning.

Automatic Stroke Generation for Style-Oriented Robotic Chinese Calligraphy