CHWmaster: Mastering Chinese Handwriting Via Sliding-Window Recurrent Neural Networks

Shilong Li,Shusen Tang,Zhouhui Lian
DOI: https://doi.org/10.1007/s10032-024-00468-9
2024-01-01
International Journal on Document Analysis and Recognition
Abstract:Empowering machines to own the capability of writing texts as human beings has been a long-standing goal in the community. The task is challenging due to the complexity of human handwriting behaviors when writing long text lines or articles, especially for some writing systems (e.g., Chinese) that contain vast amounts of glyphs with complicated geometric appearances and structures. In this paper, we propose a novel system, CHWMaster, to mimic the behavior of an arbitrary user to write Chinese articles in the user’s personalized handwriting style. The key idea of our proposed method is to design a new model based on deep Recurrent Neural Networks with sliding windows. Both qualitative and quantitative experiments have been conducted to demonstrate that with the help of our proposed CHWMaster, for the first time, robots are able to write Chinese articles like humans, getting high-fidelity Chinese handwritten texts that are indistinguishable from real ones by simply feeding one/a few human-written text lines to fine-tune our pre-trained model.
What problem does this paper attempt to address?