A new artistic information extraction method with multi channels and guided filters for calligraphy works

ZhengXia,MiaoQiguang,ShiZhenghao,FanYachun,ShuiWuyang

IF: 2.577

2016-01-01

Multimedia Tools and Applications

Abstract:The artistic beauty of Chinese calligraphy is constituted by two elements: form and spirit . To learn and study calligraphy works, both of form and spirit should be extracted correctly. However, mo...

What problem does this paper attempt to address?

A New Artistic Information Extraction Method with Multi Channels and Guided Filters for Calligraphy Works

Xia Zheng,Qiguang Miao,Zhenghao Shi,Yachun Fan,Wuyang Shui

DOI: https://doi.org/10.1007/s11042-015-2788-x

IF: 2.577

2015-01-01

Multimedia Tools and Applications

Abstract:The artistic beauty of Chinese calligraphy is constituted by two elements: form and spirit. To learn and study calligraphy works, both of form and spirit should be extracted correctly. However, most currently used calligraphy image extraction methods can only obtain form information. To address this problem, an extraction method, based on multi-channel and guided filters, is proposed in this study. The proposed method consists of three major operations: color space transformation, tablet and writing discrimination, and information extraction using guided filter. To simulate the human visual perception of calligraphy work, the color space of a calligraphy image is converted from RGB to CIELAB firstly. Then the calligraphy image is distinguished as either a tablet or a writing based on channel b. Finally, information extraction using guided filter is performed. For a tablet, a two-stage guided filtering strategy based on L channel is employed to reduce noise and obtain form information. For a writing, a guided filter based on channels L and a is used to extract both form and spirit information. To demonstrate the accuracy and efficiency of the proposed method, comparison experiments are implemented on both types of images. Experimental results reveal the advantages of the proposed method.
Chinese Calligraphic Style Representation for Recognition

Gao Pengcheng,Gu Gang,Wu Jiangqin,Wei Baogang

DOI: https://doi.org/10.1007/s10032-016-0277-z

2017-01-01

International Journal on Document Analysis and Recognition (IJDAR)

Abstract:Chinese calligraphy draws a lot of attention for its beauty and elegance. The various styles of calligraphic characters make calligraphy even more charming. But it is not always easy to recognize the calligraphic style correctly, especially for beginners. In this paper, an automatic character styles representation for recognition method is proposed. Three kinds of features are extracted to represent the calligraphic characters. Two of them are typical hand-designed features: the global feature, GIST and the local feature, scale invariant feature transform. The left one is deep feature which is extracted by a deep convolutional neural network (CNN). The state-of-the-art classifier modified quadratic discriminant function was employed to perform recognition. We evaluated our method on two calligraphic character datasets, the unconstraint real-world calligraphic character dataset (CCD) and SCL (the standard calligraphic character library). And we also compare MQDF with other two classifiers, support vector machine and neural network, to perform recognition. In our experiments, all three kinds of feature are evaluated with all three classifiers, respectively, finding that deep feature is the best feature for calligraphic style recognition. We also fine-tune the deep CNN (alex-net) in Krizhevsky et al. (Advances in Neural Information Processing Systems, pp. 1097–1105, 2012) to perform calligraphic style recognition. It turns out our method achieves about equal accuracy comparing with the fine-tuned alex-net but with much less training time. Furthermore, the algorithm style discrimination evaluation is developed to evaluate the discriminative style quantitatively.
Artistic Information Extraction from Chinese Calligraphy Works Via Shear-Guided Filter

Pengfei Xu,Xia Zheng,Xiaojun Chang,Qiguang Miao,Zhanyong Tang,Xiaojiang Chen,Dingyi Fang

DOI: https://doi.org/10.1016/j.jvcir.2016.07.012

IF: 2.887

2016-01-01

Journal of Visual Communication and Image Representation

Abstract:Chinese calligraphy is a unique visual art, and is still emitting fascinating artistic brilliance and charm. The artistic beauty of Chinese calligraphy is constituted by two elements, i.e., form and spirit, which attract continual attentions by calligraphy artists. In this paper, we present Shear-Guided filter to extract the artistic information. Shear-Guided filter is designed by combining the shear transformation and the guided filter. It has both the edge-preserving smoothing property from the guided filter and the linear multidirectional property from the shear transformation. Shear-Guided filter can extract more spirit information from the calligraphy images, especially in the half-dry strokes. Furthermore, the previous evaluation parameters consider all pixels equally, which is against the truth. Here we put forward three new parameters to solve this issue. Finally, experiments show that Shear-Guided filter can extract the information of form and spirit more accurately, and the new evaluation parameters have better performances in evaluation.
Artistic Features Extraction from Chinese Calligraphy Works Via Regional Guided Filter with Reference Image

Lei Wang,Xiaoqing Gong,Yongqin Zhang,Pengfei Xu,Xiaojiang Chen,Dingyi Fang,Xia Zheng,Jun Guo

DOI: https://doi.org/10.1007/s11042-017-4688-8

IF: 2.577

2017-01-01

Multimedia Tools and Applications

Abstract:Chinese calligraphy is a unique visual art, and and is one of the material basis of China’s traditional cultural heritage. However, time had caused the old calligraphy works to weathering and damages, so it is necessary to utilize advanced technologies to protect those works. One of those technologies is digital imaging, and the obtained images by digital imaging can preserve the visual information of calligraphy works better, furthermore, they can be used in further researches. While the basic works for those researches are to extract the artistic features which include two elements, i.e., form and spirit. However, most of the existing methods only extract the form and ignore the characters’ spirit, especially they are insensitive to the slight variation in complex ink strokes. To solve these problems, this paper proposes an extraction method based on regional guided flter (RGF) with reference images, which is generated by KNN matting and used as the input image for RGF. Since RGF is sensitive to the slight variation of ink, so the detailed information of the inside of strokes can be detected better. Besides, unlike the past works, which filter the whole strokes, RGF filters the inside of strokes and edges in different windows respectively, which results in that the edges are preserved accurately. Results from a deployment of several famous Chinese calligraphy works demonstrate that our method can extract more accurate and complete form and spirit with lower error rate.
Learning to Recognize the Art Style of Paintings Using Multi-cues

Bing Yang,Duanqing Xu

DOI: https://doi.org/10.1109/ICM.2011.70

2011-01-01

Abstract:Visual characteristics of paintings display high-level semantic concept: art style to the viewers. Classification of art style depends mainly on human knowledge and experience, which remains a big challenge for computer vision. In this paper, based on careful studies on art literature, we propose a simple but effective method to automatically identify the art style between the Chinese wash painting and the foreign art painting. The efficiency of our method lies on that three cues: color contrast, blank-leaving and uniformity of illumination are utilized to recognize the art style of one image. Experiments results show that, our method outperforms state-of-the-art approaches, yielding higher precision while requiring less computation time. Using the cues presented in this paper, our method can successfully identify whether one painting belongs to Chinese or foreign art style.
Self-Adaptive Computational Aesthetic Evaluation of Chinese Ink Paintings Based on Deep Learning

Zhang Jiajing,Yu Jinhui,Miao Yongwei,Peng Ren

DOI: https://doi.org/10.3724/sp.j.1089.2021.18815

2021-01-01

Journal of Computer-Aided Design & Computer Graphics

Abstract:Computational aesthetic evaluation of artworks has become an active research direction in recent years. However, current works mainly focus on oil paintings and photographs, there have been few attempts in quantitative aesthetic evaluation of Chinese ink paintings. Chinese ink painting uses ink blended with water and a variation of brushwork to depict picture, which differs significantly from photographs and oil paintings in visual features, semantic features, and aesthetic principles. Aiming at this problem, we propose a framework of self-adaptive computational aesthetic evaluation of Chinese ink paintings based on deep learning technique. Firstly, we build an aesthetic evaluation standard dataset for ink painting images. Secondly, according to aesthetic principles of Chinese ink paintings, we design a multi-view parallel deep neural network by taking global images and local patches as multi-column inputs to extract deep aesthetic features. Finally, we build a self-adaptive deep aesthetic model of Chinese ink paintings based on subject query mechanism. Experimental results show that, compared with the basic VGG16 architecture, our multi-view network that contains six paralleled subject convolution groups has higher aesthetic evaluation performance, the deep aesthetic features outperform the traditional hand-crafted features, and our proposed self-adaptive model can predict human aesthetic decision with highly significant Pearson correlation of 0.823, with mean squared error of 0.161. Moreover, interference experiments show that our network is sensitive to painting factors including composition, ink color, and texture. Our work not only offers a deeply-learned-based reference framework for quantitative aesthetic evaluation of Chinese paintings, but also reveals the relationship between human aesthetic perceptions and deeply-learned features extracted from Chinese ink paintings.
Inkthetics: A Comprehensive Computational Model for Aesthetic Evaluation of Chinese Ink Paintings.

Jiajing Zhang,Yongwei Miao,Junsong Zhang,Jinhui Yu

DOI: https://doi.org/10.1109/access.2020.3044573

IF: 3.9

2020-01-01

IEEE Access

Abstract:Assessing the aesthetic appeal of artworks has become an active research direction recently. However, previous works mainly focus on photographs and oil paintings, there have been few attempts in predicting aesthetics of Chinese ink paintings, due to their significant differences in visual features, semantic features, and aesthetic principles. Aiming at this problem, we propose a comprehensive framework, named Inkthetics, to quantify aesthetics of Chinese ink paintings based on deep learning. Firstly, an aesthetic assessment dataset is built for Chinese ink painting images. Secondly, a deep multi-view parallel convolutional neural network (DMVCNN) is designed by extracting global attribute images and multi-patches as inputs to jointly learn aesthetic features. Finally, we build a comprehensive aesthetic evaluation model by fusing the deeply-learned features with handcrafted features that rely on art expert knowledge. Experimental results show that our proposed deep network significantly outperforms existing methods on the dataset, and our proposed model can predict human aesthetic judgment with Pearson highly significant correlation of 0.843, which indicates an improvement up to 5.7% than the DMVCNN model when the handcrafted features are fused with activation from DMVCNN. Our work not only provides a deep-learning-based reference framework for computational aesthetic evaluation of Chinese paintings, but also explores to what extent can handcrafted features aid learning-based features in predicting human aesthetic perceptions.
Evaluating Brush Movements for Chinese Calligraphy: a Computer Vision Based Approach

Pengfei Xu,Lei Wang,Ziyu Guan,Xia Zheng,Xiaojiang Chen,Zhanyong Tang,Dingyi Fang,Xiaoqing Gong,Zheng Wang

DOI: https://doi.org/10.24963/ijcai.2018/146

2018-01-01

Abstract:Chinese calligraphy is a popular, highly esteemed art form in the Chinese cultural sphere and worldwide. Ink brushes are the traditional writing tool for Chinese calligraphy and the subtle nuances of brush movements have a great impact on the aesthetics of the written characters. However, mastering the brush movement is a challenging task for many calligraphy learners as it requires many years' practice and expert supervision. This paper presents a novel approach to help Chinese calligraphy learners to quantify the quality of brush movements without expert involvement. Our approach extracts the brush trajectories from a video stream; it then compares them with example templates of reputed calligraphers to produce a score for the writing quality. We achieve this by first developing a novel neural network to extract the spatial and temporal movement features from the video stream. We then employ methods developed in the computer vision and signal processing domains to track the brush movement trajectory and calculate the score. We conducted extensive experiments and user studies to evaluate our approach. Experimental results show that our approach is highly accurate in identifying brush movements, yielding an average accuracy of 90%, and the generated score is within 3% of errors when compared to the one given by human experts.
A computer-aided style stroke extraction system for "Dun Huang" frescoes

Jianming Liu,Xiqun Lu,Dongming Lu

DOI: https://doi.org/10.1109/MMMC.2006.1651335

2006-01-01

Abstract:In this paper a computer-aided style stroke extraction system is developed. In this system all the objects in a "Dun Huang" fresco is classified into the stroke objects and the non-stroke objects. The styled strokes are extracted as a whole using an effective algorithm, which utilize the relationship between points and curves combined both the spatial information and the color information. While the edges of the non-stroke objects can be extracted by the state-of-the-art edge detection technique. All the extracted style strokes and the edges are formed the digital sketch of the fresco. This research has the potential to provide a computer aided tool for art historians to do imitation work, and improve the efficiency of imitation
CalliPaint: Chinese Calligraphy Inpainting with Diffusion Model

Qisheng Liao,Zhinuo Wang,Muhammad Abdul-Mageed,Gus Xia

2023-12-04

Abstract:Chinese calligraphy can be viewed as a unique form of visual art. Recent advancements in computer vision hold significant potential for the future development of generative models in the realm of Chinese calligraphy. Nevertheless, methods of Chinese calligraphy inpainting, which can be effectively used in the art and education fields, remain relatively unexplored. In this paper, we introduce a new model that harnesses recent advancements in both Chinese calligraphy generation and image inpainting. We demonstrate that our proposed model CalliPaint can produce convincing Chinese calligraphy.

Computer Vision and Pattern Recognition
Chinese Brush Calligraphy Character Retrieval and Learning

Yueting Zhuang,Xiafen Zhang,Weiming Lu,Fei Wu

DOI: https://doi.org/10.4018/jdet.2007040103

2007-01-01

International Journal of Distance Education Technologies

Abstract:Chinese brush calligraphy is a valuable civilization legacy and a high art of scholarship. It is still popular in Chinese banners, newspaper mastheads, university names, and celebration gifts. There are Web sites that try to help people enjoy and learn Chinese calligraphy. However, there lacks advanced services such as content-based retrieval or vivid writing process simulation for calligraphy learning. This article proposes a novel Chinese calligraphy learning approach: First, the scanned calligraphy pages were segmented into individual calligraphy characters using minimum-bounding box. Second, the individual character’s feature information was extracted and kept. Then, a corresponding database was built to serve as a map between the feature data and the original raw data. Finally, a retrieval engine was constructed and a dynamic writing process was simulated to help learners get the calligraphy character they were interested in and watch how it was generated step by step.
Research Of 3d Chinese Calligraphic Handwriting Recur System And Its Key Algorithm

Ying-Fei Wu,Yue-Ting Zhuang,Yun-He Pan,Jiang-Qin Wu,Fei Wu

DOI: https://doi.org/10.1007/978-3-540-71457-6_10

2007-01-01

Abstract:Chinese calligraphy is a precious Chinese art. It is pictographic and each calligraphist has his own writing style. Even people whose native language is Chinese will have difficulties in writing a demanded beautiful calligraphy style, not to say people who know little about Chinese calligraphy. In order to help people enjoy the art of calligraphy writing and find out the process how it was written, we implement a new approach to animate its writing process by 3D visualization method. In the paper two novel algorithms are also presented to extract the intrinsic feature which is needed to rebuild the writing process: 1) extract strokes order from an offline Chinese calligraphic handwriting; 2) estimate varied stroke's thickness. Finally, experiment result is given to demonstrate the application.
An Approach to Extract the Chinese Calligraphy's Approximate Skeleton

J Cheng,RF Tong,M Tang,JX Dong

DOI: https://doi.org/10.1109/cacwd.2004.1349287

2004-01-01

Abstract:This work proposes an efficient approach to get the Chinese calligraphy's approximate skeleton. The contour information of the character is directly used. Thus the resulting skeleton can reflect the character's style properly. The accuracy of the result can be well controlled by specifying the density of sampling points of the contour.
Multi-Step Segmentation Method Based on Adaptive Thresholds for Chinese Calligraphy Characters.

Xiaodan Jiang,Zhe-Ming Lu,Hong Ye,Jianwen Fang

2018-01-01

Abstract:According to the writing characteristics of Chinese calligraphy, this paper proposes a multi-step segmentation method, which is the combination of column segmentation and character segmentation. The method of column segmentation based on adaptive gap thresholds gets each column on the Image. Character segmentation is divided into two steps. Firstly, we perform rough segmentation based on adaptive gap thresholds. Then we use the average height and average word spacing of each column to do the radical block merging based on adaptive threshold. Our method can extract the characters even though they have up-down structure. Experimental results show that the proposed method solves the problem of excessive segmentation and improves the accuracy of Chinese calligraphy character segmentation effectively.In addition, the robustness is strong.
Visual verification of historical chinese calligraphy works

Xiafen Zhang,Yueting Zhuang

DOI: https://doi.org/10.1007/978-3-540-69423-6_35

2007-01-01

Abstract:The problem of historical Chinese calligraphy verification is previously investigated by experienced artists, whereas this paper proposes some objective measures to bear the problem with evidences by analyzing the subtle discrepancies between the images of the suspicious and the genuine. First, features that characterize an individual calligrapher's writing style are extracted and modeled. When a suspicious comes, it is compared with the genuine in the reference database to detect problematic characters and to calculate total accepting probability. The efficiency of the algorithm is demonstrated by a preliminary experiment with 13274 images of calligraphy character.
Web Based Chinese Calligraphy Learning with 3-D Visualization Method

Yingfei Wu,Yueting Zhuang,Yunhe Pan,Jiangqin Wu

DOI: https://doi.org/10.1109/icme.2006.262642

2006-01-01

Abstract:Chinese calligraphy is pictographic and each calligraphist has his own writing style. People often feel difficult in writing a demanded beautiful calligraphy style. In order to help people enjoy the art of calligraphy and learn how it is written step-by-step we present a new approach to animate its writing process by 3-D visualization method. In this paper some novel algorithms used in the approach are presented to solve the following problems: 1) estimate varied stroke's thickness 2) extract strokes order from an offline Chinese calligraphic writing. Through this approach we implement a system. Experimental result is given to demonstrate the application finally
Painting and calligraphy identification method based on hyperspectral imaging and convolution neural network

Xingjia Tang,Penchang Zhang,Jian Du,Zongben Xu

DOI: https://doi.org/10.1080/00387010.2021.1982988

2021-10-21

Spectroscopy Letters

Abstract:It is of great social value and cultural and technological innovation demonstration value to carry out the research on the scientific identification method of painting and calligraphy works of art, and it is of great effect to the trade, collection, and protection of painting and calligraphy works of art. Spectral imaging, as an information acquisition method of attribute and visual synchronous perception, can be used for painting and calligraphy identification. In particular, through hyperspectral imaging and data analyses, we can identify the pigment ink used in painting, judge the printing characteristics, and find the painting information invisible to human eyes, to comprehensively judge the authenticity and abnormality of painting. However, due to its lack of matching painting and calligraphy identification model and algorithm, as well as special painting and calligraphy atlas database support, it is difficult to be competent for rapid and accurate identification in practice. Because of the above problems, in this paper, it is simulated the expert identification process for artificial intelligence analysis and modeling, adopts the idea of combining hyperspectral imaging and Atlas intelligent learning, proposes a method of atlas feature extraction for calligraphy and painting identification, and designs and studies convolution neural network(CNN) based on atlas feature, traditional image feature, and the mixed feature of atlas and image, to judge the authenticity of calligraphy and painting, the author and so on. The actual test results show that the convolution neural network based on the atlas features is the best, the author classification accuracy and authenticity identification rate in the test sample set are more than 96.5%, and it can also be seen that in the pseudo color image data, adding multivariate spectral features can greatly improve the accuracy significantly.

spectroscopy
Web-based chinese calligraphy retrieval and learning system

Yueting Zhuang,Xiafen Zhang,Weiming Lu,Fei Wu

DOI: https://doi.org/10.1007/11528043_18

2005-01-01

Abstract:Chinese calligraphy is a valuable civilization legacy and there are some web sites trying to help people enjoy and learn calligraphy. However, besides metadata-base searching, it is very difficult to find advanced services such as content-based retrieval or vivid writing process simulating for Chinese calligraphy. In this paper, a novel Chinese calligraphy retrieval and learning system is proposed: First, the scanned calligraphy pages were segmented into individual calligraphy characters using minimum-bounding box. Second, individual character's feature information was extracted and kept. Then, corresponding database was built to serve as a map between the feature data and the original data of individual character image. Finally, a retrieval engine was constructed and dynamic writing process was simulated to help learners get the calligraphy character they are interested in and watch how it was written.
CalliffusionV2: Personalized Natural Calligraphy Generation with Flexible Multi-modal Control

Qisheng Liao,Liang Li,Yulang Fei,Gus Xia

2024-10-04

Abstract:In this paper, we introduce CalliffusionV2, a novel system designed to produce natural Chinese calligraphy with flexible multi-modal control. Unlike previous approaches that rely solely on image or text inputs and lack fine-grained control, our system leverages both images to guide generations at fine-grained levels and natural language texts to describe the features of generations. CalliffusionV2 excels at creating a broad range of characters and can quickly learn new styles through a few-shot learning approach. It is also capable of generating non-Chinese characters without prior training. Comprehensive tests confirm that our system produces calligraphy that is both stylistically accurate and recognizable by neural network classifiers and human evaluators.

Computation and Language,Artificial Intelligence,Computer Vision and Pattern Recognition,Multimedia
Calligraphy Stroke Extraction in CADAL.

Kai Yu,Zhen-ming Yuan,Jiangqin Wu

DOI: https://doi.org/10.1007/978-3-642-34752-8_57

2012-01-01

Abstract:Stroke is the basic unit of Chinese characters. Stroke extraction is the key procedure for calligraphy reconstruction in modern digital libraries, which faces the difficulties caused by deformation and tedious manual work. A novel stroke extraction approach for Chinese calligraphy character is proposed in this paper. Firstly, the corner points on the contours are detected with fast-CPDA, and a half-edge coloring graph is presented to help connecting the contour segments on the same side of a stroke. Then the connected contour segments on opposite sides are matched to form the whole strokes. Finally, the results are refined by rule-based verification. Experiments show that the proposed method can extract basic strokes for simple calligraphy characters automatically and help stroke extraction for complicated calligraphy characters with little manual work. © 2012 Springer-Verlag.

A new artistic information extraction method with multi channels and guided filters for calligraphy works

A New Artistic Information Extraction Method with Multi Channels and Guided Filters for Calligraphy Works

Chinese Calligraphic Style Representation for Recognition

Artistic Information Extraction from Chinese Calligraphy Works Via Shear-Guided Filter

Artistic Features Extraction from Chinese Calligraphy Works Via Regional Guided Filter with Reference Image

Learning to Recognize the Art Style of Paintings Using Multi-cues

Self-Adaptive Computational Aesthetic Evaluation of Chinese Ink Paintings Based on Deep Learning

Inkthetics: A Comprehensive Computational Model for Aesthetic Evaluation of Chinese Ink Paintings.

Evaluating Brush Movements for Chinese Calligraphy: a Computer Vision Based Approach

A computer-aided style stroke extraction system for "Dun Huang" frescoes

CalliPaint: Chinese Calligraphy Inpainting with Diffusion Model

Chinese Brush Calligraphy Character Retrieval and Learning

Research Of 3d Chinese Calligraphic Handwriting Recur System And Its Key Algorithm

An Approach to Extract the Chinese Calligraphy's Approximate Skeleton

Multi-Step Segmentation Method Based on Adaptive Thresholds for Chinese Calligraphy Characters.

Visual verification of historical chinese calligraphy works

Web Based Chinese Calligraphy Learning with 3-D Visualization Method

Painting and calligraphy identification method based on hyperspectral imaging and convolution neural network

Web-based chinese calligraphy retrieval and learning system

CalliffusionV2: Personalized Natural Calligraphy Generation with Flexible Multi-modal Control

Calligraphy Stroke Extraction in CADAL.