Abstract:Recognizing freehand sketches with high arbitrariness is such a great challenge that the automatic recognition rate has reached a ceiling in recent years. In this paper, we explicitly explore the shape properties of sketches, which has almost been neglected before in the context of deep learning, and propose a sequential dual learning strategy that combines both shape and texture features. We devise a two-stage recurrent neural network to balance these two types of features. Our architecture also considers stroke orders of sketches to reduce the intra-class variations of input features. Extensive experiments on the TU-Berlin benchmark set show that our method achieves over 90% recognition rate for the first time on this task, outperforming both humans and state-of-the-art algorithms by over 19 and 7.5 percentage points, respectively. Especially, our approach can distinguish the sketches with similar textures but different shapes more effectively than recent deep networks. Based on the proposed method, we develop an on-line sketch retrieval and imitation application to teach children or adults to draw. The application is available as Sketch.Draw.

A Structural Method for Online Sketched Symbol Recognition.

An Efficient Primitive-Based Method to Recognize Online Sketched Symbols with Autocompletion

An on-line sketch recognition algorithm for composite shape

A recognition algorithm for online sketched symbols with continuous feedback

Recognition of On-line Sketched Electrical Diagrams

On-Line Sketch Recognition Using Direction Feature

Online Sketch Recognition Using Geometric-Based Classifiers

Research of the Structural-Learning-based Symbol Recognition Mechanism for Engineering Drawings

Online Hand-Sketched Flow Chart Recognition Based on Geometric Features

Online Diagramming Recognition Based on Automatic Stroke Parsing and Bayesian Classifier

On-line Handwritten Flowchart Recognition Based on Logical Structure and Graph Grammar

Structural Recognition of Sketched Irregular Military Marking Symbols

A Multilevel Approach For Recognizing Characters In Engineering Drawings

On-line hand-drawn electric circuit diagram recognition using 2D dynamic programming

Classified Segmentation of Online Complex Freehand Sketching

Segmentation of Online Sketching Using Geometric Feature

Online Sketch Recognition Using Contexts

Sketch Recognition With Natural Correction And Editing

Directional Zernike Moments for Rotation-Free Recognition of Online Sketched Symbols

An Online Multi-Stroke Sketch Recognition Method Integrated with Stroke Segmentation

Coupling Deep Textural and Shape Features for Sketch Recognition.