On the Use of Attention Mechanism in a Seq2Seq Based Approach for Off-Line Handwritten Digit String Recognition

T. Lupinski,A. Belaïd,A. Kacem Echi,Thibault Lupinski,Abdel Belaid,Afef Kacem Echi
DOI: https://doi.org/10.1109/icdar.2019.00086
2019-09-01
Abstract:In this work, we investigate the use of the attention mechanism in deep learning for a better reading of handwritten digit strings in digitized images. The proposed recognition system built upon a CNN (Convolutional Neural Network) and two RNNs (Recurrent Neural Networks), acting as Encoder and Decoder and using the attention mechanism. We used a 1D mechanism for attention location with a “soft” alignment attention which has the peculiarity of having an easily calculable gradient and thus to integrate well with the network. Experimental results on data from ORAND-CAR A, ORAND-CAR B and CVL HDS databases compare favorably to other published methods.
What problem does this paper attempt to address?