Temporal Classification Constraint for Improving Handwritten Mathematical Expression Recognition

Cuong Tuan Nguyen,Hung Tuan Nguyen,Kei Morizumi,Masaki Nakagawa
DOI: https://doi.org/10.1007/978-3-030-86159-9_8
2021-01-01
Abstract:We present a temporal classification constraint as an auxiliary learning method for improving the recognition of Handwritten Mathematical Expression (HME). Connectionist temporal classification (CTC) is used to learn the temporal alignment of the input feature sequence and corresponding symbol label sequence. The CTC alignment is trained with the encoder-decoder alignment through a combination of CTC loss and encoder-decoder loss to improve the feature learning of the encoder in the encoder-decoder model. We show the effectiveness of the approach in improving symbol classification and expression recognition on the CROHME datasets.
What problem does this paper attempt to address?