An Arabic Manuscript Regions Detection, Recognition and Its Applications for OCRing
Hassanin M. Al-Barhamtoshy,Kamal M. Jambi,Mohsen A. Rashwan,Sherif M. Abdou
DOI: https://doi.org/10.1145/3532609
2022-04-29
Abstract:The problem of region of interest (RoI) in document layout analysis and document recognition has recently become an essential topic in OCR'ing systems. Arabic manuscript layout analysis and OCRing recognition using language detection, document category, and region of interest (RoI) with Keras and TensorFlow are terms of the state-of-the-art that should be investigated. This paper investigates the problem of Arabic manuscript recognition problems with respect to in OCR'ing-based recognition. A new framework architecture, which integrates “Fast Gradient Sign Method (FGSM)” using Keras and TensorFlow with adversarial image generation during training procedure is proposed. Also, the paper tries to improve the OCRing accuracy of the image enhancement, alignment, layout analysis and recognition using deep learning in multilingual system. Region of Interests (RoIs) detections will be performed using a custom trained deep learning model using bounding box regression with Keras and TensorFlow. This topic investigates an extend of page segmentation method (PSM) to enhance OCRing parameter modes, and enhances Arabic OCRing system accuracy from reinforcement strategy. Therefore, the paper achieves a significant improvement of OCRing results due to the three parameters: language identification, document category, and RoI types (Table, Title, Paragraph, figure, and list). This model is based on “region proposal algorithm” as a basis of CNN object detectors to find the number of the RoIs. Therefore, the proposed framework performs three distinctive tasks: (1) CNN architecture for adversarial training, (2) An implementation of the FGSM with Keras and TensorFlow, and (3) An adversarial training script implementation with the CNN and the FGSM method. The experiments on Arabic manuscript dataset including Arabic text, English/Arabic documents, and Latin digits’ datasets, demonstrate the accuracy of the proposed method. Moreover, the proposed framework performs well and succeeded in defending against adversarial attacks or adversarial images. The experimental results on our collected dataset illustrate the novelty of our proposed framework over the other existing PSM methods to be extended and updated to improve the quality of the OCRing system. The results show that the influence of PSM after expanding using the RoI types, language ID, and document/manuscript category can improve the OCRing accuracy. Also, the experimental results show significant performance by the new framework model with accuracy reached to 99% compared to relative methods.
computer science, artificial intelligence