Abstract:The problem of region of interest (RoI) in document layout analysis and document recognition has recently become an essential topic in OCR'ing systems. Arabic manuscript layout analysis and OCRing recognition using language detection, document category, and region of interest (RoI) with Keras and TensorFlow are terms of the state-of-the-art that should be investigated. This paper investigates the problem of Arabic manuscript recognition problems with respect to in OCR'ing-based recognition. A new framework architecture, which integrates “Fast Gradient Sign Method (FGSM)” using Keras and TensorFlow with adversarial image generation during training procedure is proposed. Also, the paper tries to improve the OCRing accuracy of the image enhancement, alignment, layout analysis and recognition using deep learning in multilingual system. Region of Interests (RoIs) detections will be performed using a custom trained deep learning model using bounding box regression with Keras and TensorFlow. This topic investigates an extend of page segmentation method (PSM) to enhance OCRing parameter modes, and enhances Arabic OCRing system accuracy from reinforcement strategy. Therefore, the paper achieves a significant improvement of OCRing results due to the three parameters: language identification, document category, and RoI types (Table, Title, Paragraph, figure, and list). This model is based on “region proposal algorithm” as a basis of CNN object detectors to find the number of the RoIs. Therefore, the proposed framework performs three distinctive tasks: (1) CNN architecture for adversarial training, (2) An implementation of the FGSM with Keras and TensorFlow, and (3) An adversarial training script implementation with the CNN and the FGSM method. The experiments on Arabic manuscript dataset including Arabic text, English/Arabic documents, and Latin digits’ datasets, demonstrate the accuracy of the proposed method. Moreover, the proposed framework performs well and succeeded in defending against adversarial attacks or adversarial images. The experimental results on our collected dataset illustrate the novelty of our proposed framework over the other existing PSM methods to be extended and updated to improve the quality of the OCRing system. The results show that the influence of PSM after expanding using the RoI types, language ID, and document/manuscript category can improve the OCRing accuracy. Also, the experimental results show significant performance by the new framework model with accuracy reached to 99% compared to relative methods.

Improving Isolated Glyph Classification Task for Palm Leaf Manuscripts

Generate, Transform, and Clean: the Role of GANs and Transformers in Palm Leaf Manuscript Generation and Enhancement

Benchmarking of Document Image Analysis Tasks for Palm Leaf Manuscripts from Southeast Asia

Syllable Analysis Data Augmentation for Khmer Ancient Palm Leaf Recognition

A modified deep semantic binarization network for degradation removal in palm leaf manuscripts

Palmira: A Deep Deformable Network for Instance Segmentation of Dense and Uneven Layouts in Handwritten Manuscripts

Manuscripts Character Recognition Using Machine Learning and Deep Learning

Hermite and Gabor transforms for noise reduction and handwriting classification in ancient manuscripts

Palmprint Phenotype Feature Extraction and Classification Based on Deep Learning

SWP-LeafNET: A novel multistage approach for plant leaf identification based on deep CNN

A semi-self-supervised learning model to recognize handwritten characters in ancient documents in Indian scripts

Generative Adversarial Network (GAN) Based Data Augmentation for Palmprint Recognition

Analysis of Recent Deep Learning Techniques for Arabic Handwritten-Text OCR and Post-OCR Correction

AMGNet: Aligned Multilevel Gabor Convolution Network for Palmprint Recognition

Uncovering the Handwritten Text in the Margins: End-to-end Handwritten Text Detection and Recognition

An Arabic Manuscript Regions Detection, Recognition and Its Applications for OCRing

Advancements in deep learning for accurate classification of grape leaves and diagnosis of grape diseases

Cross Lingual Handwritten Character Recognition Using Long Short Term Memory Network with aid of Elephant Herding Optimization Algorithm

Impact of Ground Truth Quality on Handwriting Recognition

Mobile Contactless Palmprint Recognition: Use of Multiscale, Multimodel Embeddings

A Novel Method for the Recognition of Isolated Handwritten Arabic Characters