Abstract:Reading text in natural scene images is an active research area in the fields of computer vision and pattern recognition as text detection, text recognition and script identification are required. In this data article, a comprehensive dataset for Urdu text detection and recognition in natural scene images is presented and analysed. To develop the dataset, more than 2500 natural scene images were captured using a digital camera and a built-in mobile phone camera. Three separate datasets for isolated Urdu character images, cropped word images and end-to-end text spotting were developed. The isolated Urdu character and cropped word images dataset contain a much larger number of samples than existing Arabic natural scene text datasets. The Urdu text spotting dataset contains images with Urdu, English and Sindhi text instances. However, the focus has been given to the Urdu text instances. The ground truths for each image in the isolated character, cropped word or text spotting datasets are provided separately. The proposed datasets can be used to perform Urdu text detection and recognition or end-to-end recognition in natural scenes. These datasets can also be helpful to develop Arabic and Persian natural scene text detection and recognition systems, as Urdu is a derived language of these scripts and has many similar letters. The datasets can also be helpful to develop multi-language translation systems, which can facilitate foreign tourists to read and translate multilingual text in natural scene images. To evaluate the datasets, state-of-the-art machine learning and deep neural networks were used to build the text detection and recognition models, where the best classification accuracies are achieved. To the best of the authors' knowledge, this is the first dataset proposed for Urdu text detection, recognition or end-to-end text recognition in natural scene images. The aim of this data article is to present a benchmark work in the field of document analysis and recognition. Computer Science Computer Vision and Pattern Recognition Tables Figures Images Text Files Using a digital camera with a 20 megapixels (MP) sensor, an iPhone with a 12 MP back camera and a Samsung mobile with a 16MP back camera. Raw Analyzed Environmental factors such as illuminations, blurring and lighting conditions were considered while capturing images. The focus was given to the text within an image. The images in the dataset were obtained from the advertisement banners, sign-boards along the road side and streets, shop name boards, text written on the passing vehicles and walls. The images provided in this dataset were collected in different cities of Sindh, Pakistan. Summarized data are hosted with the article. The datasets and their related files are hosted in a Mendeley public data repository. DOI: https://data.mendeley.com/datasets/k5fz57zd9z/1 URL: http://dx.doi.org/10.17632/k5fz57zd9z.1.

Dataset and Benchmark for Urdu Natural Scenes Text Detection, Recognition and Visual Question Answering

Urdu text in natural scene images: a new dataset and preliminary text detection

Cursive-Text: A Comprehensive Dataset for End-to-End Urdu Text Recognition in Natural Scene Images

Construction of Uyghur Scene Text Image Database

UQA: Corpus for Urdu Question Answering

Leveraging machine learning for less developed languages: Progress on Urdu text detection

Quda: Natural Language Queries for Visual Data Analytics

HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Language

NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenario

The First Swahili Language Scene Text Detection and Recognition Dataset

ChitroJera: A Regionally Relevant Visual Question Answering Dataset for Bangla

VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding

A Benchmark Dataset with Larger Context for Non-Factoid Question Answering over Islamic Text

Urdu Speech and Text Based Sentiment Analyzer

LEGAL-UQA: A Low-Resource Urdu-English Dataset for Legal Question Answering

UQuAD1.0: Development of an Urdu Question Answering Training Data for Machine Reading Comprehension

VTQA2023: ACM Multimedia 2023 Visual Text Question Answering Challenge

Contextual Urdu Text Emotion Detection Corpus and Experiments using Deep Learning Approaches

UTRNet: High-Resolution Urdu Text Recognition In Printed Documents

On the General Value of Evidence, and Bilingual Scene-Text Visual Question Answering