Abstract:This thesis investigates the effectiveness of SimCLR, a contrastive learning technique, in Greek letter recognition, focusing on the impact of various augmentation techniques. We pretrain the SimCLR backbone using the Alpub dataset (pretraining dataset) and fine-tune it on a smaller ICDAR dataset (finetuning dataset) to compare SimCLR's performance against traditional baseline models, which use cross-entropy and triplet loss functions. Additionally, we explore the role of different data augmentation strategies, essential for the SimCLR training process. Methodologically, we examine three primary approaches: (1) a baseline model using cross-entropy loss, (2) a triplet embedding model with a classification layer, and (3) a SimCLR pretrained model with a classification layer. Initially, we train the baseline, triplet, and SimCLR models using 93 augmentations on ResNet-18 and ResNet-50 networks with the ICDAR dataset. From these, the top four augmentations are selected using a statistical t-test. Pretraining of SimCLR is conducted on the Alpub dataset, followed by fine-tuning on the ICDAR dataset. The triplet loss model undergoes a similar process, being pretrained on the top four augmentations before fine-tuning on ICDAR. Our experiments show that SimCLR does not outperform the baselines in letter recognition tasks. The baseline model with cross-entropy loss demonstrates better performance than both SimCLR and the triplet loss model. This study provides a detailed evaluation of contrastive learning for letter recognition, highlighting SimCLR's limitations while emphasizing the strengths of traditional supervised learning models in this task. We believe SimCLR's cropping strategies may cause a semantic shift in the input image, reducing training effectiveness despite the large pretraining dataset. Our code is available at <a class="link-external link-https" href="https://github.com/DIVA-DIA/MT_augmentation_and_contrastive_learning/" rel="external noopener nofollow">this https URL</a>.

Detecting and recognizing characters in Greek papyri with YOLOv8, DeiT and SimCLR

You Actually Look Twice At it (YALTAi): using an object detection approach instead of region segmentation within the Kraken engine

Contrastive Learning for Character Detection in Ancient Greek Papyri

Volumetric Fast Fourier Convolution for Detecting Ink on the Carbonized Herculaneum Papyri

Image Based Character Recognition, Documentation System To Decode Inscription From Temple

General Detection-based Text Line Recognition

KaiRacters: Character-level-based Writer Retrieval for Greek Papyri

Hebrew letters Detection and Cuneiform tablets Classification by using the yolov8 computer vision model

EduceLab-Scrolls: Verifiable Recovery of Text from Herculaneum Papyri using X-ray CT

NeuroPapyri: A Deep Attention Embedding Network for Handwritten Papyri Retrieval

Reading Gokturkish text with the Yolo object detection algorithm

A Novel Approach to OCR using Image Recognition based Classification for Ancient Tamil Inscriptions in Temples

On-Device Language Identification of Text in Images using Diacritic Characters

Reading Ancient Coin Legends: Object Recognition vs. OCR

Categorizing ancient documents

Exhaustive Entity Recognition for Coptic: Challenges and Solutions

Recognition of Images of Korean Characters Using Embedded Networks

CITlab ARGUS for historical handwritten documents

Character Recognition in Byzantine Seals with Deep Neural Networks

Optical Character Recognition of 19th Century Classical Commentaries: the Current State of Affairs

Handwriting Recognition in Historical Documents with Multimodal LLM