Abstract:Many real-world applications involve the use of Optical Character Recognition (OCR) engines to transform handwritten images into transcripts on which downstream Natural Language Processing (NLP) models are applied. In this process, OCR engines may introduce errors and inputs to downstream NLP models become noisy. Despite that pre-trained models achieve state-of-the-art performance in many NLP benchmarks, we prove that they are not robust to noisy texts generated by real OCR engines. This greatly limits the application of NLP models in real-world scenarios. In order to improve model performance on noisy OCR transcripts, it is natural to train the NLP model on labelled noisy texts. However, in most cases there are only labelled clean texts. Since there is no handwritten pictures corresponding to the text, it is impossible to directly use the recognition model to obtain noisy labelled data. Human resources can be employed to copy texts and take pictures, but it is extremely expensive considering the size of data for model training. Consequently, we are interested in making NLP models intrinsically robust to OCR errors in a low resource manner. We propose a novel robust training framework which 1) employs simple but effective methods to directly simulate natural OCR noises from clean texts and 2) iteratively mines the hard examples from a large number of simulated samples for optimal performance. 3) To make our model learn noise-invariant representations, a stability loss is employed. Experiments on three real-world datasets show that the proposed framework boosts the robustness of pre-trained models by a large margin. We believe that this work can greatly promote the application of NLP models in actual scenarios, although the algorithm we use is simple and straightforward. We make our codes and three datasets publicly available\footnote{<a class="link-external link-https" href="https://github.com/tal-ai/Robust-learning-MSSHEM" rel="external noopener nofollow">this https URL</a>}.

Rts: learning robustly from time series data with noisy label

OT Cleaner: Label Correction As Optimal Transport

Rethinking Noisy Label Learning in Real-world Annotation Scenarios from the Noise-type Perspective

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Robust Noisy Label Learning via Two-Stream Sample Distillation

Addressing Long-Tail Noisy Label Learning Problems: a Two-Stage Solution with Label Refurbishment Considering Label Rarity

Robust Long-Tailed Learning under Label Noise

Learning With Noisy Labels Over Imbalanced Subpopulations

OHD: An Online Category-aware Framework for Learning with Noisy Labels under Long-Tailed Distribution

Robust Learning Against Label Noise Based on Activation Trend Tracking

Learning from Noisy Labels for Long-tailed Data via Optimal Transport

Robust Feature Learning Against Noisy Labels

Enhancing Robustness in Learning with Noisy Labels: an Asymmetric Co-Training Approach

Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotations

Learning from Time Series under Temporal Label Noise

Robust Learning for Text Classification with Multi-source Noise Simulation and Hard Example Mining

Extracting Clean and Balanced Subset for Noisy Long-tailed Classification

Scalable Penalized Regression for Noise Detection in Learning with Noisy Labels

Robust online active learning

On Better Detecting and Leveraging Noisy Samples for Learning with Severe Label Noise

A Gradient-based Approach for Online Robust Deep Neural Network Training with Noisy Labels