Abstract:Ancient manuscripts are a rich source of history and civilization. Unfortunately, these documents are often affected by different age and storage related degradation which impinge on their readability and information contents. In this paper, we propose a document restoration method that removes the unwanted interfering degradation patterns from color ancient manuscripts. We exploit different color spaces to highlight the spectral differences in various layers of information usually present in these documents. At each image pixel, the spectral representations of all color spaces are stacked to form a feature vector. PCA is applied to the whole data cube to eliminate correlation of the color planes and enhance separation among the patterns. The reduced data cube, along with the pixel spatial information, is used to perform a pixel based segmentation, where each cluster represents a class of pixels that share similar color properties in the decorrelated color spaces. The interfering, unwanted classes can thus be removed by inpainting their pixels with the background texture. Assuming Gaussian distributions for the various classes, a Gaussian Mixture Model (GMM) is estimated through the Expectation Maximization (EM) algorithm from the data, and then used to find appropriate labels for each pixel. In order to preserve the original appearance of the document and reproduce the background texture, the detected degraded pixels are replaced based on Gaussian conditional simulation, according to the surrounding context. Experiments are shown on manuscripts affected by different kinds of degradations, including manuscripts from the DIBCO 2018 and 2019 publicaly available dataset. We observe that the use of a few PCA dominant components accelerates the clustering process and provides a more accurate segmentation.

Hermite and Gabor transforms for noise reduction and handwriting classification in ancient manuscripts

Innovative Methods for Non-Destructive Inspection of Handwritten Documents

Automatic segmentation and reconstruction of historical manuscripts in gradient domain

Handwritten Text Recognition for Documentary Medieval Manuscripts

Text Extraction and Restoration of Old Handwritten Documents

Interactive Enhancement of Handwritten Text through Multi-resolution Gaussian

Handwritten text recognition and information extraction from ancient manuscripts using deep convolutional and recurrent neural network

SURFACE HANDWRITING ENHANCEMENT OF ARTIFACTS BASED ON MANIFOLD LEARNING AND MIXED PIXEL DECOMPOSITION

A spatially adaptive statistical method for the binarization of historical manuscripts and degraded document images

Learning Features for Writer Identification from Handwriting on Papyri

Impact of Ground Truth Quality on Handwriting Recognition

Text-independent writer identification and verification using textural and allographic features

Modified Segmentation Algorithm for Recognition of Older Geez Scripts Written on Vellum

Image-based material analysis of ancient historical documents

The Learnable Typewriter: A Generative Approach to Text Analysis

Weighted-Gradient Features For Handwritten Line Segmentation

Mathematical Data Models and Context-Based Features for Enhancing Historical Degraded Manuscripts Using Neural Network Classification

Categorizing ancient documents

Uncovering the Handwritten Text in the Margins: End-to-end Handwritten Text Detection and Recognition

Handwriting Identification of Short Historical Manuscripts

Restoration and content analysis of ancient manuscripts via color space based segmentation