Abstract:In real life, various degradation scenarios exist that might damage document images, making it harder to recognize and analyze them, thus binarization is a fundamental and crucial step for achieving the most optimal performance in any document analysis task. We propose DocBinFormer (Document Binarization Transformer), a novel two-level vision transformer (TL-ViT) architecture based on vision transformers for effective document image binarization. The presented architecture employs a two-level transformer encoder to effectively capture both global and local feature representation from the input images. These complimentary bi-level features are exploited for efficient document image binarization, resulting in improved results for system-generated as well as handwritten document images in a comprehensive approach. With the absence of convolutional layers, the transformer encoder uses the pixel patches and sub-patches along with their positional information to operate directly on them, while the decoder generates a clean (binarized) output image from the latent representation of the patches. Instead of using a simple vision transformer block to extract information from the image patches, the proposed architecture uses two transformer blocks for greater coverage of the extracted feature space on a global and local scale. The encoded feature representation is used by the decoder block to generate the corresponding binarized output. Extensive experiments on a variety of DIBCO and H-DIBCO benchmarks show that the proposed model outperforms state-of-the-art techniques on four metrics. The source code will be made available at <a class="link-external link-https" href="https://github.com/RisabBiswas/DocBinFormer" rel="external noopener nofollow">this https URL</a>.

Improving Document Binarization Via Adversarial Noise-Texture Augmentation

Two-stage generative adversarial networks for document image binarization with color noise and background removal

An Iterative Refinement Framework for Image Document Binarization with Bhattacharyya Similarity Measure

Texture Compensation with Multi-Scale Dilated Residual Blocks for Image Denoising.

Shallow Binary Features Enhance the Robustness of Deep Convolutional Neural Networks

CCDWT-GAN: Generative Adversarial Networks Based on Color Channel Using Discrete Wavelet Transform for Document Image Binarization

Automatic Document Image Binarization using Bayesian Optimization

Adaptive degraded document image binarization

Document Image Binarization with Fully Convolutional Neural Networks

Adaptive Binarization of Historical Document Images

Three-stage binarization of color document images based on discrete wavelet transform and generative adversarial networks

A Fair Evaluation of Various Deep Learning-Based Document Image Binarization Approaches

A Novel Binarization System for Degraded Document Images.

Document image binarization based on texture features

A Review of Document Binarization: Main Techniques, New Challenges, and Trends

Handwritten document image binarization: An adaptive K-means based approach

BiNet: Degraded-Manuscript Binarization in Diverse Document Textures and Layouts using Deep Encoder-Decoder Networks

An enhanced binarization framework for degraded historical document images

DocBinFormer: A Two-Level Transformer Network for Effective Document Image Binarization

DeepOtsu: Document enhancement and binarization using iterative deep learning

U-Net versus Pix2Pix: a comparative study on degraded document image binarization