Advances in domain independent linear text segmentation

Freddy Y. Y. Choi

DOI: https://doi.org/10.48550/arXiv.cs/0003083

2000-03-31

Abstract:This paper describes a method for linear text segmentation which is twice as accurate and over seven times as fast as the state-of-the-art (Reynar, 1998). Inter-sentence similarity is replaced by rank in the local context. Boundary locations are discovered by divisive clustering.

Computation and Language

What problem does this paper attempt to address?

A new video text detection method.

Jie Yuan,Baogang Wei,Weiming Lu,Lidong Wang

DOI: https://doi.org/10.1145/1998076.1998142

2011-01-01

Abstract:Nowadays, digital libraries contain more and more videos in them, and how to organize and retrieve those videos effectively has become very urgent. Text in videos is a very meaningful clue for video semantic understanding, and it can be used for video organization and retrieval. However, existing text recognizing methods can not deal with multilingual texts or texts embedded in a complex background very well. In this paper, we propose a novel video text detection method. Edge detection and candidate region extraction are firstly used to obtain all rough candidate text regions, and then region refinement is used to obtain the accurate location of each region. Based on our observation that a real text region has a uniform distribution with its non-zero pixels in its binary image, an entropy filter is used to remove non-text regions. Experiments on various videos show that our method is effective and robust against different languages, background complexities and font styles.
CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Yi Li,Yanqing Guo,Jun Guo,Ming Li,Xiangwei Kong

DOI: https://doi.org/10.1109/acpr.2015.7486555

2015-01-01

Abstract:The use of top-down categorization information in bottom-up semantic segmentation can significantly improve its performance. The basic Conditional Random Field (CR-F) model can capture the local contexture information, while the locality-consistent sparse representation can obtain the category-level priors and the relationship infeature space. In this paper, we propose a novel semantic segmentation method based on an innovative CRF with locality-consistent dictionary learning. The framework aims to model the local structure in both location and feature space as well as encourage the discrimination of dictionary. Moreover, an adapted algorithm for the proposed model is described. Extensive experimental results on Graz-02, PASCAL VOC 2010 and MSRC-21 databases demonstrate that our method is comparable to or outperforms state-of-the-art Bag-of-Features (BoF) based segmentation methods.
Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Yi Li,Yanqing Guo,Jun Guo,Zhuang Ma,Xiangwei Kong,Qian Liu

DOI: https://doi.org/10.1109/tmm.2018.2867720

IF: 7.3

2019-01-01

IEEE Transactions on Multimedia

Abstract:Semantic image segmentation can be accomplished by assigning a proper object category label to each meaningful region of an image. Beyond the original bottom-up models, the use of top-down categorization information has been applied to semantic segmentation to improve performance. An excellent example of such a top-down scheme is to integrate a Conditional Random Field (CRF) model with sparse dictionary learning. However, the existing solutions merely consider the discrimination of dictionaries to obtain better sparse codes, without considering the inherent data locality characteristics. In this paper, we explore such characteristics and propose a novel semantic segmentation framework based on an innovative CRF model with locality-consistent dictionary learning. In particular, we propose two new locality-consistent dictionary learning strategies by capturing the local consistencies in the feature space and the label space. In addition, we develop a joint dictionary and a CRF model parameter learning algorithm to seamlessly integrate the proposed locality-consistent dictionary learning strategies into the CRF model. Extensive experiments are conducted with two popular data bases of different traits (i.e., Graz-02 and PASCAL-CONTEXT). The simulation results confirm the efficiency of the proposed scheme, especially when training data are limited.
A method for text line detection in natural images

Jie Yuan,Baogang Wei,Yonghuai Liu,Yin Zhang,Lidong Wang

DOI: https://doi.org/10.1007/s11042-013-1702-7

IF: 2.577

2013-01-01

Multimedia Tools and Applications

Abstract:Text information in natural images is very important to cross-media retrieval, index and understanding. However, its detection is challenging due to varying backgrounds, low contrast between text and non-text regions, perspective distortion and other disturbing factors. In this paper, we propose a novel text line detection method which can detect text line aligned with a straight line in any direction. It is mainly composed of three steps. In the first step, we use the maximal stable extremal region detector with dam line constraint to detect candidate text regions, we then define a similarity measurement between two regions which combines sizes, absolute distance, relative distance, contextual information and color histograms. In the second step, we propose a text line identification algorithm based on the defined similarity measurement. The algorithm firstly searches three regions as the seeds of a line, and then expands to obtain all regions in the line. In the last step, we develop a filter to remove non-text lines. The filter uses a sparse classifier based on two dictionaries which are learned from feature vectors extracted from morphological skeletons of those candidate text lines. A comparative study using two datasets shows the excellent performance of the proposed method for accurate text line detection with horizontal or arbitrary consistent orientation.
Using multiple discriminant analysis approach for linear text segmentation

Zhu Jingbo,Ye Na,Chang Xinzhi,Chen Wenliang,Benjamin K Tsou

DOI: https://doi.org/10.1007/11562214_26

2005-01-01

Abstract:Research on linear text segmentation has been an on-going focus in NLP for the last decade, and it has great potential for a wide range of applications such as document summarization, information retrieval and text understanding. However, for linear text segmentation, there are two critical problems involving automatic boundary detection and automatic determination of the number of segments in a document. In this paper, we propose a new domain-independent statistical model for linear text segmentation. In our model, Multiple Discriminant Analysis (MDA) criterion function is used to achieve global optimization in finding the best segmentation by means of the largest word similarity within a segment and the smallest word similarity between segments. To alleviate the high computational complexity problem introduced by the model, genetic algorithms (GAs) are used. Comparative experimental results show that our method based on MDA criterion functions has achieved higher Pk measure (Beeferman) than that of the baseline system using TextTiling algorithm.
An automatic approach for efficient text segmentation

Keke Cai,Jiajun Bu,Chun Chen,Peng Huang

DOI: https://doi.org/10.1007/11892960_51

2006-01-01

Abstract:This paper presents a domain-independent approach for partitioning text documents into a set of topic-coherent segment units, where the structure of segments reflects the patterns of sub-topics of the processed text document. The approach adopts similarity analyses, which is based on Shannon Information Theory, to determine topic distribution among text documents without incorporating thesaurus information and other auxiliary knowledge bases. It first observes the documents in terms of consistency of distribution from the viewpoint of individual word and then constructs a number of segmentation proposals accordingly. Furthermore, it employs the K-means clustering technique to get a consensus from these proposals and finally partition text into a set of topic coherent paragraphs. Through extensive experimental studies based on real and synthetic data sources, the performance analysis illustrates the effectiveness of the approach in text segmentation.
Recent Trends in Linear Text Segmentation: a Survey

Iacopo Ghinassi,Lin Wang,Chris Newell,Matthew Purver

2024-11-26

Abstract:Linear Text Segmentation is the task of automatically tagging text documents with topic shifts, i.e. the places in the text where the topics change. A well-established area of research in Natural Language Processing, drawing from well-understood concepts in linguistic and computational linguistic research, the field has recently seen a lot of interest as a result of the surge of text, video, and audio available on the web, which in turn require ways of summarising and categorizing the mole of content for which linear text segmentation is a fundamental step. In this survey, we provide an extensive overview of current advances in linear text segmentation, describing the state of the art in terms of resources and approaches for the task. Finally, we highlight the limitations of available resources and of the task itself, while indicating ways forward based on the most recent literature and under-explored research directions.

Computation and Language
Weakly-Supervised Text Instance Segmentation

Xinyan Zu,Haiyang Yu,Bin Li,Xiangyang Xue

2023-03-23

Abstract:Text segmentation is a challenging vision task with many downstream applications. Current text segmentation methods require pixel-level annotations, which are expensive in the cost of human labor and limited in application scenarios. In this paper, we take the first attempt to perform weakly-supervised text instance segmentation by bridging text recognition and text segmentation. The insight is that text recognition methods provide precise attention position of each text instance, and the attention location can feed to both a text adaptive refinement head (TAR) and a text segmentation head. Specifically, the proposed TAR generates pseudo labels by performing two-stage iterative refinement operations on the attention location to fit the accurate boundaries of the corresponding text instance. Meanwhile, the text segmentation head takes the rough attention location to predict segmentation masks which are supervised by the aforementioned pseudo labels. In addition, we design a mask-augmented contrastive learning by treating our segmentation result as an augmented version of the input text image, thus improving the visual representation and further enhancing the performance of both recognition and segmentation. The experimental results demonstrate that the proposed method significantly outperforms weakly-supervised instance segmentation methods on ICDAR13-FST (18.95$\%$ improvement) and TextSeg (17.80$\%$ improvement) benchmarks.

Computer Vision and Pattern Recognition
A Novel Iterative Algorithm to Text Segmentation for Web Born-Digital Images.

Zhigang Xu,Yuesheng Zhu,Ziqiang Sun,Zhen Liu

DOI: https://doi.org/10.1117/12.2197039

2015-01-01

Abstract:Since web born-digital images have low resolution and dense text atoms, text region over-merging and miss detection are still two open issues to be addressed. In this paper a novel iterative algorithm is proposed to locate and segment text regions. In each iteration, the candidate text regions are generated by detecting Maximally Stable Extremal Region (MSER) with diminishing thresholds, and categorized into different groups based on a new similarity graph, and the texted region groups are identified by applying several features and rules. With our proposed overlap checking method the final well-segmented text regions are selected from these groups in all iterations. Experiments have been carried out on the web born-digital image datasets used for robust reading competition in ICDAR 2011 and 2013, and the results demonstrate that our proposed scheme can significantly reduce both the number of over-merge regions and the lost rate of target atoms, and the overall performance outperforms the best compared with the methods shown in the two competitions in term of recall rate and f-score at the cost of slightly higher computational complexity.
A statistical learning algorithm for word segmentation

Jerry R. Van Aken

DOI: https://doi.org/10.48550/arXiv.1105.6162

2011-06-27

Abstract:In natural speech, the speaker does not pause between words, yet a human listener somehow perceives this continuous stream of phonemes as a series of distinct words. The detection of boundaries between spoken words is an instance of a general capability of the human neocortex to remember and to recognize recurring sequences. This paper describes a computer algorithm that is designed to solve the problem of locating word boundaries in blocks of English text from which the spaces have been removed. This problem avoids the complexities of speech processing but requires similar capabilities for detecting recurring sequences. The algorithm relies entirely on statistical relationships between letters in the input stream to infer the locations of word boundaries. A Viterbi trellis is used to simultaneously evaluate a set of hypothetical segmentations of a block of adjacent words. This technique improves accuracy but incurs a small latency between the arrival of letters in the input stream and the sending of words to the output stream. The source code for a C++ version of this algorithm is presented in an appendix.

Computation and Language
LISTER: Neighbor Decoding for Length-Insensitive Scene Text Recognition

Changxu Cheng,Peng Wang,Cheng Da,Qi Zheng,Cong Yao

2023-08-24

Abstract:The diversity in length constitutes a significant characteristic of text. Due to the long-tail distribution of text lengths, most existing methods for scene text recognition (STR) only work well on short or seen-length text, lacking the capability of recognizing longer text or performing length extrapolation. This is a crucial issue, since the lengths of the text to be recognized are usually not given in advance in real-world applications, but it has not been adequately investigated in previous works. Therefore, we propose in this paper a method called Length-Insensitive Scene TExt Recognizer (LISTER), which remedies the limitation regarding the robustness to various text lengths. Specifically, a Neighbor Decoder is proposed to obtain accurate character attention maps with the assistance of a novel neighbor matrix regardless of the text lengths. Besides, a Feature Enhancement Module is devised to model the long-range dependency with low computation cost, which is able to perform iterations with the neighbor decoder to enhance the feature map progressively. To the best of our knowledge, we are the first to achieve effective length-insensitive scene text recognition. Extensive experiments demonstrate that the proposed LISTER algorithm exhibits obvious superiority on long text recognition and the ability for length extrapolation, while comparing favourably with the previous state-of-the-art methods on standard benchmarks for STR (mainly short text).

Computer Vision and Pattern Recognition
Self-supervised Scene Text Segmentation with Object-centric Layered Representations Augmented by Text Regions

Yibo Wang,Yunhu Ye,Yuanpeng Mao,Yanwei Yu,Yuanping Song

DOI: https://doi.org/10.1145/3503161.3548315

2023-08-25

Abstract:Text segmentation tasks have a very wide range of application values, such as image editing, style transfer, watermark removal, etc.However, existing public datasets are of poor quality of pixel-level labels that have been shown to be notoriously costly to acquire, both in terms of money and time. At the same time, when pretraining is performed on synthetic datasets, the data distribution of the synthetic datasets is far from the data distribution in the real scene. These all pose a huge challenge to the current pixel-level text segmentation <a class="link-external link-http" href="http://algorithms.To" rel="external noopener nofollow">this http URL</a> alleviate the above problems, we propose a self-supervised scene text segmentation algorithm with layered decoupling of representations derived from the object-centric manner to segment images into texts and background. In our method, we propose two novel designs which include Region Query Module and Representation Consistency Constraints adapting to the unique properties of text as complements to Auto Encoder, which improves the network's sensitivity to texts.For this unique design, we treat the polygon-level masks predicted by the text localization model as extra input information, and neither utilize any pixel-level mask annotations for training stage nor pretrain on synthetic datasets.Extensive experiments show the effectiveness of the method proposed. On several public scene text datasets, our method outperforms the state-of-the-art unsupervised segmentation algorithms.

Computer Vision and Pattern Recognition
A Handwriting Textline Extraction Approach Based on Connected Domain

Wei Gao,Fuchun Sun,Zhonghang Yin

DOI: https://doi.org/10.1109/coginf.2010.5599738

2010-01-01

Abstract:This paper describes an approach for extracting words, textlines and text blocks by analyzing the spatial configuration of connected domain and word contour rectangles on a given document image. The basic idea is that connected components of black pixels and contours can be used as computational units in document image analysis. In this paper, we try to find a spatial feature and overlapped relationships for every contour rectangle, and we call this feature rectangle “Standard Rectangle”(SR). Then we calculate the split line of every textline according to a series of operations of SRs, and separate the word contour rectangles to different lines. In the next step we estimate that if the adjacent textlines is overlapped. If it is, we calculate the overlap distance and move the word contour rectangles according to it. Our experiment show the approach does good work on both overlapped textlines and detached textlines.
Text Segmentation with LDA-based Fisher Kernel

Qi Sun,Runxin Li,Dingsheng Luo,Xihong Wu

DOI: https://doi.org/10.3115/1557690.1557768

2008-01-01

Abstract:In this paper we propose a domain-independent text segmentation method, which consists of three components. Latent Dirichlet allocation (LDA) is employed to compute words semantic distribution, and we measure semantic similarity by the Fisher kernel. Finally global best segmentation is achieved by dynamic programming. Experiments on Chinese data sets with the technique show it can be effective. Introducing latent semantic information, our algorithm is robust on irregular-sized segments.
Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation

Pengyuan Lyu,Cong Yao,Wenhao Wu,Shuicheng Yan,Xiang Bai

DOI: https://doi.org/10.1109/cvpr.2018.00788

2018-06-01

Abstract:Previous deep learning based state-of-the-art scene text detection methods can be roughly classified into two categories. The first category treats scene text as a type of general objects and follows general object detection paradigm to localize scene text by regressing the text box locations, but troubled by the arbitrary-orientation and large aspect ratios of scene text. The second one segments text regions directly, but mostly needs complex post processing. In this paper, we present a method that combines the ideas of the two types of methods while avoiding their shortcomings. We propose to detect scene text by localizing corner points of text bounding boxes and segmenting text regions in relative positions. In inference stage, candidate boxes are generated by sampling and grouping corner points, which are further scored by segmentation maps and suppressed by NMS. Compared with previous methods, our method can handle long oriented text naturally and doesn't need complex post processing. The experiments on ICDAR2013, ICDAR2015, MSRA-TD500, MLT and COCO-Text demonstrate that the proposed algorithm achieves better or comparable results in both accuracy and efficiency. Based on VGG16, it achieves an F-measure of 84.3% on ICDAR2015 and 81.5% on MSRA-TD500.
Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation

Markus Frohmann,Igor Sterner,Ivan Vulić,Benjamin Minixhofer,Markus Schedl

2024-10-03

Abstract:Segmenting text into sentences plays an early and crucial role in many NLP systems. This is commonly achieved by using rule-based or statistical methods relying on lexical features such as punctuation. Although some recent works no longer exclusively rely on punctuation, we find that no prior method achieves all of (i) robustness to missing punctuation, (ii) effective adaptability to new domains, and (iii) high efficiency. We introduce a new model - Segment any Text (SaT) - to solve this problem. To enhance robustness, we propose a new pretraining scheme that ensures less reliance on punctuation. To address adaptability, we introduce an extra stage of parameter-efficient fine-tuning, establishing state-of-the-art performance in distinct domains such as verses from lyrics and legal documents. Along the way, we introduce architectural modifications that result in a threefold gain in speed over the previous state of the art and solve spurious reliance on context far in the future. Finally, we introduce a variant of our model with fine-tuning on a diverse, multilingual mixture of sentence-segmented data, acting as a drop-in replacement and enhancement for existing segmentation tools. Overall, our contributions provide a universal approach for segmenting any text. Our method outperforms all baselines - including strong LLMs - across 8 corpora spanning diverse domains and languages, especially in practically relevant situations where text is poorly formatted. Our models and code, including documentation, are available at <a class="link-external link-https" href="https://github.com/segment-any-text/wtpsplit" rel="external noopener nofollow">this https URL</a> under the MIT license.

Computation and Language,Artificial Intelligence,Machine Learning
Real-Time Scene Text Detection With Differentiable Binarization and Adaptive Scale Fusion

Minghui Liao,Zhisheng Zou,Zhaoyi Wan,Cong Yao,Xiang Bai

DOI: https://doi.org/10.1109/TPAMI.2022.3155612

Abstract:Recently, segmentation-based scene text detection methods have drawn extensive attention in the scene text detection field, because of their superiority in detecting the text instances of arbitrary shapes and extreme aspect ratios, profiting from the pixel-level descriptions. However, the vast majority of the existing segmentation-based approaches are limited to their complex post-processing algorithms and the scale robustness of their segmentation models, where the post-processing algorithms are not only isolated to the model optimization but also time-consuming and the scale robustness is usually strengthened by fusing multi-scale feature maps directly. In this paper, we propose a Differentiable Binarization (DB) module that integrates the binarization process, one of the most important steps in the post-processing procedure, into a segmentation network. Optimized along with the proposed DB module, the segmentation network can produce more accurate results, which enhances the accuracy of text detection with a simple pipeline. Furthermore, an efficient Adaptive Scale Fusion (ASF) module is proposed to improve the scale robustness by fusing features of different scales adaptively. By incorporating the proposed DB and ASF with the segmentation network, our proposed scene text detector consistently achieves state-of-the-art results, in terms of both detection accuracy and speed, on five standard benchmarks.
Text Segmentation in Degraded Historical Document Images

A. S. Kavitha,P. Shivakumara,G. H. Kumar,Tong Lu

DOI: https://doi.org/10.1016/j.eij.2015.11.003

IF: 4.195

2016-01-01

Egyptian Informatics Journal

Abstract:Text segmentation from degraded Historical Indus script images helps Optical Character Recognizer (OCR) to achieve good recognition rates for Hindus scripts; however, it is challenging due to complex background in such images. In this paper, we present a new method for segmenting text and non-text in Indus documents based on the fact that text components are less cursive compared to non-text ones. To achieve this, we propose a new combination of Sobel and Laplacian for enhancing degraded low contrast pixels. Then the proposed method generates skeletons for text components in enhanced images to reduce computational burdens, which in turn helps in studying component structures efficiently. We propose to study the cursiveness of components based on branch information to remove false text components. The proposed method introduces the nearest neighbor criterion for grouping components in the same line, which results in clusters. Furthermore, the proposed method classifies these clusters into text and non-text cluster based on characteristics of text components. We evaluate the proposed method on a large dataset containing varieties of images. The results are compared with the existing methods to show that the proposed method is effective in terms of recall and precision.
Robust text line detection in historical documents: learning and evaluation methods

Mélodie Boillet,Christopher Kermorvant,Thierry Paquet

DOI: https://doi.org/10.1007/s10032-022-00395-7

2022-03-23

International Journal on Document Analysis and Recognition (IJDAR)

Abstract:Text line segmentation is one of the key steps in historical document understanding. It is challenging due to the variety of fonts, contents, writing styles and the quality of documents that have degraded through the years. In this paper, we address the limitations that currently prevent people from building line segmentation models with a high generalization capacity. We present a study conducted using three state-of-the-art systems Doc-UFCN, dhSegment and ARU-Net and show that it is possible to build generic models trained on a wide variety of historical document datasets that can correctly segment diverse unseen pages. This paper also highlights the importance of the annotations used during training: Each existing dataset is annotated differently. We present a unification of the annotations and show its positive impact on the final text recognition results. In this end, we present a complete evaluation strategy using standard pixel-level metrics, object-level ones and introducing goal-oriented metrics.
More Separable and Easier to Segment: A Cluster Alignment Method for Cross-Domain Semantic Segmentation

Shuang Wang,Dong Zhao,Yi Li,Chi Zhang,Yuwei Guo,Qi Zang,Biao Hou,Licheng Jiao

DOI: https://doi.org/10.48550/arXiv.2105.03151

2021-05-07

Abstract:Feature alignment between domains is one of the mainstream methods for Unsupervised Domain Adaptation (UDA) semantic segmentation. Existing feature alignment methods for semantic segmentation learn domain-invariant features by adversarial training to reduce domain discrepancy, but they have two limits: 1) associations among pixels are not maintained, 2) the classifier trained on the source domain couldn't adapted well to the target. In this paper, we propose a new UDA semantic segmentation approach based on domain closeness assumption to alleviate the above problems. Specifically, a prototype clustering strategy is applied to cluster pixels with the same semantic, which will better maintain associations among target domain pixels during the feature alignment. After clustering, to make the classifier more adaptive, a normalized cut loss based on the affinity graph of the target domain is utilized, which will make the decision boundary target-specific. Sufficient experiments conducted on GTA5 $\rightarrow$ Cityscapes and SYNTHIA $\rightarrow$ Cityscapes proved the effectiveness of our method, which illustrated that our results achieved the new state-of-the-art.

Computer Vision and Pattern Recognition

Advances in domain independent linear text segmentation

A new video text detection method.

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

A method for text line detection in natural images

Using multiple discriminant analysis approach for linear text segmentation

An automatic approach for efficient text segmentation

Recent Trends in Linear Text Segmentation: a Survey

Weakly-Supervised Text Instance Segmentation

A Novel Iterative Algorithm to Text Segmentation for Web Born-Digital Images.

A statistical learning algorithm for word segmentation

LISTER: Neighbor Decoding for Length-Insensitive Scene Text Recognition

Self-supervised Scene Text Segmentation with Object-centric Layered Representations Augmented by Text Regions

A Handwriting Textline Extraction Approach Based on Connected Domain

Text Segmentation with LDA-based Fisher Kernel

Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation

Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation

Real-Time Scene Text Detection With Differentiable Binarization and Adaptive Scale Fusion

Text Segmentation in Degraded Historical Document Images

Robust text line detection in historical documents: learning and evaluation methods

More Separable and Easier to Segment: A Cluster Alignment Method for Cross-Domain Semantic Segmentation