Abstract:While numerous page segmentation algorithms have been proposed in the literature, there is lack of comparative evaluation of these algorithms. In the existing performance evaluation methods, two crucial components are usually missing: 1) automatic training of algorithms with free parameters and 2) statistical and error analysis of experimental results. We use the following five-step methodology to quantitatively compare the performance of page segmentation algorithms: 1) first, we create mutually exclusive training and test data sets with groundtruth, 2) we then select a meaningful and computable performance metric, 3) an optimization procedure is then used to search automatically for the optimal parameter values of the segmentation algorithms on the training data set, 4) the segmentation algorithms are then evaluated on the test data set, and, finally, 5) a statistical and error analysis is performed to give the statistical significance of the experimental results. In particular, instead of the ad hoc and manual approach typically used in the literature for training algorithms, we pose the automatic training of algorithms as an optimization problem and use the simplex algorithm to search for the optimal parameter value. A paired-model statistical analysis and an error analysis are then conducted to provide confidence intervals for the experimental results of the algorithms. This methodology is applied to the evaluation of live page segmentation algorithms of which, three are representative research algorithms and the other two are well-known commercial products, on 978 images from the University of Washington III data set. It is found that the performance indices of the Voronoi, Docstrum, and Caere segmentation algorithms are not significantly different from each other, but they are significantly better than that of ScanSoft's segmentation algorithm, which, in turn, is significantly better than that of X-Y cut.

Evaluation and Comparison of Different Segmentation Algorithms

Objective Performance Evaluation of Video Segmentation Algorithms with Ground-Truth

The Comparative Research on Image Segmentation Algorithms

A survey on evaluation methods for image segmentation

Objective Image Quality Measures and Their Applications in Segmentation Evaluation

A comparative evaluation of interactive segmentation algorithms

A Novel Quality Evaluating Method for Over-Segmentation Approaches Using Real-Time Boundary Information

Accuracy Evaluation of Segmentation for High Resolution Imagery and 3D Laser Point Cloud Data

Image Segmentation Evaluation in this Century

Toward Objective Evaluation of Image Segmentation Algorithms

Segmentation Evaluation Using Ultimate Measurement Accuracy

Evaluation Knowledge Based Optimal Selection Systemfor Image Segmentation Algorithms

A Review of Recent Evaluation Methods for Image Segmentation

Different Algorithms Comparison for Gray-level Co-occurrence Matrix of Irregular Graph

A framework for evaluating image segmentation algorithms

Supervised Evaluation of Synthetic and Real Contour Segmentation Results.

Survey of Object Segmentation Algorithms in Vision-Based Monitoring System

Comparison of Thresholding Techniques Using Synthetic Images and Ultimate Measurement Accuracy

Evaluation Based Segmentation Algorithm Optimization: Idea and System

Empirical performance evaluation methodology and its application to page segmentation algorithms

Benchmarking Image Segmentation Algorithms