Abstract:Excellent results have been reported for Data-Oriented Parsing (DOP) of natural language texts (Bod, 1993). Unfortunately, existing algorithms are both computationally intensive and difficult to implement. Previous algorithms are expensive due to two factors: the exponential number of rules that must be generated and the use of a Monte Carlo parsing algorithm. In this paper we solve the first problem by a novel reduction of the DOP model to a small, equivalent probabilistic context-free grammar. We solve the second problem by a novel deterministic parsing strategy that maximizes the expected number of correct constituents, rather than the probability of a correct parse tree. Using the optimizations, experiments yield a 97% crossing brackets rate and 88% zero crossing brackets rate. This differs significantly from the results reported by Bod, and is comparable to results from a duplication of Pereira and Schabes's (1992) experiment on the same data. We show that Bod's results are at least partially due to an extremely fortuitous choice of test data, and partially due to using cleaner data than other researchers.

Linear quantum transformation in multi-mode fermion Fock space and its applications

Linear Quantum Transformation Theory of Multimode Bosons and Its Application to Calculation of Partition-Function

Two Applications Of Linear Quantum Transformation Theory In Multi-Mode Fock Space

General theory of linear quantum transformation of Bargmann-Fock space

Linear Quantum Transform Theory in Bargmann–Fock Space and Its Preliminary Application

Linear Quantum Transformation and Normal Product Calculation of Boson Exponential Quadratic Operators

Quantum Statistics for General Quadratic System

Transference of a kind of nonclassical properties between two interacting modes of light

Operator Quantum Geometric Tensor and Quantum Phase Transitions

Exact Expressions Of Energy Spectrum And Partition Function For Quantum Quadratic Systems

Feshbach Projection-Operator Partitioning For Quantum Open Systems: Stochastic Approach

Modular Transformation and Anyonic Statistics of Multicomponent Fractional Quantum Hall States

Open Quadratic Fermion Systems and Algebras of Affine Transformations

A deformation of quantum mechanics

Efficient Algorithms for Parsing the DOP Model

Eigenvalue and Eigenfunction of N-Mode Boson Quadratic Hamiltonian

Two Theorems for General N -Mode Boson Exponential Quadratic Operators

Derivation of Discrete Symmetric Transformations of Quantum Fields in View of the Linear Quantum Transformation Theory

Single-Valued Hamiltonian via Legendre-Fenchel Transformation and Time Translation Symmetry

Ternary tree transformations are equivalent to linear encodings of the Fock basis

Wigner operator's new transformation in phase space quantum mechanics and its applications