Abstract:Complex textual information extraction tasks are often posed as sequence labeling or \emph{shallow parsing}, where fields are extracted using local labels made consistent through probabilistic inference in a graphical model with constrained transitions. Recently, it has become common to locally parametrize these models using rich features extracted by recurrent neural networks (such as LSTM), while enforcing consistent outputs through a simple linear-chain model, representing Markovian dependencies between successive labels. However, the simple graphical model structure belies the often complex non-local constraints between output labels. For example, many fields, such as a first name, can only occur a fixed number of times, or in the presence of other fields. While RNNs have provided increasingly powerful context-aware local features for sequence tagging, they have yet to be integrated with a global graphical model of similar expressivity in the output distribution. Our model goes beyond the linear chain CRF to incorporate multiple hidden states per output label, but parametrizes their transitions parsimoniously with low-rank log-potential scoring matrices, effectively learning an embedding space for hidden states. This augmented latent space of inference variables complements the rich feature representation of the RNN, and allows exact global inference obeying complex, learned non-local output constraints. We experiment with several datasets and show that the model outperforms baseline CRF+RNN models when global output constraints are necessary at inference-time, and explore the interpretable latent structure.

Automatic Indexing Model Based on Conditional Random Fields

The Automatic Extraction of Temporal Relation from Chinese Narrative Medical Records Using Conditional Random Fields

Citation Metadata Extraction Via Deep Neural Network-based Segment Sequence Labeling

Conditional Random Fields for Image Labeling

Scene description based on the conditional random fields model

Global Ranking of Documents Using Continuous Conditional Random Fields

Ensemble Approach Based on Conditional Random Field for Multi-Label Image and Video Annotation

2D Conditional Random Fields for Web Information Extraction

Automatic Identification of Concurrent Structure Based on Conditional Random Field

Image labeling based on fully-connected conditional random field

Conditional Random Fields for Image Region Labeling with Global Observation.

Conditional Topic Random Fields.

Analyzing Sequence Data Based on Conditional Random Fields with Co-Training

A New Image Labeling Method Based on Content-Based Image Retrieval and Conditional Random Field

Embedded-State Latent Conditional Random Fields for Sequence Labeling

Chinese Named Entity Recognition with the Improved Smoothed Conditional Random Fields

Research on Keywords Indexing for Chinese Bibliography Based on Word Roles Annotation

Neural CRF transducers for sequence labeling

Semantic Music Annotation by Label-Specific Conditional Random Fields

Efficient robust conditional random fields

Upgrading CRFS to JRFS and Its Benefits to Sequence Modeling and Labeling.