Abstract:In this paper, we discuss how discriminative training can be applied to the hidden vector state (HVS) model in different task domains. The HVS model is a discrete hidden Markov model (HMM) in which each HMM state represents the state of a push-down automaton with a finite stack size. In previous applications, maximum-likelihood estimation (MLE) is used to derive the parameters of the HVS model. However, MLE makes a number of assumptions and unfortunately some of these assumptions do not hold. Discriminative training, without making such assumptions, can improve the performance of the HVS model by discriminating the correct hypothesis from the competing hypotheses. Experiments have been conducted in two domains: the travel domain for the semantic parsing task using the DARPA Communicator data and the Air Travel Information Services (ATIS) data and the bioinformatics domain for the information extraction task using the GENIA corpus. The results demonstrate modest improvements of the performance of the HVS model using discriminative training. In the travel domain, discriminative training of the HVS model gives a relative error reduction rate of 31 percent in F-measure when compared with MLE on the DARPA Communicator data and 9 percent on the ATIS data. In the bioinformatics domain, a relative error reduction rate of 4 percent in F-measure is achieved on the GENIA corpus.

Spoken Language Understanding from Unaligned Data Using Discriminative Classification Models

Spoken Language Understanding Using Finite State Tagger and Long-Range Dependency Parsing

Discriminative Spoken Language Understanding Using Word Confusion Networks

A Generative Parser with a Discriminative Recognition Algorithm

Embedded Machine Learning Systems For Robust Spoken Language Parsing

A Hybrid Generative/Discriminative Framework to Train a Semantic Parser from an Un-annotated Corpus.

Learning Conditional Random Fields From Unaligned Data For Natural Language Understanding

A Hierarchical Decoding Model for Spoken Language Understanding from Unaligned Data.

Semi-supervised Learning of Statistical Models for Natural Language Understanding.

Discriminative Training of the Hidden Vector State Model for Semantic Parsing

Efficient Latent Structural Perceptron with Hybrid Trees for Semantic Parsing

Bridging the Gap Between Clean Data Training and Real-World Inference for Spoken Language Understanding

Discriminative induction of sub-tree alignment using limited labeled data

A novel framework of training hidden markov support vector machines from lightly-annotated data.

Few-Shot Spoken Language Understanding via Joint Speech-Text Models

Augmenting text for spoken language understanding with Large Language Models

Modality Confidence Aware Training for Robust End-to-End Spoken Language Understanding

MACT: Model-Agnostic Cross-Lingual Training for Discourse Representation Structure Parsing

A Joint and Domain-Adaptive Approach to Spoken Language Understanding

Generative Models for Alignment and Data Efficiency in Language

Advancing Singlish Understanding: Bridging the Gap with Datasets and Multimodal Models