Abstract:Question Generation (QG) aims to automatically raise questions given contexts. Due to the discrepancy between the training (supervised learning) and inference (autoregressive) modes, the current QG task suffers from exposure bias, i.e., the phenomenon of error propagation induced by mistakenly-generated tokens in the preceding subsequence. To address this issue, we propose to utilize moment matching to progressively alleviate exposure biases, which is referred to EBAMQ for short in this paper. EBAMQ enhances QG by imposing positive mitigation effects on the distributed representation. This is implemented by two components, including (1) adaptive moment matching and (2) assistant-cooperating data augmentation. Within the two components, adaptive moment matching plays the dominant role. It enables the sharing of feature space among different samples that derive from binary channels (i.e., training and inference). More importantly, it provides more similar representations for synonymous or homologous tokens. In addition, we introduce the pseudo-masked technique to generate additional reference questions. It contributes to the reduction of inevitable constraints of ground-truth instances, and therefore, it helps to improve the robustness. Extensive experiments are conducted on the benchmark dataset SQuAD. Experimental results show that EBAMD produces substantial improvements for all the metrics (BLEU-4, ROUGE-L and METEOR) compared to the UniLM-based baseline, and it outperforms the state-of-the-art QG models.

Hypersphere Embedding and Additive Margin for Query-by-example Keyword Spotting

Query-by-Example Keyword Spotting Using Spectral-Temporal Graph Attentive Pooling and Multi-Task Learning

Multilingual Query-by-Example Keyword Spotting with Metric Learning and Phoneme-to-Embedding Mapping

GE2E-KWS: Generalized End-to-End Training and Evaluation for Zero-shot Keyword Spotting

Query-by-example Spoken Term Detection Based on Phonetic Posteriorgram

Neural Network based End-to-End Query by Example Spoken Term Detection

Disentangled Training with Adversarial Examples For Robust Small-footprint Keyword Spotting

EBAMQ: Exposure Bias Alleviation via Moment Matching for Question Generation.

Query-by-Example Spoken Term Detection using Attentive Pooling Networks

Keyword Spotting Based on Hypothesis Boundary Realignment and State-Level Confidence Weighting

Hypergraph-based multi-example ranking with sparse representation for transductive learning image retrieval

Focal Loss And Double-Edge-Triggered Detector For Robust Small-Footprint Keyword Spotting

Keyword-specific normalization based keyword spotting for spontaneous speech

An Empirical Study of Cross-Lingual Transfer Learning Techniques for Small-Footprint Keyword Spotting.

Multilingual Bottleneck Features for Query by Example Spoken Term Detection

Micro-Expression Spotting Based on a Short-Duration Prior and Multi-Stage Feature Extraction

Depthwise Separable Convolutional ResNet with Squeeze-and-Excitation Blocks for Small-footprint Keyword Spotting

Semantic query-by-example speech search using visual grounding

Siamese Recurrent Auto-Encoder Representation for Query-by-Example Spoken Term Detection

"\"Peak\" Quantization: A Training Method Suitable for Terminal Equipment to Deploy Keyword Spotting Network"

VE-KWS: Visual Modality Enhanced End-to-End Keyword Spotting