Abstract:Natural language processing (NLP) is one of the key techniques in intelligent question-answering (Q&A) systems. Although recurrent neural networks and long short-term memory (LSTM) networks exhibit obvious advantages on well-known English Q&A datasets, they still suffer from several defects including indeterminateness, polysemy and the lack of changing morphology in Chinese, which results in complex NLP on large and diverse Chinese Q&A datasets. In this paper, we first analyze limitations of applying LSTM and bidirectional LSTM (Bi-LSTM) models to noisy Chinese Q&A datasets. Then, we focus on integrating attention mechanisms and multi-granularity word segmentation into Bi-LSTM and propose an attention mechanism and multi-granularity-based Bi-LSTM model (AM–Bi-LSTM) which combines the improved attention mechanism with a novel processing of multi-granularity word segmentation to handle the complex NLP in Chinese Q&A datasets. Furthermore, similarity of questions and answers is formulated to implement the quantitative computation which helps to achieve better performance in Chinese Q&A systems. Finally, we verify the proposed model on a noisy Chinese Q&A dataset. The experimental results demonstrate that the novel AM–Bi-LSTM model achieves significant improvement on evaluation metrics of accuracy, mean average precision and so on. Moreover, the experimental results indicate that the novel AM–Bi-LSTM model outperforms baseline methods and other LSTM-based models.

Empirical Study on Deep Learning Models for Question Answering.

Long-Term Memory Networks for Question Answering

Memory Augmented Deep Recurrent Neural Network for Video Question Answering

Exploring Question Understanding and Adaptation in Neural-Network-Based Question Answering

Visual Question Answering with Memory-Augmented Networks

An attention mechanism and multi-granularity-based Bi-LSTM model for Chinese Q&A system

Answering with Memory-Augmented Networks

Question-Aware Memory Network for Multi-hop Question Answering in Human-Robot Interaction

Ask Me Even More: Dynamic Memory Tensor Networks (Extended Model)

Feature Augmented Memory with Global Attention Network for VideoQA

Skip-Thought Memory Networks

Deep Learning in Question Answering

Motion-Appearance Co-Memory Networks for Video Question Answering

Pay More Attention - Neural Architectures for Question-Answering

Enhancing Key-Value Memory Neural Networks for Knowledge Based Question Answering.

A Question-Focused Multi-Factor Attention Network for Question Answering

A Brain-inspired Memory Transformation based Differentiable Neural Computer for Reasoning-based Question Answering

Intelligent Question Answering in Restricted Domains Using Deep Learning and Question Pair Matching

Bi-directional Long Short-Term Memory Model with Semantic Positional Attention for the Question Answering System

Machine Comprehension Comparison using Latest Advancements in Deep Learning

Open Domain Question Answering with Character-Level Deep Learning Models.