Abstract:Recent years, the approaches based on neural networks have shown remarkable potential for sentence modeling. There are two main neural network structures: recurrent neural network (RNN) and convolution neural network (CNN). RNN can capture long term dependencies and store the semantics of the previous information in a fixed-sized vector. However, RNN is a biased model and its ability to extract global semantics is restricted by the fixed-sized vector. Alternatively, CNN is able to capture n-gram features of texts by utilizing convolutional filters. But the width of convolutional filters restricts its performance. In order to combine the strengths of the two kinds of networks and alleviate their shortcomings, this paper proposes Attention-based Multichannel Convolutional Neural Network (AMCNN) for text classification. AMCNN utilizes a bi-directional long short-term memory to encode the history and future information of words into high dimensional representations, so that the information of both the front and back of the sentence can be fully expressed. Then the scalar attention and vectorial attention are applied to obtain multichannel representations. The scalar attention can calculate the word-level importance and the vectorial attention can calculate the feature-level importance. In the classification task, AMCNN uses a CNN structure to cpture word relations on the representations generated by the scalar and vectorial attention mechanism instead of calculating the weighted sums. It can effectively extract the n-gram features of the text. The experimental results on the benchmark datasets demonstrate that AMCNN achieves better performance than state-of-the-art methods. In addition, the visualization results verify the semantic richness of multichannel representations.

Multichannel Variable-Size Convolution for Sentence Classification

Database Systems for Advanced Applications

A Multi-Class Large Margin Classifier

Convolutional Neural Networks for Sentence Classification

An Efficient Cross-lingual Model for Sentence Classification Using Convolutional Neural Network.

SECNN: Squeeze-and-Excitation Convolutional Neural Network for Sentence Classification

A Convolutional Neural Network for Modelling Sentences

MGNC-CNN: A Simple Approach to Exploiting Multiple Word Embeddings for Sentence Classification.

MGNC-CNN: A Simple Approach to Exploiting Multiple Word Embeddings for Sentence Classification

Sequential Multi-Kernel Convolutional Recurrent Network for Sentiment Classification

Multi-channel Convolutional Neural Network with Sentiment Information for Sentiment Classification

Convolutional Neural Network for Sentence Classification

An Attention-Gated Convolutional Neural Network for Sentence Classification

Multichannel CNN with Attention for Text Classification

Tree-based Convolution for Sentence Modeling.

Convolutional Neural Networks for Text Classification with Multi-size Convolution and Multi-type Pooling.

Deformable convolutional networks for multi‐view 3D shape classification

TextConvoNet: a convolutional neural network based architecture for text classification

SLCNN: Sentence-Level Convolutional Neural Network for Text Classification

Transformable Convolutional Neural Network for Text Classification