Abstract:Convolutional neural networks (CNNs) need to replicate feature detectors when modeling spatial information, which reduces their efficiency. The number of replicated feature detectors or labeled training data required for such methods grows exponentially with the dimensionality of the data being used. On the other hand, space-insensitive methods are difficult to encode and express effectively due to the limitation of their rich text structures. In response to the above problems, this paper proposes a capsule network (self-attention capsule network, or SA-CapsNet) with a self-attention mechanism for text classification tasks, wherein the capsule network itself, given the feature with the symmetry hint on two ends, acts as both encoder and decoder. In order to learn long-distance dependent features in sentences and encode text information more efficiently, SA-CapsNet maps the self-attention module to the feature extraction layer of the capsule network, thereby increasing its feature extraction ability and overcoming the limitations of convolutional neural networks. In addition, in this study, in order to improve the accuracy of the model, the capsule was improved by reducing its dimension and an intermediate layer was added, enabling the model to obtain more expressive instantiation features in a given sentence. Finally, experiments were carried out on three general datasets of different sizes, namely the IMDB, MPQA, and MR datasets. The accuracy of the model on these three datasets was 84.72%, 80.31%, and 75.38%, respectively. Furthermore, compared with the benchmark algorithm, the model's performance on these datasets was promising, with an increase in accuracy of 1.08%, 0.39%, and 1.43%, respectively. This study focused on reducing the parameters of the model for various applications, such as edge and mobile applications. The experimental results show that the accuracy is still not apparently decreased by the reduced parameters. The experimental results therefore verify the effective performance of the proposed SA-CapsNet model.

Snore Sound Recognition Via an Explainable Capsule Network

Automatic Respiratory Sound Classification Via Multi-Branch Temporal Convolutional Network

A multi-branch convolutional neural network for snoring detection based on audio

0526 Deep Convolutional Neural Network for Groaning and Snoring Sounds Classification

who is snoring? snore based user recognition

Snoring Sound Recognition Using Multi-Channel Spectrograms

A System for the Detection of Polyphonic Sound on a University Campus Based on CapsNet-RNN

A Bag of Wavelet Features for Snore Sound Classification

Real-time Prediction of Upcoming Respiratory Events Via Machine Learning Using Snoring Sound Signal.

Classification of Snoring Sound-Related Signals Based on MLP.

Automated sleep apnea detection in snoring signal using long short-term memory neural networks

Coherent Feature Extraction with Swarm Intelligence Based Hybrid Adaboost Weighted ELM Classification for Snoring Sound Classification

Cross-Individual Obstructive Obstructive Apnea Detection in Snoring Signals Using Hybrid Deep Neural Networks.

Improving snore detection under limited dataset through harmonic/percussive source separation and convolutional neural networks

Sign Language Recognition from Digital Videos Using Deep Learning Methods

Research on a Capsule Network Text Classification Method with a Self-Attention Mechanism

Sleep Apnea Detection Based on Snoring Sound Analysis Using DS-MS neural network

CTCNet: A CNN Transformer Capsule Network for Sleep Stage Classification

Automatic Classification of the Obstruction Site in Obstructive Sleep Apnea Based on Snoring Sounds.

An efficient deep model for children sleep apnea detection using snoring signals

SleepNet: automated sleep analysis via dense convolutional neural network using physiological time series