Abstract:Simple linear models, which usually learn word-level representations that are later combined to form document representations, have recently shown impressive performance. To improve the performance of document-level classification, it is crucial to explore the factors affecting the quality of the document vector. In this paper, we propose the concept of containers and further explore the properties of word containers and document containers by experiments and theoretical demonstrations. We find that the document container has a fixed capacity and that the document vector obtained by a simple average of too many word embeddings undoubtedly cannot be fully loaded by the container and will lose some semantic and syntactic information on very large text datasets. We also propose an efficient approach for document representation, using clustering algorithms to divide a document container into several subcontainers and establishing the relationship between the subcontainers. We additionally report and discuss the properties of two methods of clustering algorithms, DVEM-Kmeans and DVEM-Random, on large text datasets by sentiment analysis and topic classification tasks. Compared to simple linear models, the results show that our models outperform the existing state-of-the-art in generating high-quality document representations for document-level classification relatedness tasks. Our approaches can also be introduced to other models based on neural networks, such as convolutional neural networks, recurrent neural networks and generative adversarial networks, in supervised or semisupervised settings.

A VECTOR SPACE MODEL BASED DOCUMENT CLASSIFICATION SYSTEM [J]

A multiclass classification framework for document categorization

Document Classification Based on Word Vectors

An Automatic Chinese-Text Classifier Based on Vector Space Model

An Approach of Multi-hierarchy Text Classification Based on Vector Space Model

Document Classification Method Based on Word2vec

Research on Chinese Document Classification Based on Graph Model

A Document-Based Information Retrieval Model Vector Space

Improved VSM Based on Chinese Text Categorization

Automatic Text Classification Based on Improved Vector Space Model

An Efficient Method for Document Categorization Based on Word2vec and Latent Semantic Analysis.

WordNet-based Concept Vector Space Model for Text Classification

Document Classification Based on Support Vector Machine Using a Concept Vector Model

Chinese Document Categorization without Dictionary Support and Segmentation Processing

Research and application of a method for real estate document image classification

A kind of vector space representation model based on semantic

A Method for Chinese Text Classification Based on Three-Dimensional Vector Space Model

A document feature extraction method based on concept-word list

A Kind of Self-Constructed Category Dictionary in Chinese Text Classification

Performance Comparison of TF*IDF, LDA and Paragraph Vector for Document Classification

Document Vector Extension for Documents Classification