Abstract:Latent Semantic Indexing (LSI) with Singular Value Decomposition (SVD) is an effective dimension reduction method for document classification and other information analysis tasks. The computational overhead of SVD is known to be a bottleneck in dealing with large data sets, and faster dimension reduction with competitive accuracy is desired in such a setting.This paper presents Imprecise Spectrum Analysis (ISA) to carry out fast dimension reduction for document classification. ISA follows the one-sided Jacobi method for computing SVD and simplifies its intensive orthogonality computation. It uses a representative matrix composed of top-k column vectors derived from the original feature vector space and reduces the dimension of a feature vector by computing its product with this representative matrix. The paper provides an analysis to show the approximation error and the rationale behind such a dimension reduction method. To further improve classification accuracy, this paper also presents a feature selection method in building the initial feature matrix and augments the representative matrix by including centroid vectors. Our extensive experimental results show that ISA is fast in handling large term-document feature matrices while delivering better or competitive classification accuracy for the tested benchmarks compared to LSI with SVD.

Implementation of Supply and Demand Information Classification Based on Latent Semantic Indexing

LATENT SEMANTIC INDEXING (LSI) AND ITS APPLICATIONS IN CHINESE TEXT PROCESSING

Supervised latent semantic indexing for document categorization

Improving Text Classification Using Local Latent Semantic Indexing

Local Semantic Indexing Based on Partial Least Squares for Text Classification

Text Information Retrieval Based on Latent Semantic Analysis

Adaptive Label-Driven Scaling for Latent Semantic Indexing

A study of semi-discrete matrix decomposition for LSI in automated text categorization

A MapReduce Based Distributed LSI for Scalable Information Retrieval.

A Simplified Latent Semantic Indexing Approach for Multi-Linguistic Information Retrieval.

Comparison Probabilistic Latent Semantic Indexing Model in Chinese Information Retrieval.

Incorporating Latent Semantic Indexing into Spectral Graph Transducer for Text Classification.

Understanding and Enhancing the Folding-In Method in Latent Semantic Indexing.

Application of the Information Retrieval Method in Handwritten Digit Recognition and Its Improvement

Fast Dimension Reduction for Document Classification Based on Imprecise Spectrum Analysis.

A latent image semantic indexing scheme for image retrieval on the web

Web Page Classification Based on a Least Square Support Vector Machine with Latent Semantic Analysis

Improving Latent Semantic Indexing With Concepts Mapping Based On Domain Ontology

Research on Multi-Document Summarization Based on Latent Semantic Indexing

An Information Retrieval Model Based On Vector Space Method By Supervised Learning

Support Vector Machines for Information Retrieval