Abstract:Probabilistic Latent Semantic Analysis (PLSA) is a fundamental text analysis technique that models each word in a document as a sample from a mixture of topics. PLSA is the precursor of probabilistic topic models including Latent Dirichlet Allocation (LDA). PLSA, LDA and their numerous extensions have been successfully applied to many text mining and retrieval tasks. One important extension of LDA is supervised LDA (sLDA), which distinguishes itself from most topic models in that it is supervised. However, to the best of our knowledge, no prior work extends PLSA in a similar manner sLDA extends LDA by jointly modeling the contents and the responses of documents. In this paper, we propose supervised PLSA (sPLSA) which can efficiently infer latent topics and their factorized response values from the contents and the responses of documents. The major challenge lies in estimating a document's topic distribution which is a constrained probability that is dictated by both the content and the response of the document. To tackle this challenge, we introduce an auxiliary variable to transform the constrained optimization problem to an unconstrained optimization problem. This allows us to derive an efficient Expectation and Maximization (EM) algorithm for parameter estimation. Compared to sLDA, sPLSA converges much faster and requires less hyperparameter tuning, while performing similarly on topic modeling and better in response factorization. This makes sPLSA an appealing choice for latent response analysis such as ranking latent topics by their factorized response values. We apply the proposed sPLSA model to analyze the controversy of bills from the United States Congress. We demonstrate the effectiveness of our model by identifying contentious legislative issues.

Sparsity-Constrained Probabilistic Latent Semantic Analysis For Land Cover Classification

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Probabilistic Latent Semantic Analysis for Sketch-Based 3D Model Retrieval

Semantic Representation Fusion-Based Network for Robust Land Cover Classification in Foggy Conditions.

Image Categorization Via Robust Plsa

A NOVEL BAYESIAN LASSO MODEL BASED ON SPATIAL-CORRELATED SPARSITY FOR SEMISUPERVISED HYPERSPECTRAL UNMIXING

Dynamic Threshold Model Based Probabilistic Latent Semantic Analysis

Incorporate Spatial Information into pLSA for Scene Classification

Laplacian Sparse Dictionary Learning for Image Classification Based on Sparse Representation

SPLC: An Attention-Based End-to-End Superpixels and Land Cover Classification Jointly Learning Architecture for HR Remote Sensing Image

Probabilistic Latent Semantic Analysis for Dynamic Textures Recognition and Localization

Applying pLSA to region-based image categorization with soft vector quantization.

Integrating Image Segmentation And Annotation Using Supervised Plsa

Semantic image classification using statistical local spatial relations model

Multimodal Semantic Collaborative Classification for Hyperspectral Images and LiDAR Data

A Hierarchical Latent Topic Model Based on Sparse Coding

Multilabel image annotation based on double-layer PLSA model.

Land Cover Classification Based on PSPNet Using Remote Sensing Image

Supervised probabilistic latent semantic analysis with applications to controversy analysis of legislative bills

Scene Classification Using Class-Supervised Local-Space-constraint Latent Dirichlet Allocation

Automatic Landslide Detection from Remote-Sensing Imagery Using A Scene Classification Method Based on Bovw and Plsa