Abstract:In this chapter we present a method for learning a compositional model in a minimax entropy framework for modeling object categories with large intra-class variance. The model we learn incorporates the flexibility of a stochastic context free grammar (SCFG) to account for the variation in object structure with the neighborhood constraints of a Markov random field (MRF) to enforce spatial context. We learn the model through a generalized minimax entropy framework that accounts for the dynamic structure of the hierarchical model. We first learn the SCFG parameters using the frequencies of object parts, then pursue spatial relations in order of greatest information gain. The learned model can generalize from a small set of training samples (n < 100) to generate a combinatorially large number of novel instances using stochastic sampling. To verify our learning method and model performance, we present plots of KL divergence minimization as the algorithm proceeds, and show that samples from the model become more realistic as more spatial relations are added. We also show the model accurately predicting missing or undetected parts for top-down recognition along with preliminary results showing that the model can learn a large space of category appearances from a very small (n < 15) number of training samples. This process is similar to “recognition-by-components”, a theory that postulates that biological vision systems recognize objects as composed from a dictionary of commonly appearing 3D structures. Finally, we discuss a compositional boosting algorithm for inference and show examples using it for object recognition. This article is a chapter from the book Object Categorization: Computer and Human Vision Perspectives, edited by Sven Dickinson, Ales Leonardis, Bernt Schiele, and Michael J. Tarr (Cambridge University Press). University of California Los Angeles, Los Angeles, CA. Lotus Hill Research Institute, EZhou, China.

Constructing Training Distribution by Minimizing Variance of Risk Criterion for Visual Category Learning

Active Learning with Optimal Distribution for Image Classification

Prior-free Rare Category Detection: More Effective and Efficient Solutions

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

Effective Constructing Training Sets For Object Detection

Hierarchical Visual Categories Modeling: A Joint Representation Learning and Density Estimation Framework for Out-of-Distribution Detection

Category Modeling from Just a Single Labeling: Use Depth Information to Guide the Learning of 2D Models

Learning Category-Specific 3d Shape Models From Weakly Labeled 2d Images

Unifying Discriminative Visual Codebook Generation with Classifier Training for Object Category Recognition

Practice Makes Perfect: an Adaptive Active Learning Framework for Image Classification

Residual Tuning: Toward Novel Category Discovery Without Labels

A Latent Variable Augmentation Method for Image Categorization with Insufficient Training Samples

Virtual Category Learning: A Semi-Supervised Learning Method for Dense Prediction with Extremely Limited Labels

Semi-supervised Object Detection via Virtual Category Learning

Labeled Data Selection for Category Discovery

Learning Compositional Models for Object Categories from Small Sample Sets

An Information-Theoretic Learning Model Based on Importance Sampling

Cost-sensitive Learning of Hierarchical Tree Classifiers for Large-Scale Image Classification and Novel Category Detection

Automatic Online Labeling Images Via Co-Active-learning

Learning from Noisy Labels via Conditional Distributionally Robust Optimization