Abstract:Few-shot semantic segmentation (FSS) aims to segment unseen objects in a query image using a few pixel-wise annotated support images, thus expanding the capabilities of semantic segmentation. The main challenge lies in extracting sufficient information from the limited support images to guide the segmentation process. Conventional methods typically address this problem by generating single or multiple prototypes from the support images and calculating their cosine similarity to the query image. However, these methods often fail to capture meaningful information for modeling the de facto joint distribution of pixel and category. Consequently, they result in incomplete segmentation of foreground objects and mis-segmentation of the complex background. To overcome this issue, we propose the Cross Gaussian Mixture Generative Model (CGMGM), a novel Gaussian Mixture Models~(GMMs)-based FSS method, which establishes the joint distribution of pixel and category in both the support and query images. Specifically, our method initially matches the feature representations of the query image with those of the support images to generate and refine an initial segmentation mask. It then employs GMMs to accurately model the joint distribution of foreground and background using the support masks and the initial segmentation mask. Subsequently, a parametric decoder utilizes the posterior probability of pixels in the query image, by applying the Bayesian theorem, to the joint distribution, to generate the final segmentation mask. Experimental results on PASCAL-5i and COCO-20i datasets demonstrate our CGMGM's effectiveness and superior performance compared to the state-of-the-art methods.

Generalized Gaussian mixture Conditional Random Field model for image labeling

A new Laplacian mixture conditional random field model for image labeling

CGMGM: A Cross-Gaussian Mixture Generative Model for Few-Shot Semantic Segmentation

Facial feature points detecting based on Gaussian Mixture Models

Conditional Random Fields for Image Labeling

A Novel Hyperspectral Remote Sensing Images Classification Using Gaussian Processes with Conditional Random Fields

Modeling natural images using gated MRFs

Image labeling based on fully-connected conditional random field

Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials

A Projected Gradient Descent Method for CRF Inference allowing End-To-End Training of Arbitrary Pairwise Potentials

Gaussian mixture model for relevance feedback in image retrieval

Mixtures of conditional Gaussian scale mixtures applied to multiscale image representations

Image Binarization Based on Conditional Random Fields

Context-based conditional random fields as recurrent neural networks for image labeling

Deep Gaussian mixture model for unsupervised image segmentation

Conditional Random Fields for Image Region Labeling with Global Observation.

A new robust context-based dense CRF model for image labeling

Gaussian mixture model and Markov random fields for hyperspectral image classification

A Two-Layer Mixture Model of Gaussian Process Functional Regressions and Its MCMC EM Algorithm

Diffusion Model Conditioning on Gaussian Mixture Model and Negative Gaussian Mixture Gradient

A BYY Scale-Incremental EM Algorithm for Gaussian Mixture Learning