Abstract:Few-shot semantic segmentation (FSS) aims to segment unseen objects in a query image using a few pixel-wise annotated support images, thus expanding the capabilities of semantic segmentation. The main challenge lies in extracting sufficient information from the limited support images to guide the segmentation process. Conventional methods typically address this problem by generating single or multiple prototypes from the support images and calculating their cosine similarity to the query image. However, these methods often fail to capture meaningful information for modeling the de facto joint distribution of pixel and category. Consequently, they result in incomplete segmentation of foreground objects and mis-segmentation of the complex background. To overcome this issue, we propose the Cross Gaussian Mixture Generative Model (CGMGM), a novel Gaussian Mixture Models~(GMMs)-based FSS method, which establishes the joint distribution of pixel and category in both the support and query images. Specifically, our method initially matches the feature representations of the query image with those of the support images to generate and refine an initial segmentation mask. It then employs GMMs to accurately model the joint distribution of foreground and background using the support masks and the initial segmentation mask. Subsequently, a parametric decoder utilizes the posterior probability of pixels in the query image, by applying the Bayesian theorem, to the joint distribution, to generate the final segmentation mask. Experimental results on PASCAL-5i and COCO-20i datasets demonstrate our CGMGM's effectiveness and superior performance compared to the state-of-the-art methods.

Enhanced Gaussian Mixture Models for Object Recognition Using Salient Image Features

Combination Of Wavelet And Sift Features For Image Classification Using Trained Gaussian Mixture Model

Facial feature points detecting based on Gaussian Mixture Models

CGMGM: A Cross-Gaussian Mixture Generative Model for Few-Shot Semantic Segmentation

Target Recognition with SIFT Features and Enhanced Gaussian Mixture Model

Robust Image Matching Via Feature Guided Gaussian Mixture Model

Soft Measure of Visual Token Occurrences for Object Categorization

Efficient video object segmentation based on Gaussian mixture model and Markov random field

Accurate Image Segmentation Using Gaussian Mixture Model with Saliency Map

Feature-guided Gaussian Mixture Model for Image Matching.

Robust Point Sets Matching by Fusing Feature and Spatial Information Using Nonuniform Gaussian Mixture Models.

Mixture Models for Object Detection.

Double Gaussian Mixture Model for Image Segmentation with Spatial Relationships

Global vision object detection using an improved Gaussian Mixture model based on contour

Two Fast and Robust Modified Gaussian Mixture Models Incorporating Local Spatial Information for Image Segmentation

Spatial Gaussian Mixture Model for Gender Recognition

Image Segmentation Based on Spatially Coherent Gaussian Mixture Model

Learning a field of Gaussian mixture model for image classification

Gaussian Mixture Distribution Makes Data Uncertainty Learning Better

Feature guided Gaussian mixture model with semi-supervised EM and local geometric constraint for retinal image registration.

Object recognition using Gabor co-occurrence similarity