Abstract:Few-shot semantic segmentation (FSS) aims to segment unseen objects in a query image using a few pixel-wise annotated support images, thus expanding the capabilities of semantic segmentation. The main challenge lies in extracting sufficient information from the limited support images to guide the segmentation process. Conventional methods typically address this problem by generating single or multiple prototypes from the support images and calculating their cosine similarity to the query image. However, these methods often fail to capture meaningful information for modeling the de facto joint distribution of pixel and category. Consequently, they result in incomplete segmentation of foreground objects and mis-segmentation of the complex background. To overcome this issue, we propose the Cross Gaussian Mixture Generative Model (CGMGM), a novel Gaussian Mixture Models~(GMMs)-based FSS method, which establishes the joint distribution of pixel and category in both the support and query images. Specifically, our method initially matches the feature representations of the query image with those of the support images to generate and refine an initial segmentation mask. It then employs GMMs to accurately model the joint distribution of foreground and background using the support masks and the initial segmentation mask. Subsequently, a parametric decoder utilizes the posterior probability of pixels in the query image, by applying the Bayesian theorem, to the joint distribution, to generate the final segmentation mask. Experimental results on PASCAL-5i and COCO-20i datasets demonstrate our CGMGM's effectiveness and superior performance compared to the state-of-the-art methods.

A robust soft decision mixture model for image segmentation

A robust modified Gaussian mixture model with rough set for image segmentation.

CGMGM: A Cross-Gaussian Mixture Generative Model for Few-Shot Semantic Segmentation

A Spatially Compact Mixture Model for Image Segmentation

Double Gaussian Mixture Model for Image Segmentation with Spatial Relationships

Image Segmentation Based on Spatially Coherent Gaussian Mixture Model

Image segmentation by MAP-ML estimations.

IMPROVEMENT OF FINITE MIXTURE MODEL BASED ON GIBBS RANDOM THEORY AND ROBUST SEGMENTATION FOR BRAIN MR IMAGES

Image Segmentation by Student's-t Mixture Models Based on Markov Random Field and Weighted Mean Template

Image Segmentation Using a Trimmed Likelihood Estimator in the Asymmetric Mixture Model Based on Generalized Gamma and Gaussian Distributions

A Gray Image Segmentation Method Based on Gaussian Mixture Model and Markov Modeling

A spatially constrained shifted asymmetric Laplace mixture model for the grayscale image segmentation.

Estimation of fuzzy Gaussian mixture and unsupervised statistical image segmentation

A New Textured Image Segmentation Algorithm Based on Gaussian Mixture Models

Accurate Image Segmentation Using Gaussian Mixture Model with Saliency Map

A Region Markov Random Field Model with Integrated Edge Feature and Image Segmentation Algorithm

Image Segmentation Based on High-Order MRF Model with Robust Local Spatial Information

BM-GMM: Belief Function-Based Gaussian Markov Model for Image Segmentation

Robust MR Image Segmentation Using the Trimmed Likelihood Estimator in Asymmetric Student's-t Mixture Model

A Gaussian Mixture Model-based Clustering Algorithm for Image Segmentation Using Dependable Spatial Constraints

SAR Image Segmentation Using GHM-Based Dirichlet Process Mixture Models.