Abstract:Few-shot semantic segmentation (FSS) aims to segment unseen objects in a query image using a few pixel-wise annotated support images, thus expanding the capabilities of semantic segmentation. The main challenge lies in extracting sufficient information from the limited support images to guide the segmentation process. Conventional methods typically address this problem by generating single or multiple prototypes from the support images and calculating their cosine similarity to the query image. However, these methods often fail to capture meaningful information for modeling the de facto joint distribution of pixel and category. Consequently, they result in incomplete segmentation of foreground objects and mis-segmentation of the complex background. To overcome this issue, we propose the Cross Gaussian Mixture Generative Model (CGMGM), a novel Gaussian Mixture Models~(GMMs)-based FSS method, which establishes the joint distribution of pixel and category in both the support and query images. Specifically, our method initially matches the feature representations of the query image with those of the support images to generate and refine an initial segmentation mask. It then employs GMMs to accurately model the joint distribution of foreground and background using the support masks and the initial segmentation mask. Subsequently, a parametric decoder utilizes the posterior probability of pixels in the query image, by applying the Bayesian theorem, to the joint distribution, to generate the final segmentation mask. Experimental results on PASCAL-5i and COCO-20i datasets demonstrate our CGMGM's effectiveness and superior performance compared to the state-of-the-art methods.

Foreground extraction with genetic mechanism and difference of Guassian

Face Feature Extraction Method Based on CGA and ICA

Automatic foreground extraction based on difference of Gaussian.

Automatic foreground extraction of head shoulder images

Foreground Gating and Background Refining Network for Surveillance Object Detection

CGMGM: A Cross-Gaussian Mixture Generative Model for Few-Shot Semantic Segmentation

A Foreground Extraction Method by Using Multi-Resolution Edge Aggregation Algorithm.

Image interpretation with fuzzy-graph based genetic algorithm

A mixture of Gaussian-based method for detecting foreground object in video surveillance

High Level Feedback for Foreground Detectioin

Human object segmentation using Gaussian mixture model and graph cuts

The Algorithm of Video Foreground Extraction via Improved Single Gauss Model and Merge of Broken Targets

Optimization of Edge Extraction Algorithm for Objects in Complex Background

Fuzzy Image Interpretation Based on Genetic Searching

Foreground Object Detecting Algorithm Based On Mixture Of Gaussian And Kalman Filter In Video Surveillance

Efficient Foreground Segmentation Using an Image Matting Technology

Automatic foreground extraction in video

Research on Fine-Grained Image Recognition Based on Foreground Extraction and Convolutional Neural Networks

Efficient Foreground Layer Extraction In Video

Automatic foreground segmentation using light field images

Foreground Detection Based on Superpixel and Semantic Segmentation