Abstract:Video amodal segmentation is a particularly challenging task in computer vision, which requires to deduce the full shape of an object from the visible parts of it. Recently, some studies have achieved promising performance by using motion flow to integrate information across frames under a self-supervised setting. However, motion flow has a clear limitation by the two factors of moving cameras and object deformation. This paper presents a rethinking to previous works. We particularly leverage the supervised signals with object-centric representation in \textit{real-world scenarios}. The underlying idea is the supervision signal of the specific object and the features from different views can mutually benefit the deduction of the full mask in any specific frame. We thus propose an Efficient object-centric Representation amodal Segmentation (EoRaS). Specially, beyond solely relying on supervision signals, we design a translation module to project image features into the Bird's-Eye View (BEV), which introduces 3D information to improve current feature quality. Furthermore, we propose a multi-view fusion layer based temporal module which is equipped with a set of object slots and interacts with features from different views by attention mechanism to fulfill sufficient object representation completion. As a result, the full mask of the object can be decoded from image features updated by object slots. Extensive experiments on both real-world and synthetic benchmarks demonstrate the superiority of our proposed method, achieving state-of-the-art performance. Our code will be released at \url{<a class="link-external link-https" href="https://github.com/kfan21/EoRaS" rel="external noopener nofollow">this https URL</a>}.

pix2gestalt: Amodal Segmentation by Synthesizing Wholes

Sequential Amodal Segmentation via Cumulative Occlusion Learning

Using Diffusion Priors for Video Amodal Segmentation

Amodal Ground Truth and Completion in the Wild

Coarse-to-Fine Amodal Segmentation with Shape Prior

Delving into Shape-aware Zero-shot Semantic Segmentation

Self-supervised Amodal Video Object Segmentation

Pixel Objectness: Learning to Segment Generic Objects Automatically in Images and Videos

The Emergence of Objectness: Learning Zero-Shot Segmentation from Videos

Amodal segmentation just like doing a jigsaw

Amodal Segmentation Based on Visible Region Segmentation and Shape Prior

Diffuse, Attend, and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusion

Zero-Shot Point Cloud Segmentation by Semantic-Visual Aware Synthesis.

Learning Segmented 3D Gaussians via Efficient Feature Unprojection for Zero-shot Neural Scene Segmentation

Rethinking Amodal Video Segmentation from Learning Supervised Signals with Object-centric Representation

Zero-Shot Dual-Path Integration Framework for Open-Vocabulary 3D Instance Segmentation

3D Open-Vocabulary Panoptic Segmentation with 2D-3D Vision-Language Distillation

PLUG: Revisiting Amodal Segmentation with Foundation Model and Hierarchical Focus

StixelNExT: Toward Monocular Low-Weight Perception for Object Segmentation and Free Space Detection

See More and Know More: Zero-shot Point Cloud Segmentation via Multi-modal Visual Data

PanopticRecon: Leverage Open-vocabulary Instance Segmentation for Zero-shot Panoptic Reconstruction