Abstract:Many computer vision tasks can be posed as either a graph part itioning (segmentation) problem or a graph matching (correspondence) problem. In this paper, we present an integrated solution for simultaneous graph partition and matching with graph editing. Our object ive is to find and match an unknown number of common graph structures (objects) in two images – a problem a rising in recent object recognition research, such as object categorization and unsupervised learning. U like previous segmentation and correspondence problems motivated by large motion or wide baseline stereo, the scenes and objects in the two images may have quite different appearance but share similar graphic s tru tures. Given two images, we first extract their primal sketches [11] as attributed graphs which repre sent both textures (by key points) and structures (by line segments and primitives). The points, line segment s, and primitives are vertices of the graphs. Both graphs are partitioned into K + 1 layers of subgraphs so that K pairs of subgraphs are matched and the remaining layer contains unmatched background. Eac h p ir of matched subgraphs represent a common object under geometric deformations and structural editing with graph operators. We design a data-driven Markov Chain Monte Carlo (DDMCMC) algorithm to explore the joint partition and matching space effectively. It has two iterative components: (i) A Sw endsen-Wang Cut component in the partition space that can flip, in each step, a chunk (connected componen t) of the graph where the vertices are often strongly coupled due to proximity and similar appeara nce; (ii) A Gibbs sampling step for matching some connected components to the other graph. To prune the ma tching space, we grow a number of vertices to form some connected components so that each conn e ted component has a small number of candidate matches. We apply the algorithm to a number of appl ications with comparison to the state of the art methods: (i) multi-object wide-baseline matching (und erlying both rigid and non-rigid motions) with occlusions , (ii) automatic detection and recognition of co mmon objects from templates, and (iii) human articulate motion analysis between images from a video sequ ence. Index Terms Graph Matching, Graph Partitioning, DDMCMC, Motion Analys is, Swendsen-Wang Cut. This manuscript is submitted to IEEE Trans. on PAMI. A short version was published in CVPR2007 [14]. email contacts: llin@lotushill.org, xbliu@lotushill.orgxbliu@lotushill.org, sczhu@stat.ucla.edu

Bipartite Graph Matching for Keyframe Summary Evaluation

A Novel Compact Yet Rich Key Frame Creation Method for Compressed Video Summarization

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

An Interactive Personalized Video Summarization Based on Sketches.

A Graph-based Ranking Approach to Extract Key-frames for Static Video Summarization

Fast Graph Sampling for Short Video Summarization using Gershgorin Disc Alignment

Multi-video Summarization Using Complex Graph Clustering and Mining.

Movie Summarization via Sparse Graph Construction

Large Model based Sequential Keyframe Extraction for Video Summarization

Object Segmentation and Key-Pose Based Summarization for Motion Video

Unsupervised video summarization framework using keyframe extraction and video skimming

Eratosthenes sieve based key-frame extraction technique for event summarization in videos

Multi-View Video Summarization

Layered Graph Match with Graph Editing

VideoSAGE: Video Summarization with Graph Representation Learning

FrameRank: A Text Processing Approach to Video Summarization

Integrating Graph Partition and Matching with Editing

Clip-based Similarity Measure for Query-Dependent Clip Retrieval and Video Summarization.

Graph Unfolding and Sampling for Transitory Video Summarization via Gershgorin Disc Alignment

Hot event detection and summarization by graph modeling and matching

Clip based video summarization and ranking