Abstract:Many computer vision tasks can be posed as either a graph part itioning (segmentation) problem or a graph matching (correspondence) problem. In this paper, we present an integrated solution for simultaneous graph partition and matching with graph editing. Our object ive is to find and match an unknown number of common graph structures (objects) in two images – a problem a rising in recent object recognition research, such as object categorization and unsupervised learning. U like previous segmentation and correspondence problems motivated by large motion or wide baseline stereo, the scenes and objects in the two images may have quite different appearance but share similar graphic s tru tures. Given two images, we first extract their primal sketches [11] as attributed graphs which repre sent both textures (by key points) and structures (by line segments and primitives). The points, line segment s, and primitives are vertices of the graphs. Both graphs are partitioned into K + 1 layers of subgraphs so that K pairs of subgraphs are matched and the remaining layer contains unmatched background. Eac h p ir of matched subgraphs represent a common object under geometric deformations and structural editing with graph operators. We design a data-driven Markov Chain Monte Carlo (DDMCMC) algorithm to explore the joint partition and matching space effectively. It has two iterative components: (i) A Sw endsen-Wang Cut component in the partition space that can flip, in each step, a chunk (connected componen t) of the graph where the vertices are often strongly coupled due to proximity and similar appeara nce; (ii) A Gibbs sampling step for matching some connected components to the other graph. To prune the ma tching space, we grow a number of vertices to form some connected components so that each conn e ted component has a small number of candidate matches. We apply the algorithm to a number of appl ications with comparison to the state of the art methods: (i) multi-object wide-baseline matching (und erlying both rigid and non-rigid motions) with occlusions , (ii) automatic detection and recognition of co mmon objects from templates, and (iii) human articulate motion analysis between images from a video sequ ence. Index Terms Graph Matching, Graph Partitioning, DDMCMC, Motion Analys is, Swendsen-Wang Cut. This manuscript is submitted to IEEE Trans. on PAMI. A short version was published in CVPR2007 [14]. email contacts: llin@lotushill.org, xbliu@lotushill.orgxbliu@lotushill.org, sczhu@stat.ucla.edu

Joint Cuts and Matching of Partitions in One Graph

Matching Images Based on Consistency Graph and Region Adjacency Graphs.

Integrating Graph Partition and Matching with Editing

Joint Optimization for Consistent Multiple Graph Matching

Layered Graph Match with Graph Editing

Partial Gromov-Wasserstein Learning for Partial Graph Matching

Joint Tree of Combinatorial Maps.

Graph Based Image Matching

Toward More Robust Graph Matching : Models and Algorithms

A Short Survey Of Recent Advances In Graph Matching

Matching (Multi)Cut: Algorithms, Complexity, and Enumeration

Multiple Graph Matching and Clustering via Decayed Pairwise Matching Composition

An Evaluation of Recent Graph Matching Algorithms

Efficient joint object matching via linear programming

From One to All: Learning to Match Heterogeneous and Partially Overlapped Graphs

A Matrix Decomposition Perspective to Multiple Graph Matching

Graduated Consistency-Regularized Optimization For Multi-Graph Matching

A survey on graph matching algorithms in computer vision

Algorithm for Images Matching Based on Graph Cut and Epipolar Geometric Constraint

On the convergence of graph matching: graduated assignment revisited

Learning Combinatorial Solver for Graph Matching