Abstract:Many computer vision tasks can be posed as either a graph part itioning (segmentation) problem or a graph matching (correspondence) problem. In this paper, we present an integrated solution for simultaneous graph partition and matching with graph editing. Our object ive is to find and match an unknown number of common graph structures (objects) in two images – a problem a rising in recent object recognition research, such as object categorization and unsupervised learning. U like previous segmentation and correspondence problems motivated by large motion or wide baseline stereo, the scenes and objects in the two images may have quite different appearance but share similar graphic s tru tures. Given two images, we first extract their primal sketches [11] as attributed graphs which repre sent both textures (by key points) and structures (by line segments and primitives). The points, line segment s, and primitives are vertices of the graphs. Both graphs are partitioned into K + 1 layers of subgraphs so that K pairs of subgraphs are matched and the remaining layer contains unmatched background. Eac h p ir of matched subgraphs represent a common object under geometric deformations and structural editing with graph operators. We design a data-driven Markov Chain Monte Carlo (DDMCMC) algorithm to explore the joint partition and matching space effectively. It has two iterative components: (i) A Sw endsen-Wang Cut component in the partition space that can flip, in each step, a chunk (connected componen t) of the graph where the vertices are often strongly coupled due to proximity and similar appeara nce; (ii) A Gibbs sampling step for matching some connected components to the other graph. To prune the ma tching space, we grow a number of vertices to form some connected components so that each conn e ted component has a small number of candidate matches. We apply the algorithm to a number of appl ications with comparison to the state of the art methods: (i) multi-object wide-baseline matching (und erlying both rigid and non-rigid motions) with occlusions , (ii) automatic detection and recognition of co mmon objects from templates, and (iii) human articulate motion analysis between images from a video sequ ence. Index Terms Graph Matching, Graph Partitioning, DDMCMC, Motion Analys is, Swendsen-Wang Cut. This manuscript is submitted to IEEE Trans. on PAMI. A short version was published in CVPR2007 [14]. email contacts: llin@lotushill.org, xbliu@lotushill.orgxbliu@lotushill.org, sczhu@stat.ucla.edu

Robust Common Visual Pattern Discovery Using Graph Matching

Matching Images Based on Consistency Graph and Region Adjacency Graphs.

Common Visual Pattern Discovery Via Nonlinear Mean Shift Clustering

Hierarchical Clustering Matching for Features with Repetitive Patterns in Visual Odometry

Realtime and Robust Object Matching with a Large Number of Templates

Realtime object matching with robust dominant orientation templates

Efficient Covisibility-based Image Matching for Large-Scale SfM

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

Integrating Graph Partition and Matching with Editing

Feature Matching via Graph Clustering with Local Affine Consensus

Graph Based Image Matching

Fast and Robust Spatial Matching for Object Retrieval

A More Robust Feature Correspondence for more Accurate Image Recognition

Image Correspondence With CUR Decomposition-Based Graph Completion and Matching

Robust Image Matching Via Local Graph Structure Consensus

Layered Graph Match with Graph Editing

Transfer Vision Patterns for Multi-Task Pixel Learning.

A Branch-and-Bound Approach to Correspondence and Grouping Problems

A Geometric Reasoning Based Algorithm for Point Pattern Matching

Invariant Visual Patterns for Video Copy Detection

Shape Profile Matching and Its Applications