Abstract:Robots typically possess sensors of different modalities, such as colour cameras, inertial measurement units, and 3D laser scanners. Often, solving a particular problem becomes easier when more than one modality is used. However, while there are undeniable benefits to combine sensors of different modalities the process tends to be complicated. Segmenting scenes observed by the robot into a discrete set of classes is a central requirement for autonomy as understanding the scene is the first step to reason about future situations. Scene segmentation is commonly performed using either image data or 3D point cloud data. In computer vision many successful methods for scene segmentation are based on conditional random fields (CRF) where the maximum a posteriori (MAP) solution to the segmentation can be obtained by inference. In this paper we devise a new CRF inference method for scene segmentation that incorporates global constraints, enforcing the sets of nodes are assigned the same class label. To do this efficiently, the CRF is formulated as a relaxed quadratic program whose MAP solution is found using a gradient-based optimisation approach. The proposed method is evaluated on images and 3D point cloud data gathered in urban environments where image data provides the appearance features needed by the CRF, while the 3D point cloud data provides global spatial constraints over sets of nodes. Comparisons with belief propagation, conventional quadratic programming relaxation, and higher order potential CRF show the benefits of the proposed method.

A probabilistic patch based image representation using Conditional Random Field model for image classification

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Image Binarization Based on Conditional Random Fields

Conditional Random Fields for Image Labeling

Context-based conditional random fields as recurrent neural networks for image labeling

Scene description based on the conditional random fields model

Reducing Reconstruction Error of Classified Textural Patches by Integration of Random Forests and Coupled Dictionary Nonlinear Regressors: with Applications to Super-Resolution of Abdominal CT Images

A new Laplacian mixture conditional random field model for image labeling

Conditional Random Fields for Image Region Labeling with Global Observation.

PProCRC: Probabilistic Collaboration of Image Patches

Image labeling based on fully-connected conditional random field

Semantic Conditional Random Field for Object Based SAR Image Segmentation.

Object Codetection Based on a Higher-Order Conditional Random Field

A Novel Hyperspectral Remote Sensing Images Classification Using Gaussian Processes with Conditional Random Fields

Image Semantic Segmentation Optimization by Conditional Random Field Integrated with Object Clique Potential.

Conditional Random Field and Deep Feature Learning for Hyperspectral Image Classification

A New Image Labeling Method Based on Content-Based Image Retrieval and Conditional Random Field

Urban Scene Segmentation with Laser-Constrained CRFs

Generalized Gaussian mixture Conditional Random Field model for image labeling

A fast, weighted CRF algorithm based on a two-step superpixel generation for SAR image segmentation

CRF Learning with CNN Features for Image Segmentation