Abstract:Recent works on deep conditional random fields (CRFs) have set new records on many vision tasks involving structured predictions. Here, we propose a fully connected deep continuous CRF model with task-specific losses for both discrete and continuous labeling problems. We exemplify the usefulness of the proposed model on multi-class semantic labeling (discrete) and the robust depth estimation (continuous) problems. In our framework, we model both the unary and the pairwise potential functions as deep convolutional neural networks (CNNs), which are jointly learned in an end-to-end fashion. The proposed method possesses the main advantage of continuously valued CRFs, which is a closed-form solution for the maximum a posteriori (MAP) inference. To better take into account the quality of the predicted estimates during the cause of learning, instead of using the commonly employed maximum likelihood CRF parameter learning protocol, we propose task-specific loss functions for learning the CRF parameters. It enables direct optimization of the quality of the MAP estimates during the learning process. Specifically, we optimize the multi-class classification loss for the semantic labeling task and the Tukey's biweight loss for the robust depth estimation problem. Experimental results on the semantic labeling and robust depth estimation tasks demonstrate that the proposed method compare favorably against both baseline and state-of-the-art methods. In particular, we show that although the proposed deep CRF model is continuously valued, with the equipment of task-specific loss, it achieves impressive results even on discrete labeling tasks.

Semi-supervised training for conditional random fields with pseudo auxiliary task.

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Training Conditional Random Fields Using Transfer Learning for Gesture Recognition

Feature Learning for Conditional Random Fields and its Application to Gesture Recognition

Semi-Markov Conditional Random Fields for sequence labeling

Semi-supervised learning for image annotation based on conditional random fields

Hybrid Semi-Markov CRF for Neural Sequence Labeling.

Exploring Segment Representations for Neural Semi-Markov Conditional Random Fields

Learning with Annotation of Various Degrees

Masked Conditional Random Fields for Sequence Labeling

Upgrading CRFS to JRFS and Its Benefits to Sequence Modeling and Labeling.

Chinese Named Entity Recognition with the Improved Smoothed Conditional Random Fields

Semi-Supervised Mesh Segmentation and Labeling

Discriminative Training of Deep Fully-connected Continuous CRF with Task-specific Loss

Discriminative Training of Deep Fully Connected Continuous CRFs with Task-Specific Loss

Hybrid Neural Conditional Random Fields for Multi-View Sequence Labeling

Sequence Classification with Neural Conditional Random Fields

Sparse Higher Order Conditional Random Fields for Improved Sequence Labeling.

Neural-Hidden-CRF: A Robust Weakly-Supervised Sequence Labeler.

Segment-Level Sequence Modeling Using Gated Recursive Semi-Markov Conditional Random Fields