Abstract:Recent works on deep conditional random fields (CRFs) have set new records on many vision tasks involving structured predictions. Here, we propose a fully connected deep continuous CRF model with task-specific losses for both discrete and continuous labeling problems. We exemplify the usefulness of the proposed model on multi-class semantic labeling (discrete) and the robust depth estimation (continuous) problems. In our framework, we model both the unary and the pairwise potential functions as deep convolutional neural networks (CNNs), which are jointly learned in an end-to-end fashion. The proposed method possesses the main advantage of continuously valued CRFs, which is a closed-form solution for the maximum a posteriori (MAP) inference. To better take into account the quality of the predicted estimates during the cause of learning, instead of using the commonly employed maximum likelihood CRF parameter learning protocol, we propose task-specific loss functions for learning the CRF parameters. It enables direct optimization of the quality of the MAP estimates during the learning process. Specifically, we optimize the multi-class classification loss for the semantic labeling task and the Tukey's biweight loss for the robust depth estimation problem. Experimental results on the semantic labeling and robust depth estimation tasks demonstrate that the proposed method compare favorably against both baseline and state-of-the-art methods. In particular, we show that although the proposed deep CRF model is continuously valued, with the equipment of task-specific loss, it achieves impressive results even on discrete labeling tasks.

Conditional Random Fields with Decode-based Learning: Simpler and Faster

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Learning to Decode for Future Success

A Simple, Fast Diverse Decoding Algorithm for Neural Generation

Fast Structured Decoding for Sequence Models

A Fast Accurate Two-stage Training Algorithm for L1-regularized CRFs with Heuristic Line Search Strategy.

Efficient robust conditional random fields

Discriminative Training of Deep Fully Connected Continuous CRFs with Task-Specific Loss

Word Recognition with Deep Conditional Random Fields

Gradual Transition Detection with Conditional Random Fields.

Sequence Classification with Neural Conditional Random Fields

Conditional Random Fields for Image Labeling

Contrastive Feature Induction for Efficient Structure Learning of Conditional Random Fields.

A New Recurrent Neural CRF for Learning Non-linear Edge Features

Uncertainty-Aware Label Refinement for Sequence Labeling

Analyzing Sequence Data Based on Conditional Random Fields with Co-Training

A Projected Gradient Descent Method for CRF Inference allowing End-To-End Training of Arbitrary Pairwise Potentials

Uncertainty-Aware Sequence Labeling

Fast Chain-of-Thought: A Glance of Future from Parallel Decoding Leads to Answers Faster

Efficient Sdp Inference For Fully-Connected Crfs Based On Low-Rank Decomposition