Abstract:Recent works on deep conditional random fields (CRFs) have set new records on many vision tasks involving structured predictions. Here, we propose a fully connected deep continuous CRF model with task-specific losses for both discrete and continuous labeling problems. We exemplify the usefulness of the proposed model on multi-class semantic labeling (discrete) and the robust depth estimation (continuous) problems. In our framework, we model both the unary and the pairwise potential functions as deep convolutional neural networks (CNNs), which are jointly learned in an end-to-end fashion. The proposed method possesses the main advantage of continuously valued CRFs, which is a closed-form solution for the maximum a posteriori (MAP) inference. To better take into account the quality of the predicted estimates during the cause of learning, instead of using the commonly employed maximum likelihood CRF parameter learning protocol, we propose task-specific loss functions for learning the CRF parameters. It enables direct optimization of the quality of the MAP estimates during the learning process. Specifically, we optimize the multi-class classification loss for the semantic labeling task and the Tukey's biweight loss for the robust depth estimation problem. Experimental results on the semantic labeling and robust depth estimation tasks demonstrate that the proposed method compare favorably against both baseline and state-of-the-art methods. In particular, we show that although the proposed deep CRF model is continuously valued, with the equipment of task-specific loss, it achieves impressive results even on discrete labeling tasks.

A Fast Accurate Two-stage Training Algorithm for L1-regularized CRFs with Heuristic Line Search Strategy.

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Efficient robust conditional random fields

Conditional Random Fields with Decode-based Learning: Simpler and Faster

A Comparison and Improvement of Online Learning Algorithms for Sequence Labeling.

A Two-stage Sparse Optimization Algorithm for Gated Recurrent Units Estimators

Contrastive Feature Induction for Efficient Structure Learning of Conditional Random Fields.

Loopless Semi-Stochastic Gradient Descent with Less Hard Thresholding for Sparse Learning

Rectified Linear Neural Networks with Tied-Scalar Regularization for LVCSR

Fast Online Training with Frequency-Adaptive Learning Rates for Chinese Word Segmentation and New Word Detection

Variable step-size convex regularized PRLS algorithms

Feature-Frequency-Adaptive On-Line Training for Fast and Accurate Natural Language Processing

Improving Sparsity and Scalability in Regularized Nonconvex Truncated-Loss Learning Problems

Mitigating Forgetting in LLM Supervised Fine-Tuning and Preference Learning

Towards easier and faster sequence labeling for natural language processing: A search-based probabilistic online learning framework (SAPO)

Learning-rate-free Momentum SGD with Reshuffling Converges in Nonsmooth Nonconvex Optimization

Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning

Hierarchical Particle Swarm Optimization-incorporated Latent Factor Analysis for Large-Scale Incomplete Matrices

Discriminative Training of Deep Fully Connected Continuous CRFs with Task-Specific Loss

Regularized Loss With Hyperparameter Estimation for Weakly Supervised Single Class Segmentation