Abstract:Nonlinear regression has been extensively employed in many computer vision problems (e.g., crowd counting, age estimation, affective computing). Under the umbrella of deep learning, two common solutions exist i) transforming nonlinear regression to a robust loss function which is jointly optimizable with the deep convolutional network, and ii) utilizing ensemble of deep networks. Although some improved performance is achieved, the former may be lacking due to the intrinsic limitation of choosing a single hypothesis and the latter may suffer from much larger computational complexity. To cope with those issues, we propose to regress via an efficient "divide and conquer" manner. The core of our approach is the generalization of negative correlation learning that has been shown, both theoretically and empirically, to work well for non-deep regression problems. Without extra parameters, the proposed method controls the bias-variance-covariance trade-off systematically and usually yields a deep regression ensemble where each base model is both "accurate" and "diversified." Moreover, we show that each sub-problem in the proposed method has less Rademacher Complexity and thus is easier to optimize. Extensive experiments on several diverse and challenging tasks including crowd counting, personality analysis, age estimation, and image super-resolution demonstrate the superiority over challenging baselines as well as the versatility of the proposed method. The source code and trained models are available on our project page: https://mmcheng.net/dncl/.

The Research of Artificial Neural Network on Negative Correlation Learning

Multiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning.

Regularized Negative Correlation Learning for Neural Network Ensembles

Deep Negative Correlation Classification

Evolutionary Random Neural Ensembles Based on Negative Correlation Learning

Nonlinear Regression via Deep Negative Correlation Learning

A hybrid ensemble method with negative correlation learning for regression

Robust Regression Via Deep Negative Correlation Learning

NeuralAC: Learning Cooperation and Competition Effects for Match Outcome Prediction.

Algorithms for Exploiting Negative Correlation

Fast Decorrelated Neural Network Ensembles with Random Weights

Research Ideas Discovery Via Hierarchical Negative Correlation

Incremental Negative Correlation Learning with Evolutionary Selection of Parameters

Research and Application on BP Neural Network Algorithm

A Constructive Algorithm for Training Neural Network Ensemble

Negative Correlation Learning for Classification Ensembles.

Enhancement of Weak Signal Detection in Parallel Arrays of Integrate-And-Fire Neurons by Negative Spatial Correlation

Negatively correlated ensemble against transfer adversarial attacks

Defending Adversarial Examples by Negative Correlation Ensemble

Semisupervised Negative Correlation Learning

On the Versatile Uses of Partial Distance Correlation in Deep Learning