Abstract:Curriculum learning and self-paced learning are the training strategies that gradually feed the samples from easy to more complex. They have captivated increasing attention due to their excellent performance in robotic vision. Most recent works focus on designing curricula based on difficulty levels in input samples or smoothing the feature maps. However, smoothing labels to control the learning utility in a curriculum manner is still unexplored. In this work, we design a paced curriculum by label smoothing (P-CBLS) using paced learning with uniform label smoothing (ULS) for classification tasks and fuse uniform and spatially varying label smoothing (SVLS) for semantic segmentation tasks in a curriculum manner. In ULS and SVLS, a bigger smoothing factor value enforces a heavy smoothing penalty in the true label and limits learning less information. Therefore, we design the curriculum by label smoothing (CBLS). We set a bigger smoothing value at the beginning of training and gradually decreased it to zero to control the model learning utility from lower to higher. We also designed a confidence-aware pacing function and combined it with our CBLS to investigate the benefits of various curricula. The proposed techniques are validated on four robotic surgery datasets of multi-class, multi-label classification, captioning, and segmentation tasks. We also investigate the robustness of our method by corrupting validation data into different severity levels. Our extensive analysis shows that the proposed method improves prediction accuracy and robustness. The code is publicly available at https://github.com/XuMengyaAmy/P-CBLS. Note to Practitioners—The motivation of this article is to improve the performance and robustness of deep neural networks in safety-critical applications such as robotic surgery by controlling the learning ability of the model in a curriculum learning manner and allowing the model to imitate the cognitive process of humans and animals. The designed approaches do not add parameters that require additional computational resources.

A Theoretical Understanding of Self-Paced Learning

What Objective Does Self-paced Learning Indeed Optimize?

On Convergence Properties of Implicit Self-paced Objective

Multi-Objective Self-Paced Learning

Self-paced Learning with Diversity

Self-paced Learning with Privileged Information.

Understanding Self-Paced Learning Under Concave Conjugacy Theory

Finding Age Path of Self-Paced Learning

Self-paced Learning Method with Adaptive Mixture Weighting

Decomposition-Based Evolutionary Multiobjective Optimization to Self-Paced Learning

Multi-modal Self-Paced Learning for Image Classification

Pareto Self-Paced Learning Based on Differential Evolution

Weighted Self-Paced Learning with Belief Functions

Self-Prompting Perceptual Edge Learning for Dense Prediction

SPLBoost: An Improved Robust Boosting Algorithm Based on Self-Paced Learning

Scene Prior Constrained Self-Paced Learning for Unsupervised Satellite Video Vehicle Detection

Why Curriculum Learning & Self-Paced Learning Work in Big/noisy Data: A Theoretical Perspective

Pixel-level self-paced learning for super-resolution

Confidence-Aware Paced-Curriculum Learning by Label Smoothing for Surgical Scene Understanding

Self-Paced Deep Regression Forests with Consideration on Ranking Fairness

Active Self-Paced Learning for Cost-Effective and Progressive Face Identification