Abstract:Weakly supervised object detection (WSOD) aims to train detectors using only image-category labels. Current methods typically first generate dense class-agnostic proposals and then select objects based on the classification scores of these proposals. These methods mainly focus on selecting the proposal having high Intersection-over-Union with the true object location, while ignoring the problem of misclassification, which occurs when some proposals exhibit semantic similarities with objects from other categories due to viewing perspective and background interference. We observe that the positive class that is misclassified typically has the following two characteristics: 1) It is usually misclassified as one or a few specific negative classes, and the scores of these negative classes are high; 2) Compared to other negative classes, the score of the positive class is relatively high. Based on these two characteristics, we propose misclassification correction (MCC) and misclassification tolerance (MCT) respectively. In MCC, we establish a misclassification memory bank to record and summarize the class-pairs with high frequencies of potential misclassifications in the early stage of training, that is, cases where the score of a negative class is significantly higher than that of the positive class. In the later stage of training, when such cases occur and correspond to the summarized class-pairs, we select the top-scoring negative class proposal as the positive training example. In MCT, we decrease the loss weights of misclassified classes in the later stage of training to avoid them dominating training and causing misclassification of objects from other classes that are semantically similar to them during inference. Extensive experiments on the PASCAL VOC and MS COCO demonstrate our method can alleviate the problem of misclassification and achieve the state-of-the-art results.

Cost-Sensitive Multi-Granularity Sequential Three-Way Decision for Object Detection

Sequential three-way decision and granulation for cost-sensitive face recognition

Multi-granularity cost-sensitive three-way decision for face recognition

Cost-sensitive Sequential Three-Way Decision Modeling Using a Deep Neural Network

Co-Training Based Sequential Three-Way Decisions for Cost-Sensitive Classification.

Cost-Sensitive Three-Way Decision: A Sequential Strategy

Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection

Sequential Three-Way Decision Based on Multi-Granular Autoencoder Features.

Cost-sensitive Rough Set: A Multi-Granulation Approach

Semi-Supervised Incremental Three-Way Decision Using Convolutional Neural Network

Sequential Three-Way Classifier with Justifiable Granularity

A Multiphase Cost-Sensitive Learning Method Based on the Multiclass Three-Way Decision-Theoretic Rough Set Model

An Efficient Ungrouped Mask Method with Two Learnable Parameters for 3D Object Detection

Incremental Sequential Three-Way Decision Using a Deep Stacked Autoencoder.

A Decision-Theoretic Rough Set Approach To Multi-Class Cost-Sensitive Classification

Misclassification in Weakly Supervised Object Detection

Rethinking the Detection Head Configuration for Traffic Object Detection

Matching strategy and skip-scale head configuration guideline based traffic object detection

Cost-Sensitive Uncertainty-Based Failure Recognition for Object Detection

Cost-Sensitive Alternating Direction Method Of Multipliers For Large-Scale Classification

Group Cost-Sensitive Boosting For Multi-Resolution Pedestrian Detection