Abstract:Successful image classification requires a discriminative representation learning model for images. To approach this idea, deep metric learning (DML), serving as building a basic feature space with a pre-defined metric, has demonstrated compelling performance over the years. DML is often implemented with a carefully crafted loss function, such as the representative triplet loss, which encourages a positive sample to be by a fixed margin closer to the anchor than the negative. Despite its efficacy, the negative samples are treated uniformly, rendering the feature space less informative since different negative samples can be largely different from the anchor. In this work, we, for the first time, propose to exploit the semantic information inherent in discrete class labels as an aid for the triplet loss. Specifically, we build a bi-level negative sampling strategy, i . e ., strong negative and weak negative sampling, with the guidance of an external knowledge source, from which rich class semantics can be extracted. With several fine-grained and complementary triplet losses based on this strategy, our method is enhanced with semantic awareness for image classification. In addition, to coordinate with the complicated training dynamics, we devise an ad-hoc Semantic Relation Weighting module, which consistently inspects model states and dynamically adjusts the importance of each triplet loss. It is worth noting that our method is plug-and-play, and we thus test its validity over various backbones and knowledge sources. Both qualitative and quantitative experimental results on benchmark datasets demonstrate the effectiveness of employing semantics for image classification.

A Semantic Loss Function for Deep Learning under Weak Supervision

A Semantic Loss Function for Deep Learning with Symbolic Knowledge

A s emantic l oss f unction for d eep l earning with s ymbolic k nowledge

Chapter 22. Semantic Loss Functions for Neuro-Symbolic Structured Prediction

Semantic Strengthening of Neuro-Symbolic Learning

Semantic and Generalized Entropy Loss Functions for Semi-Supervised Deep Learning

Semantic Objective Functions: A distribution-aware method for adding logical constraints in deep learning

Semantic Softmax Loss for Zero-Shot Learning

A Novel Multi-Loss-Based Deep Adversarial Network For Handling Challenging Cases In Semi-Supervised Image Semantic Segmentation

Weakly Supervised Neural Symbolic Learning for Cognitive Tasks

Weakly Supervised Reasoning by Neuro-Symbolic Approaches

Learning with Logical Constraints but without Shortcut Satisfaction

Semantic-Aware Triplet Loss for Image Classification.

A Pseudo-Semantic Loss for Autoregressive Models with Logical Constraints

Regularized Loss for Weakly Supervised Single Class Semantic Segmentation

Semantic Correlations Loss: Improving Model Interpretability for Multi-class Classification.

An Experimental Study of Semantic Continuity for Deep Learning Models

Group-Wise Semantic Mining for Weakly Supervised Semantic Segmentation

Semantic Loss Application to Entity Relation Recognition

Weakly-Supervised Semantic Segmentation Network with Deep Seeded Region Growing

Symbolic-AI-Fusion Deep Learning (SAIF-DL): Encoding Knowledge into Training with Answer Set Programming Loss Penalties by a Novel Loss Function Approach