Abstract:Modern deep neural networks are prone to learn domain-dependent shortcuts and thus usually suffer from severe performance degradation when tested in unseen target domains due to their poor ability of out-of-distribution generalization, which significantly limits the real-world applications. The main reason is the domain shift lying in the large distribution gap between source and unseen target data. To this end, this paper takes a step towards training robust models for domain generalizable visual tasks, which mainly focuses on learning domain-invariant visual representation to alleviate the domain shift. Specifically, we first propose an effective Hierarchical Visual Transformation (HVT) network to (1) first transform the training sample hierarchically into new domains with diverse distributions from three levels: Global, Local, and Pixel, (2) then maximize the visual discrepancy between the source domain and new domains, and minimize the cross-domain feature inconsistency to capture domain-invariant features. Besides, we further enhance the HVT network by introducing the environment-invariant learning. To be specific, we enforce the invariance of the visual representation across automatically inferred environments by minimizing invariant learning loss that considers the weighted average of environmental losses. In this way, we can prevent the model from relying on the spurious features for prediction, thus helping the model to effectively learn domain-invariant representation and narrow the domain gap in various visual matching and recognition tasks, such as stereo matching, pedestrian retrieval, and image classification. We term our extended HVT as EHVT to show distinction. We integrate our EHVT network into different models and evaluate its effectiveness and compatibility on several public benchmark datasets. Extensive experiments clearly show that our EHVT can substantially enhance the generalization performance in various tasks. Our codes are available at https://github.com/cty8998/EHVT-VisualDG.

Hierarchical Block Aggregation Network for Long-Tailed Visual Recognition

A Channel-Wise Spatial-Temporal Aggregation Network for Action Recognition

Hierarchical Gate Network for Fine-Grained Visual Recognition.

BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognition

A Deep Learning Model for Long-Tail Visual Recognition

Divide and Retain: A Dual-Phase Modeling for Long-Tailed Visual Recognition

Recurrent Aggregation Learning for Multi-View Echocardiographic Sequences Segmentation

Hierarchical Feature Aggregation Network for Deep Image Compression

Deep Long-Tailed Learning: A Survey

Long-Tailed Recognition by Hierarchical Rebalancing Dual-Classifier

NCL++: Nested Collaborative Learning for Long-Tailed Visual Recognition

Cascading Hierarchical Networks with Multi-task Balanced Loss for Fine-grained hashing

Feature-Balanced Loss for Long-Tailed Visual Recognition

Learning Hierarchical Visual Transformation for Domain Generalizable Visual Matching and Recognition

Long-tailed Visual Recognition with Deep Models: A Methodological Survey and Evaluation

Bag of Tricks for Long-Tailed Visual Recognition with Deep Convolutional Neural Networks

A Dual Progressive Strategy for Long-Tailed Visual Recognition

Bt-Vmf Contrastive and Collaborative Learning for Long-Tailed Visual Recognition

Feature Re-Balancing for Long-Tailed Visual Recognition.

Data-Driven Neuron Allocation for Scale Aggregation Networks