Abstract:Modern deep neural networks are prone to learn domain-dependent shortcuts and thus usually suffer from severe performance degradation when tested in unseen target domains due to their poor ability of out-of-distribution generalization, which significantly limits the real-world applications. The main reason is the domain shift lying in the large distribution gap between source and unseen target data. To this end, this paper takes a step towards training robust models for domain generalizable visual tasks, which mainly focuses on learning domain-invariant visual representation to alleviate the domain shift. Specifically, we first propose an effective Hierarchical Visual Transformation (HVT) network to (1) first transform the training sample hierarchically into new domains with diverse distributions from three levels: Global, Local, and Pixel, (2) then maximize the visual discrepancy between the source domain and new domains, and minimize the cross-domain feature inconsistency to capture domain-invariant features. Besides, we further enhance the HVT network by introducing the environment-invariant learning. To be specific, we enforce the invariance of the visual representation across automatically inferred environments by minimizing invariant learning loss that considers the weighted average of environmental losses. In this way, we can prevent the model from relying on the spurious features for prediction, thus helping the model to effectively learn domain-invariant representation and narrow the domain gap in various visual matching and recognition tasks, such as stereo matching, pedestrian retrieval, and image classification. We term our extended HVT as EHVT to show distinction. We integrate our EHVT network into different models and evaluate its effectiveness and compatibility on several public benchmark datasets. Extensive experiments clearly show that our EHVT can substantially enhance the generalization performance in various tasks. Our codes are available at https://github.com/cty8998/EHVT-VisualDG.

Holons Visual Representation for Image Retrieval.

Aggregating Hierarchical Binary Activations for Image Retrieval

Image Representation Optimization Based on Locally Aggregated Descriptors.

Hierarchical Multi-Vlad For Image Retrieval

Hybrid Histogram Descriptor: A Fusion Feature Representation For Image Retrieval

Fine-residual VLAD for Image Retrieval.

Learning General Feature Descriptor for Visual Measurement with Hierarchical View Consistency

Group Invariant Deep Representations for Image Instance Retrieval

Boosting VLAD with Supervised Dictionary Learning and High-Order Statistics.

Making Residual Vector Distribution Uniform for Distinctive Image Representation

Learning Token-Based Representation for Image Retrieval

A Hyperdimensional One Place Signature to Represent Them All: Stackable Descriptors For Visual Place Recognition

Learning Hierarchical Visual Transformation for Domain Generalizable Visual Matching and Recognition

Learning Enriched Feature Descriptor for Image Matching and Visual Measurement

HVS Revisited: A Comprehensive Video Quality Assessment Framework

SERVE: Soft and Equalized Residual VEctors for Image Retrieval

Feature Fusion for Image Retrieval with Adaptive Bitrate Allocation and Hard Negative Mining.

Dynamic in Static: Hybrid Visual Correspondence for Self-Supervised Video Object Segmentation

SPA: Spatially Pooled Attributes for Image Retrieval.

pVLAD: A discriminative image descriptor for image retrieval

Image Retrieval Using the Fused Perceptual Color Histogram