Abstract:Unsupervised representation learning aims at finding methods that learn representations from data without annotation-based signals. Abstaining from annotations not only leads to economic benefits but may - and to some extent already does - result in advantages regarding the representation's structure, robustness, and generalizability to different tasks. In the long run, unsupervised methods are expected to surpass their supervised counterparts due to the reduction of human intervention and the inherently more general setup that does not bias the optimization towards an objective originating from specific annotation-based signals. While major advantages of unsupervised representation learning have been recently observed in natural language processing, supervised methods still dominate in vision domains for most tasks. In this dissertation, we contribute to the field of unsupervised (visual) representation learning from three perspectives: (i) Learning representations: We design unsupervised, backpropagation-free Convolutional Self-Organizing Neural Networks (CSNNs) that utilize self-organization- and Hebbian-based learning rules to learn convolutional kernels and masks to achieve deeper backpropagation-free models. (ii) Evaluating representations: We build upon the widely used (non-)linear evaluation protocol to define pretext- and target-objective-independent metrics for measuring and investigating the objective function mismatch between various unsupervised pretext tasks and target tasks. (iii) Transferring representations: We contribute CARLANE, the first 3-way sim-to-real domain adaptation benchmark for 2D lane detection, and a method based on prototypical self-supervised learning. Finally, we contribute a content-consistent unpaired image-to-image translation method that utilizes masks, global and local discriminators, and similarity sampling to mitigate content inconsistencies.

Learning Generalizable Visual Representations via Self-Supervised Information Bottleneck.

MVEB: Self-Supervised Learning With Multi-View Entropy Bottleneck

Self-supervised Sequential Information Bottleneck for Robust Exploration in Deep Reinforcement Learning

Learning Unsupervised Gaze Representation via Eye Mask Driven Information Bottleneck

Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey

Disentangled Variational Information Bottleneck for Multiview Representation Learning

Scaling and Benchmarking Self-Supervised Visual Representation Learning

Learning Representations in Reinforcement Learning:An Information Bottleneck Approach

Self-Supervised Video Representation Learning with Motion-Contrastive Perception

Patch-Wise Self-Supervised Visual Representation Learning: A Fine-Grained Approach

Towards Unsupervised Representation Learning: Learning, Evaluating and Transferring Visual Representations

Deep Representation Learning for Domain Generalization with Information Bottleneck Principle

Learning to Learn with Variational Information Bottleneck for Domain Generalization

Self-labelling via simultaneous clustering and representation learning

Self-supervised Feature Learning by Cross-modality and Cross-view Correspondences

Exploring the Equivalence of Siamese Self-Supervised Learning Via A Unified Gradient Framework

Compressive Visual Representations

A Probabilistic Model Behind Self-Supervised Learning

Multi-View Information Bottleneck Without Variational Approximation

Self-Supervised Representation Learning From Multi-Domain Data