Abstract:Unsupervised representation learning aims at finding methods that learn representations from data without annotation-based signals. Abstaining from annotations not only leads to economic benefits but may - and to some extent already does - result in advantages regarding the representation's structure, robustness, and generalizability to different tasks. In the long run, unsupervised methods are expected to surpass their supervised counterparts due to the reduction of human intervention and the inherently more general setup that does not bias the optimization towards an objective originating from specific annotation-based signals. While major advantages of unsupervised representation learning have been recently observed in natural language processing, supervised methods still dominate in vision domains for most tasks. In this dissertation, we contribute to the field of unsupervised (visual) representation learning from three perspectives: (i) Learning representations: We design unsupervised, backpropagation-free Convolutional Self-Organizing Neural Networks (CSNNs) that utilize self-organization- and Hebbian-based learning rules to learn convolutional kernels and masks to achieve deeper backpropagation-free models. (ii) Evaluating representations: We build upon the widely used (non-)linear evaluation protocol to define pretext- and target-objective-independent metrics for measuring and investigating the objective function mismatch between various unsupervised pretext tasks and target tasks. (iii) Transferring representations: We contribute CARLANE, the first 3-way sim-to-real domain adaptation benchmark for 2D lane detection, and a method based on prototypical self-supervised learning. Finally, we contribute a content-consistent unpaired image-to-image translation method that utilizes masks, global and local discriminators, and similarity sampling to mitigate content inconsistencies.

Unsupervisedly Learned Representations: Should the Quest be Over?

Unsupervised Representation Learning in Partially Observable Atari Games

Unsupervised Representation Learning in Deep Reinforcement Learning: A Review

Unsupervised Control Through Non-Parametric Discriminative Rewards

Reinforcement Learning with Unsupervised Auxiliary Tasks

Towards Unsupervised Representation Learning: Learning, Evaluating and Transferring Visual Representations

Unsupervised State Representation Learning in Atari

NavRep: Unsupervised Representations for Reinforcement Learning of Robot Navigation in Dynamic Human Environments

Is 'Unsupervised Learning' a Misconceived Term?

Must Unsupervised Continual Learning Relies on Previous Information?

The Clever Hans Effect in Unsupervised Learning

Revisiting Supervision for Continual Representation Learning

The Next Big Thing(s) in Unsupervised Machine Learning: Five Lessons from Infant Learning

Effective Representation Learning is More Effective in Reinforcement Learning Than You Think

A Computational Model of Representation Learning in the Brain Cortex, Integrating Unsupervised and Reinforcement Learning

A Survey on Self-Supervised Representation Learning

Unified Representations for Learning and Reasoning

Demystifying unsupervised learning: how it helps and hurts

From Centralized to Self-Supervised: Pursuing Realistic Multi-Agent Reinforcement Learning

Rethinking Generalizability and Discriminability of Self-Supervised Learning from Evolutionary Game Theory Perspective

Unsupervised learning by competing hidden units