Abstract:Deep learning typically requires training a very capable architecture using large datasets. However, many important learning problems demand an ability to draw valid inferences from small size datasets, and such problems pose a particular challenge for deep learning. In this regard, various researches on "meta-learning" are being actively conducted. Recent work has suggested a Memory Augmented Neural Network (MANN) for meta-learning. MANN is an implementation of a Neural Turing Machine (NTM) with the ability to rapidly assimilate new data in its memory, and use this data to make accurate predictions. In models such as MANN, the input data samples and their appropriate labels from previous step are bound together in the same memory locations. This often leads to memory interference when performing a task as these models have to retrieve a feature of an input from a certain memory location and read only the label information bound to that location. In this paper, we tried to address this issue by presenting a more robust MANN. We revisited the idea of meta-learning and proposed a new memory augmented neural network by explicitly splitting the external memory into feature and label memories. The feature memory is used to store the features of input data samples and the label memory stores their labels. Hence, when predicting the label of a given input, our model uses its feature memory unit as a reference to extract the stored feature of the input, and based on that feature, it retrieves the label information of the input from the label memory unit. In order for the network to function in this framework, a new memory-writingmodule to encode label information into the label memory in accordance with the meta-learning task structure is designed. Here, we demonstrate that our model outperforms MANN by a large margin in supervised one-shot classification tasks using Omniglot and MNIST datasets.

Semi Supervised Meta Learning for Spatiotemporal Learning

Masked Autoencoders As Spatiotemporal Learners

Self-supervised Video Representation Learning with Motion-Aware Masked Autoencoders

Concatenated Masked Autoencoders as Spatial-Temporal Learner

Graph Masked Autoencoder for Spatio-Temporal Graph Learning

Temporally-Embedded Self-Supervised Video Representation Learning

Unsupervised Representation Learning to Aid Semi-Supervised Meta Learning

AdaMAE: Adaptive Masking for Efficient Spatiotemporal Learning with Masked Autoencoders

Spatial-Temporal-Decoupled Masked Pre-training for Spatiotemporal Forecasting

Unsupervised Meta-Learning for Reinforcement Learning

Temporal Embeddings: Scalable Self-Supervised Temporal Representation Learning from Spatiotemporal Data for Multimodal Computer Vision

CMVAE: Causal Meta VAE for Unsupervised Meta-Learning.

T-MAE: Temporal Masked Autoencoders for Point Cloud Representation Learning

Self-Supervised Video Representation Learning with Meta-Contrastive Network

Forecast-MAE: Self-supervised Pre-training for Motion Forecasting with Masked Autoencoders

SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders

Multimodal Meta-Learning for Time Series Regression

Downstream Task Guided Masking Learning in Masked Autoencoders Using Multi-Level Optimization

Meta-Learning via Feature-Label Memory Network

SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery

Towards Transferable Multi-modal Perception Representation Learning for Autonomy: NeRF-Supervised Masked AutoEncoder