Abstract:With the attention mechanism, transformers achieve significant empirical successes. Despite the intuitive understanding that transformers perform relational inference over long sequences to produce desirable representations, we lack a rigorous theory on how the attention mechanism achieves it. In particular, several intriguing questions remain open: (a) What makes a desirable representation? (b) How does the attention mechanism infer the desirable representation within the forward pass? (c) How does a pretraining procedure learn to infer the desirable representation through the backward pass? We observe that, as is the case in BERT and ViT, input tokens are often exchangeable since they already include positional encodings. The notion of exchangeability induces a latent variable model that is invariant to input sizes, which enables our theoretical analysis. - To answer (a) on representation, we establish the existence of a sufficient and minimal representation of input tokens. In particular, such a representation instantiates the posterior distribution of the latent variable given input tokens, which plays a central role in predicting output labels and solving downstream tasks. - To answer (b) on inference, we prove that attention with the desired parameter infers the latent posterior up to an approximation error, which is decreasing in input sizes. In detail, we quantify how attention approximates the conditional mean of the value given the key, which characterizes how it performs relational inference over long sequences. - To answer (c) on learning, we prove that both supervised and self-supervised objectives allow empirical risk minimization to learn the desired parameter up to a generalization error, which is independent of input sizes. Particularly, in the self-supervised setting, we identify a condition number that is pivotal to solving downstream tasks.

Structural analysis of an all-purpose question answering model

Answer, Assemble, Ace: Understanding How Transformers Answer Multiple Choice Questions

An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models

Local-to-Global Structure-Aware Transformer for Question Answering over Structured Knowledge.

Pay More Attention - Neural Architectures for Question-Answering

Positional Attention Guided Transformer-Like Architecture for Visual Question Answering

A Study of Visual Question Answering Techniques Based on Collaborative Multi-Head Attention

Attention Can Reflect Syntactic Structure (If You Let It)

Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Models

A Closer Look at Transformer Attention for Multilingual Translation.

Syntax-informed Question Answering with Heterogeneous Graph Transformer

Multimodal Graph Transformer for Multimodal Question Answering

DHHG-TAC: Fusion of Dynamic Heterogeneous Hypergraphs and Transformer Attention Mechanism for Visual Question Answering Tasks

Is Graph Structure Necessary for Multi-hop Question Answering?

Modeling Graph Structure in Transformer for Better AMR-to-Text Generation.

Visual Question Answering Via Attention-based Syntactic Structure Tree-Lstm

Attention-Based Transformer-BiGRU for Question Classification

Enhancing Pre-trained Models with Text Structure Knowledge for Question Generation

Cluster-Former: Clustering-based Sparse Transformer for Question Answering.

Attention as a Hypernetwork

A lightweight Transformer-based visual question answering network with Weight-Sharing Hybrid Attention