Abstract:Collective, coordinated cellular motions underpin key processes in all multicellular organisms, yet it has been difficult to simultaneously express the 'rules' behind these motions in clear, interpretable forms that effectively capture high-dimensional cell-cell interaction dynamics in a manner that is intuitive to the researcher. Here we apply deep attention networks to analyze several canonical living tissues systems and present the underlying collective migration rules for each tissue type using only cell migration trajectory data. We use these networks to learn the behaviors of key tissue types with distinct collective behaviors—epithelial, endothelial, and metastatic breast cancer cells—and show how the results complement traditional biophysical approaches. In particular, we present attention maps indicating the relative influence of neighboring cells to the learned turning decisions of a 'focal cell'–the primary cell of interest in a collective setting. Colloquially, we refer to this learned relative influence as 'attention', as it serves as a proxy for the physical parameters modifying the focal cell's future motion as a function of each neighbor cell. These attention networks reveal distinct patterns of influence and attention unique to each model tissue. Endothelial cells exhibit tightly focused attention on their immediate forward-most neighbors, while cells in more expansile epithelial tissues are more broadly influenced by neighbors in a relatively large forward sector. Attention maps of ensembles of more mesenchymal, metastatic cells reveal completely symmetric attention patterns, indicating the lack of any particular coordination or direction of interest. Moreover, we show how attention networks are capable of detecting and learning how these rules change based on biophysical context, such as location within the tissue and cellular crowding. That these results require only cellular trajectories and no modeling assumptions highlights the potential of attention networks for providing further biological insights into complex cellular systems. Collective behaviors are crucial to the function of multicellular life, with large-scale, coordinated cell migration enabling processes spanning organ formation to coordinated skin healing. However, we lack effective tools to discover and cleanly express collective rules at the level of an individual cell. Here, we employ a carefully structured neural network to extract collective information directly from cell trajectory data. The network is trained on data from various systems, including canonical collective cell systems (HUVEC and MDCK cells) which display visually distinct forms of collective motion, and metastatic cancer cells (MDA-MB-231) which are highly uncoordinated. Using these trained networks, we can produce attention maps for each system, which indicate how a cell within a tissue takes in information from its surrounding neighbors, as a function of weights assigned to those neighbors. Thus for a cell type in which cells tend to follow the path of the cell in front, the attention maps will display high weights for cells spatially forward of the focal cell. We present results in terms of additional metrics, such as accuracy plots and number of interacting cells, and encourage future development of improved metrics.

A self-supervised embedding of cell migration features for behavior discovery over cell populations

Biologically Informed Deep Learning to Infer Gene Program Activity in Single Cells

A statistical-inference approach to reconstruct inter-cellular interactions in cell-migration experiments

An agent-based method to estimate 3D cell migration trajectories from 2D measurements: Quantifying and comparing T vs CAR-T 3D cell migration

Systematic analysis of immune cell motility leveraging Immunemap, an open intravital microscopy atlas

Inference of Spatiotemporal Effects on Cellular State Transitions from Time-Lapse Microscopy

A machine learning one-class logistic regression model to predict stemness for single cell transcriptomics and spatial omics

Self-supervised deep learning for highly efficient spatial immunophenotyping

Uncovering Interpretable Fine-Grained Phenotypes of Subcellular Dynamics through Unsupervised Self-Training of Deep Neural Networks

Using deep learning for predicting the dynamic evolution of breast cancer migration

Learning the rules of collective cell migration using deep attention networks

Single clonal tracking on biomimetic microtextured platforms for real-time guided migration analysis of myeloid-derived suppressor cell dissemination characteristics ex vivo

Self-supervised learning for analysis of temporal and morphological drug effects in cancer cell imaging data

Abstract 5421: Characterizing functional cell migration states with highly multiplexed immunofluorescence imaging

Disentangling the Behavioural Variability of Confined Cell Migration

Learning the dynamics of cell-cell interactions in confined cell migration

Interpretable Fine-Grained Phenotypes of Subcellular Dynamics via Unsupervised Deep Learning

A data-driven approach to establishing cell motility patterns as predictors of macrophage subtypes and their relation to cell morphology

Cell migration guided by long-lived spatial memory

Detecting long-range interactions between migrating cells

Abstract 892: Pan-cancer tumor microenvironment profiling with multiplexed immunofluorescence microscopy and self-supervised learning