Abstract:Modeling cell interactions such as co-attraction and contact-inhibition of locomotion is essential for understanding collective cell migration. Here, we propose a novel deep reinforcement learning model for collective neural crest cell migration. We apply the deep deterministic policy gradient algorithm in association with a particle dynamics simulation environment to train agents to determine the migration path. Because of the different migration mechanisms of leader and follower neural crest cells, we train two types of agents (leaders and followers) to learn the collective cell migration behavior. For a leader agent, we consider a linear combination of a global task, resulting in the shortest path to the target source, and a local task, resulting in a coordinated motion along the local chemoattractant gradient. For a follower agent, we consider only the local task. First, we show that the self-driven forces learned by the leader cell point approximately to the placode, which means that the agent is able to learn to follow the shortest path to the target. To validate our method, we compare the total time elapsed for agents to reach the placode computed using the proposed method and the time computed using an agent-based model. The distributions of the migration time intervals calculated using the two methods are shown to not differ significantly. We then study the effect of co-attraction and contact-inhibition of locomotion to the collective leader cell migration. We show that the overall leader cell migration for the case with co-attraction is slower because the co-attraction mitigates the source-driven effect. In addition, we find that the leader and follower agents learn to follow a similar migration behavior as in experimental observations. Overall, our proposed method provides useful insight on how to apply reinforcement learning techniques to simulate collective cell migration.

Directional Collective Cell Migration Emerges as a Property of Cell Interactions

Multiscale mechanisms of cell migration during development: theory and experiment

Integrating chemical and mechanical signals in neural crest cell migration

Collective directional memory controls the range of epithelial cell migration

Physical Models of Collective Cell Migration

Modeling the roles of cohesotaxis, cell-intercalation, and tissue geometry in collective cell migration of Xenopus mesendoderm

Dynamic fibronectin assembly and remodeling by leader neural crest cells prevents jamming in collective cell migration

Dynamic Migration Modes of Collective Cells.

Collective cell migration in morphogenesis, regeneration and cancer

The Forces behind Directed Cell Migration

Emergent collective chemotaxis without single-cell gradient sensing

A biased random walk approach for modeling the collective chemotaxis of neural crest cells

Emergence of bidirectional cell laning from collective contact guidance

Collective effects in flow-driven cell migration

Collective cell migration has distinct directionality and speed dynamics

Three-dimensional Cancer Cell Migration Directed by Dual Mechanochemical Guidance

A deep reinforcement learning model based on deterministic policy gradient for collective neural crest cell migration

Collective Chemotaxis through Noisy Multicellular Gradient Sensing

Mechanobiology of Collective Cell Migration in 3D Microenvironments

Homeostatic interactions at the front of migration control the integrity and the efficiency of a migratory glial chain