Cellcyclegan: Spatiotemporal Microscopy Image Synthesis Of Cell Populations Using Statistical Shape Models And Conditional Gans

Dennis Bähr,Dennis Eschweiler,Anuk Bhattacharyya,Daniel Moreno-Andrés,Wolfram Antonin,Johannes Stegmaier,Dennis Bahr,Daniel Moreno-Andres
DOI: https://doi.org/10.1109/isbi48211.2021.9433896
2021-04-13
Abstract:Automatic analysis of spatio-temporal microscopy images is inevitable for state-of-the-art research in the life sciences. Recent developments in deep learning provide powerful tools for automatic analyses of such image data, but heavily depend on the amount and quality of provided training data to perform well. To this end, we developed a new method for realistic generation of synthetic 2D+t microscopy image data of fluorescently labeled cellular nuclei. The method combines spatiotemporal statistical shape models of different cell cycle stages with a conditional GAN to generate time series of cell populations and provides instance-level control of cell cycle stage and the fluorescence intensity of generated cells. We show the effect of the GAN conditioning and create a set of synthetic images that can be readily used for training and benchmarking of cell segmentation and tracking approaches.
What problem does this paper attempt to address?