DL4MicEverywhere: deep learning for microscopy made flexible, shareable and reproducible
Iván Hidalgo-Cenalmor,Joanna W. Pylvänäinen,Mariana G. Ferreira,Craig T. Russell,Alon Saguy,Ignacio Arganda-Carreras,Yoav Shechtman,Arrate Muñoz-Barrutia,Beatriz Serrano-Solano,Caterina Fuster Barcelo,Constantin Pape,Emma Lundberg,Florian Jug,Joran Deschamps,Mariana G. Ferreira,Matthew Hartley,Mehdi Seifi,Teresa Zulueta-Coarasa,Vera Galinova,Wei Ouyang,Guillaume Jacquemet,Ricardo Henriques,Estibaliz Gómez-de-Mariscal,AI4Life Horizon Europe Program Consortium
DOI: https://doi.org/10.1038/s41592-024-02295-6
IF: 48
2024-05-19
Nature Methods
Abstract:DL4MicEverywhere is a platform that lets users train and implement their models in different computational environments. These environments include Google Colab, personal computational resources such as a desktop or laptop, and HPC systems. This flexibility is achieved by encapsulating each deep learning technique in an interactive Jupyter Notebook within a Docker container, enabling others to replicate analyses consistently across multiple platforms. DL4MicEverywhere (https://github.com/HenriquesLab/DL4MicEverywhere) enables users to install and interact with a large offering of standardized, user-friendly deep learning workflows, away from the limitations of proprietary platforms such as Google Colab and in a secure computational environment with controlled data privacy and resources. DL4MicEverywhere can be launched graphically, via X11 forwarding, or directly through a command line (headless mode), supporting HPC usage. This cross-platform containerization technology boosts the long-term platform's sustainability and reproducibility, enhancing user convenience 7 . DL4MicEverywhere features a zero-code interface that handles all the behind-the-scenes complexities, so users no longer need to deal with Docker configuration and deployment through a terminal. The intuitive interface abstracts away these technical details while providing a standardized Docker encapsulation for executing advanced techniques reliably. Researchers can select a notebook, choose computing resources and run the corresponding deep learning-powered analysis with just a few clicks (Fig. 1c–e). This allows users to train and apply models on various computing resources they control, eliminating reliance on third-party platforms. Furthermore, researchers can launch a notebook on local or remote systems with GPU acceleration whenever available, without worrying about complex software dependencies, Docker container management, or loss of access to deep learning frameworks (Fig. 1f–h). Compared to ZeroCostDL4Mic, DL4MicEverywhere doubles the number of deep learning approaches and provides new bioimaging analysis tasks, such as semantic segmentation, interactive instance segmentation, image registration, 3D single molecule localization microscopy, temporal and spatial upsampling, and image generation. The platform is designed to encourage the sharing and reuse of deep learning workflows provided as Jupyter Notebooks, which are then integrated into the BioImage Model Zoo. DL4MicEverywhere is strengthened by automated build pipelines 8 that allow tracked versioning of ZeroCostDL4Mic notebooks and the seamless integration of new trainable models contributed by the community as user-friendly notebooks independently of the original ZeroCostDL4Mic framework (Fig. 1b). DL4MicEverywhere handles the corresponding testing and building of fully documented and open-source containers, making it easy for researchers to share not just the latest method, but the full software environment required to run it reliably.
biochemical research methods