DLSIA: Deep Learning for Scientific Image Analysis

Eric J. Roberts,Tanny Chavez,Alexander Hexemer,Petrus H. Zwart
DOI: https://doi.org/10.1107/s1600576724001390
IF: 4.868
2024-03-23
Journal of Applied Crystallography
Abstract:This article introduces DLSIA (Deep Learning for Scientific Image Analysis), a user‐friendly Python library that provides scientists and researchers with a number of convolutional neural networks with customizable architectures for a variety of image analysis tasks, enabling accelerated discoveries and enhancing interdisciplinary collaboration in the face of growing experimental data complexity.DLSIA (Deep Learning for Scientific Image Analysis) is a Python‐based machine learning library that empowers scientists and researchers across diverse scientific domains with a range of customizable convolutional neural network (CNN) architectures for a wide variety of tasks in image analysis to be used in downstream data processing. DLSIA features easy‐to‐use architectures, such as autoencoders, tunable U‐Nets and parameter‐lean mixed‐scale dense networks (MSDNets). Additionally, this article introduces sparse mixed‐scale networks (SMSNets), generated using random graphs, sparse connections and dilated convolutions connecting different length scales. For verification, several DLSIA‐instantiated networks and training scripts are employed in multiple applications, including inpainting for X‐ray scattering data using U‐Nets and MSDNets, segmenting 3D fibers in X‐ray tomographic reconstructions of concrete using an ensemble of SMSNets, and leveraging autoencoder latent spaces for data compression and clustering. As experimental data continue to grow in scale and complexity, DLSIA provides accessible CNN construction and abstracts CNN complexities, allowing scientists to tailor their machine learning approaches, accelerate discoveries, foster interdisciplinary collaboration and advance research in scientific image analysis.
chemistry, multidisciplinary,crystallography
What problem does this paper attempt to address?