Abstract:Morphology analysis based on atomic force microscopy (AFM) imaging contributes to understanding the characteristics of specimens more deeply. The preliminary and crucial step of implementing morphology analysis is to precisely segment the target area from the complex background. In this study, an automated AFM image segmentation strategy based on a well-designed U-shaped neural network is proposed to achieve accurate and robust segmentation for AFM images of different samples, thus realizing morphology analysis in micro-nano scale. Specifically, the centralized information interaction strategy cooperated with a two-path attention module is introduced to realize efficient cross-scale information interaction, which can fundamentally avoid the negative effects induced by spatial interpolation. Besides, the global information flows are adopted to guide the global information extracted by atrous spatial pyramid pooling to each level of the top-down pathway, which ensures that the high-level semantic information is not diluted during the top-down transmission process, thus locating the target area more precisely. Moreover, an AFM image dataset is constructed to train the network, which will be available online for free to facilitate other data-based AFM research. The segmentation results demonstrate that the proposed strategy has better performance on multiple AFM images compared with traditional Otsu method, fully convolutional network and U-Net. The application of the proposed method is carried out to exhibit the effectiveness in automated morphology analysis. Note to Practitioners—Despite the growing demand of AFM-based morphology analysis in many fields, the automated analysis is still lacking limited by accuracy and robustness of AFM image segmentation. Since manual segmentation, sometimes tedious and time-consuming, heavily depends on the personal judgment, it is thus necessary to develop automated segmentation methods. Although traditional automated segmentation algorithms have good performance on certain types of images, they may be difficult to apply in different scenarios, especially for micro-nano images, due to the limited robustness. Therefore, this paper proposes an automated image segmentation algorithm based on an improved U-shaped neural network to achieve accurate morphology analysis for AFM images. The proposed automated morphology analysis workflow will be a practical tool to help reduce human workload and subjective errors, as well as enhancing the accuracy and robustness of the analysis process. In addition, the constructed AFM image dataset can greatly facilitate the research on data-based AFM image analysis of other practitioners. Moreover, practitioners can benefit from our algorithm to improve the accuracy and robustness of image segmentation in other practical applications.

Automated High-Throughput Atomic Force Microscopy Single-Cell Nanomechanical Assay Enabled by Deep Learning-Based Optical Image Recognition

Deep Learning for Live Cell Shape Detection and Automated AFM Navigation

Deep learning strategy for small dataset from atomic force microscopy mechano-imaging on macrophages phenotypes

Living Cell Study at the Single-Molecule and Single-Cell Levels by Atomic Force Microscopy

Machine learning approaches for improving atomic force microscopy instrumentation and data analytics

An open-source combined atomic force microscope and optical microscope for mechanobiology studies

Artificial Intelligent Atomic Force Microscope Enabled by Machine Learning

Atomic Force Microscopy: Mechanosensor and Mechanotransducer for Probing Biological System from Molecules to Tissues

Noninvasive Subcellular Imaging Using Atomic Force Acoustic Microscopy (Afam)

Automated Bio-AFM Generation of Large Mechanome Data Set and Their Analysis by Machine Learning to Classify Cancerous Cell Lines

High-quality AFM image acquisition of living cells by modified residual encoder-decoder network

Deep-Learning-Based Automated Morphology Analysis With Atomic Force Microscopy

General Resolution Enhancement Method in Atomic Force Microscopy (AFM) Using Deep Learning

On machine learning analysis of atomic force microscopy images for image classification, sample surface recognition

AFM Imaging Defect Detection and Classification with Artificial Intelligence and Deep Learning

Side-view optical microscopy-assisted atomic force microscopy for thickness-dependent nanobiomechanics

Artificial Neural Network-Aided Computational Approach for Mechanophenotyping of Biological Cells Using Atomic Force Microscopy

Unveiling a Hidden Event in Fluorescence Correlative Microscopy by AFM Nanomechanical Analysis

Automated Structure Discovery in Atomic Force Microscopy

Nanomechanical and topographical imaging of living cells by atomic force microscopy with colloidal probes