Abstract:Morphology analysis based on atomic force microscopy (AFM) imaging contributes to understanding the characteristics of specimens more deeply. The preliminary and crucial step of implementing morphology analysis is to precisely segment the target area from the complex background. In this study, an automated AFM image segmentation strategy based on a well-designed U-shaped neural network is proposed to achieve accurate and robust segmentation for AFM images of different samples, thus realizing morphology analysis in micro-nano scale. Specifically, the centralized information interaction strategy cooperated with a two-path attention module is introduced to realize efficient cross-scale information interaction, which can fundamentally avoid the negative effects induced by spatial interpolation. Besides, the global information flows are adopted to guide the global information extracted by atrous spatial pyramid pooling to each level of the top-down pathway, which ensures that the high-level semantic information is not diluted during the top-down transmission process, thus locating the target area more precisely. Moreover, an AFM image dataset is constructed to train the network, which will be available online for free to facilitate other data-based AFM research. The segmentation results demonstrate that the proposed strategy has better performance on multiple AFM images compared with traditional Otsu method, fully convolutional network and U-Net. The application of the proposed method is carried out to exhibit the effectiveness in automated morphology analysis. Note to Practitioners—Despite the growing demand of AFM-based morphology analysis in many fields, the automated analysis is still lacking limited by accuracy and robustness of AFM image segmentation. Since manual segmentation, sometimes tedious and time-consuming, heavily depends on the personal judgment, it is thus necessary to develop automated segmentation methods. Although traditional automated segmentation algorithms have good performance on certain types of images, they may be difficult to apply in different scenarios, especially for micro-nano images, due to the limited robustness. Therefore, this paper proposes an automated image segmentation algorithm based on an improved U-shaped neural network to achieve accurate morphology analysis for AFM images. The proposed automated morphology analysis workflow will be a practical tool to help reduce human workload and subjective errors, as well as enhancing the accuracy and robustness of the analysis process. In addition, the constructed AFM image dataset can greatly facilitate the research on data-based AFM image analysis of other practitioners. Moreover, practitioners can benefit from our algorithm to improve the accuracy and robustness of image segmentation in other practical applications.

Automated analysis of grain morphology in TEM images using convolutional neural network with CHAC algorithm

Automated Grain Boundary Detection for Bright-Field Transmission Electron Microscopy Images via U-Net

A Deep Learning Based Automatic Defect Analysis Framework for In-situ TEM Ion Irradiations

FFT pattern recognition of crystal HRTEM image with deep learning

Review in situ transmission electron microscope with machine learning

Deep learning-assisted analysis of HRTEM images of crystalline nanoparticles

Spatiotemporal Evolution of Grain Microstructure: A CNN Perspective

Machine Learning to Reveal Nanoparticle Dynamics from Liquid-Phase TEM Videos

Phase division and recognition of crystal HRTEM images based on machine learning and deep learning

A Novel Approach to Grain Shape Factor in 3D Hexagonal Cellular Automaton

Deep Learning Segmentation of Complex Features in Atomic-Resolution Phase Contrast Transmission Electron Microscopy Images

Revealing in-plane grain boundary composition features through machine learning from atom probe tomography data

Deep-Learning-Based Automated Morphology Analysis With Atomic Force Microscopy

Accurate identification and measurement of the precipitate area by two-stage deep neural networks in novel chromium-based alloys

A cellular automata modelling approach for grain growth topological evolution process of ternary cathode materials combined with deep neural networks

A high-precision automatic recognition method based on target detection for nanometer scaled precipitates or carbides in different alloys

Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopy

Exploring electron-beam induced modifications of materials with machine-learning assisted high temporal resolution electron microscopy

Semi-supervised machine learning model for analysis of nanowire morphologies from transmission electron microscopy images

A robust synthetic data generation framework for machine learning in High-Resolution Transmission Electron Microscopy (HRTEM)

TEMImageNet Training Library and AtomSegNet Deep-Learning Models for High-Precision Atom Segmentation, Localization, Denoising, and Super-Resolution Processing of Atomic-Resolution Images