Abstract:In recent years, two-dimensional materials have received widespread attention due to their unique properties. Among the various methods for preparing two-dimensional layered crystals, the thin-layer two-dimensional material crystals obtained by mechanical exfoliation are of high quality, suitable for basic research and performance demonstration. However, mechanically exfoliated crystals on substrates exhibit a certain degree of randomness, including a few layers and relatively thick flakes. The effective, rapid and intelligent characterization method of these two-dimensional nanostructures is beneficial to further research on the properties of two-dimensional materials. This paper proposes a method based on deep learning, which can segment and quickly identify two-dimensional material nanosheets based on optical microscope images through a convolutional neural network semantic segmentation algorithm built with an encoding-decoding structure. As a typical algorithm for deep learning in the field of image processing, Convolutional neural networks can be applied to the feature extraction in optical microscope images. Firstly, MoS2 nanosheet samples were prepared by mechanical exfoliation, and high spectroscopic images were acquired by optical microscopy. The nanosheet samples were labeled, and the marked images were further processed, including color calibration and sliding shear operation, to obtain datasets for network training and testing. A semantic segmentation algorithm based on encoding-decoding network structure was designed to rapidly identify nanosheets. Aiming at some flakes in images showing the characteristic of low contrast and fragmentation, residual convolution and pyramid pooling models were added to strengthen the extraction of features during encoding. The shallow feature information extracted from the encoding stage was reused during decoding to improve the network segmentation results. In the experiment, the weighted cross-entropy loss function was used to solve the problem of unbalanced classes, and the dataset was enlarged with data augmentation. Testing on the trained network show that the pixel accuracy was 97. 38% , the mean pixel accuracy was 90. 38% , and the mean intersection over union was 75. 86%. Then, the exfoliated monolayer and bilayer graphenes were identified by transfer learning, and the mean intersection over union reached 81. 63% , showing that this technique is universal for the identification of two-dimensional nanosheets. The identification of MoS2 and graphene nanosheets realizes the application of deep learning in optical microscopy images of two-dimensional materials. This method is expected to apply to more two-dimensional materials and break through the problem of automatic dynamic processing of optical images. Moreover, it provides a reference for hyperspectral images processing of other nanomaterials.

Image segmentation of exfoliated two-dimensional materials by generative adversarial network-based data augmentation

Thermal Deformation Defect Prediction for Layered Printing Using Convolutional Generative Adversarial Network

3DMaterialGAN: Learning 3D Shape Representation from Latent Space for Materials Science Applications

Identification of Two-Dimensional Material Nanosheets Based on Deep Neural Network and Hyperspectral Microscopy Images

Data augmentation in microscopic images for material data mining

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Generation of highly realistic microstructural images of alloys from limited data with a style-based generative adversarial network

A deep learned nanowire segmentation model using synthetic data augmentation

3D Grain Shape Generation in Polycrystals Using Generative Adversarial Networks

Single-image based deep learning for precise atomic defects identification

A Deep Learning Labeling Method for Material Microstructure Image Segmentation

Leveraging generative adversarial networks to create realistic scanning transmission electron microscopy images

Synthetic Data Generation for Automatic Segmentation of X-ray Computed Tomography Reconstructions of Complex Microstructures

Deep Generative Models-Assisted Automated Labeling for Electron Microscopy Images Segmentation

MaskTerial: A Foundation Model for Automated 2D Material Flake Detection

Generating three-dimensional structures from a two-dimensional slice with generative adversarial network-based dimensionality expansion

AtomGAN: unsupervised deep learning for fast and accurate defect detection of 2D materials at the atomic scale

Multispectral Microscopic Multiplexed (3M) Imaging of Atomically‐Thin Crystals Using Deep Learning

An Improved Dataset Augmentation Approach for Deep Learning-Based XCT Images Segmentation in Layered Composite Fabric

Identification and Structural Characterization of Twisted Atomically Thin Bilayer Materials by Deep Learning

Utilizing Generative Adversarial Networks for Image Data Augmentation and Classification of Semiconductor Wafer Dicing Induced Defects