Abstract:Liquid-phase transmission electron microscopy (TEM) has been recently applied to materials chemistry to gain fundamental understanding of various reaction and phase transition dynamics at nanometer resolution. However, quantitative extraction of physical and chemical parameters from the liquid-phase TEM videos remains bottlenecked by the lack of automated analysis methods compatible with the videos' high noisiness and spatial heterogeneity. Here, we integrate, for the first time, liquid-phase TEM imaging with our customized analysis framework based on a machine learning model called U-Net neural network. This combination is made possible by our workflow to generate simulated TEM images as the training data with well-defined ground truth. We apply this framework to three typical systems of colloidal nanoparticles, concerning their diffusion and interaction, reaction kinetics, and assembly dynamics, all resolved in real-time and real-space by liquid-phase TEM. A diversity of properties for differently shaped anisotropic nanoparticles are mapped, including the anisotropic interaction landscape of nanoprisms, curvature-dependent and staged etching profiles of nanorods, and an unexpected kinetic law of first-order chaining assembly of concave nanocubes. These systems representing properties at the nanoscale are otherwise experimentally inaccessible. Compared to the prevalent image segmentation methods, U-Net shows a superior capability to predict the position and shape boundary of nanoparticles from highly noisy and fluctuating background—a challenge common and sometimes inevitable in liquid-phase TEM videos. We expect our framework to push the potency of liquid-phase TEM to its full quantitative level and to shed insights, in high-throughput and statistically significant fashion, on the nanoscale dynamics of synthetic and biological nanomaterials.Machine-learning-assisted extracting of nanoscale dynamics from liquid-phase TEM videos.This article has not yet been cited by other publications.

Deep Learning for Analysis of Two-Dimensional Materials in High-Resolution Transmission Electron Microscopy Image

Deep-Learning-Enabled Fast Optical Identification and Characterization of Two-Dimensional Materials

Artificial Neuron Networks Enabled Identification and Characterizations of 2D Materials and van der Waals Heterostructures

Deep‐Learning‐Enabled Fast Optical Identification and Characterization of 2D Materials

Towards Large-Scale and Spatiotemporally Resolved Diagnosis of Electronic Density of States by Deep Learning

Deep Learning Segmentation of Complex Features in Atomic-Resolution Phase Contrast Transmission Electron Microscopy Images

Machine-Learning-Enabled Fast Optical Identification and Characterization of 2D Materials

Deep learning assisted high resolution microscopy image processing for phase segmentation in functional composite materials

Deep learning-assisted analysis of HRTEM images of crystalline nanoparticles

Deep learning in two-dimensional materials: Characterization, prediction, and design

Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations

A small-dataset-trained deep learning framework for identifying atoms on transmission electron microscopy images

Single-image based deep learning for precise atomic defects identification

Deep Learning-Assisted Analysis of Single Molecule Dynamics from Liquid-Phase Electron Microscopy

Deep Learning Assisted Raman Spectroscopy for Rapid Identification of 2D Materials

Deep-learning-based image segmentation integrated with optical microscopy for automatically searching for two-dimensional materials

Thickness Determination of Ultrathin 2D Materials Empowered by Machine Learning Algorithms

Understanding important features of deep learning models for segmentation of high-resolution transmission electron microscopy images

Semi-supervised machine learning model for analysis of nanowire morphologies from transmission electron microscopy images

Intelligent Identification of Two-Dimensional Nanostructures by Machine-Learning Optical Microscopy

Machine Learning to Reveal Nanoparticle Dynamics from Liquid-Phase TEM Videos