Abstract:The lack of available annotated Scanning Probe Microscopy (SPM) data limits the applicability of Machine Learning to evaluate images on the nanoscale, requiring laborious manual work. The use of synthetic data to train state‐of‐the‐art object detection models can overcome this limitation, enabling a fast, accurate, and reliable analysis of SPM images, as demonstrated on two self‐assembled molecular chiral networks. Enantiospecific effects play an uprising role in chemistry and technical applications. Chiral molecular networks formed by self‐assembly processes at surfaces can be imaged by scanning probe microscopy (SPM). Low contrast and high noise in the topography map often interfere with the automatic image analysis using classical methods. The long SPM image acquisition times restrain Artificial Intelligence‐based methods requiring large training sets, leaving only tedious manual work, inducing human‐dependent errors and biased labeling. By generating realistic looking synthetic images, the acquisition of real datasets is avoided. Two state‐of‐the‐art object detection architectures are trained to localize and classify chiral unit‐cells in a regular molecular chiral network formed by self‐assembly of linear molecular bricks. The comparison of different architectures and datasets demonstrates that the training on purely synthetic data outperforms models trained using augmented datasets. A Faster R‐CNN model trained solely on synthetic data achieved an excellent mean average precision of 99% on real data. Hence this approach and the transfer to real data show high success, also highlighting the high robustness against experimental noise and different zoom levels across the full experimentally reasonable parameter range. The generalizability of this idea is demonstrated by achieving equally high performance on a different structure, too.

A deep learning framework for automated molecular recognitions in scanning probe microscopy images.

A Deep‐Learning Framework for the Automated Recognition of Molecules in Scanning‐Probe‐Microscopy Images

Applying a Deep-Learning-Based Keypoint Detection in Analyzing Surface Nanostructures

Artificial-intelligence-driven scanning probe microscopy

Machine Vision Automated Chiral Molecule Detection and Classification in Molecular Imaging

Autonomous Scanning Tunneling Microscopy Imaging via Deep Learning

Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations

Precise Large-Scale Chemical Transformations on Surfaces: Deep Learning Meets Scanning Probe Microscopy with Interpretability

Deep-Learning Recognition of Scanning Transmission Electron Microscopy: Quantifying and Mitigating the Influence of Gaussian Noises

A deep learning-based framework for automatic analysis of the nanoparticle morphology in SEM/TEM images

Deep Learning for Atomically Resolved Imaging

Nanoparticle Recognition on Scanning Probe Microscopy Images Using Computer Vision and Deep Learning

Deep learning for electron and scanning probe microscopy: From materials design to atomic fabrication

Robust multi-scale multi-feature deep learning for atomic and defect identification in Scanning Tunneling Microscopy on H-Si(100) 2x1 surface

Chirality Detection in Scanning Tunneling Microscopy Data Using Artificial Intelligence

A Deep Learning Approach for Molecular Classification Based on AFM Images

Deep-learning-augmented Microscopy for Super-Resolution Imaging of Nanoparticles.

ABC-Net: a Divide-and-conquer Based Deep Learning Architecture for SMILES Recognition from Molecular Images.

DeepS: a Web Server for Image Optical Sectioning and Super Resolution Microscopy Based on a Deep Learning Framework.

High Resolution of Plasmonic Resonance Scattering Imaging with Deep Learning

Deep Learning Analysis on Microscopic Imaging in Materials Science