Abstract:Self-supervised pre-training has become the priory choice to establish reliable neural networks for automated recognition of massive biomedical microscopy images, which are routinely annotation-free, without semantics, and without guarantee of quality. Note that this paradigm is still at its infancy and limited by closely related open issues: (1) how to learn robust representations in an unsupervised manner from unlabelled biomedical microscopy images of low diversity in samples? and (2) how to obtain the most significant representations demanded by a high-quality segmentation? Aiming at these issues, this study proposes a knowledge-based learning framework (TOWER) towards enhanced recognition of biomedical microscopy images, which works in three phases by synergizing contrastive learning and generative learning methods: (1) Sample Space Diversification: Reconstructive proxy tasks have been enabled to embed a priori knowledge with context highlighted to diversify the expanded sample space; (2) Enhanced Representation Learning: Informative noise-contrastive estimation loss regularizes the encoder to enhance representation learning of annotation-free images; (3) Correlated Optimization: Optimization operations in pre-training the encoder and the decoder have been correlated via image restoration from proxy tasks, targeting the need for semantic segmentation. Experiments have been conducted on public datasets of biomedical microscopy images against the state-of-the-art counterparts (e.g., SimCLR and BYOL), and results demonstrate that: TOWER statistically excels in all self-supervised methods, achieving a Dice improvement of 1.38 percentage points over SimCLR. TOWER also has potential in multi-modality medical image analysis and enables label-efficient semi-supervised learning, e.g., reducing the annotation cost by up to 99% in pathological classification.

Microsnoop: A Generalized Tool for Unbiased Representation of Diverse Microscopy Images

Microsnoop: A generalist tool for microscopy image representation

Microsnoop: a Generalist Tool for the Unbiased Representation of Heterogeneous Microscopy Images

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

X-Microscopy: Multicolor Super Resolution Image Reconstruction from Conventional Microscopy with Deep Learning

A Survey on Applications of Deep Learning in Microscopy Image Analysis

Scellseg: a Style-Aware Cell Instance Segmentation Tool with Pre-Training and Contrastive Fine-Tuning

Microscopy Image Segmentation via Point and Shape Regularized Data Synthesis

AIMIC: Deep Learning for Microscopic Image Classification

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Two-stage Generative Models of Simulating Training Data at the Voxel Level for Large-Scale Microscopy Bioimage Segmentation

Generalizable Morphological Profiling of Cells by Interpretable Unsupervised Learning

Roadmap on Deep Learning for Microscopy

MicroAnalyzer: A Python Tool for Automated Bacterial Analysis with Fluorescence Microscopy

Grad-CAMO: Learning Interpretable Single-Cell Morphological Profiles from 3D Cell Painting Images

DeepS: a Web Server for Image Optical Sectioning and Super Resolution Microscopy Based on a Deep Learning Framework.

Joint Anomaly Detection and Inpainting for Microscopy Images Via Deep Self-Supervised Learning.

Deep Learning Microscopy

Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biology

A knowledge-based learning framework for self-supervised pre-training towards enhanced recognition of biomedical microscopy images

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence