Abstract:Chromosome analysis is essential for diagnosing genetic disorders. For hematologic malignancies, identification of somatic clonal aberrations by karyotype analysis remains the standard of care. However, karyotyping is costly and time-consuming because of the largely manual process and the expertise required in identifying and annotating aberrations. Efforts to automate karyotype analysis to date fell short in aberration detection. Using a training set of ~10k patient specimens and ~50k karyograms from over 5 years from the Fred Hutchinson Cancer Center, we created a labeled set of images representing individual chromosomes. These individual chromosomes were used to train and assess deep learning models for classifying the 24 human chromosomes and identifying chromosomal aberrations. The top-accuracy models utilized the recently introduced Topological Vision Transformers (TopViTs) with 2-level-block-Toeplitz masking, to incorporate structural inductive bias. TopViT outperformed CNN (Inception) models with >99.3% accuracy for chromosome identification, and exhibited accuracies >99% for aberration detection in most aberrations. Notably, we were able to show high-quality performance even in "few shot" learning scenarios. Incorporating the definition of clonality substantially improved both precision and recall (sensitivity). When applied to "zero shot" scenarios, the model captured aberrations without training, with perfect precision at >50% recall. Together these results show that modern deep learning models can approach expert-level performance for chromosome aberration detection. To our knowledge, this is the first study demonstrating the downstream effectiveness of TopViTs. These results open up exciting opportunities for not only expediting patient results but providing a scalable technology for early screening of low-abundance chromosomal lesions.

A Robust Framework of Chromosome Straightening with ViT-Patch GAN

Chromosome Classification and Straightening Based on an Interleaved and Multi-Task Network

A Novel Application of Image-to-Image Translation: Chromosome Straightening Framework by Learning from a Single Image

Masked conditional variational autoencoders for chromosome straightening

ChrSNet: Chromosome Straightening using Self-attention Guided Networks

BR-ChromNet: Banding Resolution Localization of Chromosome Structural Abnormality with Conditional Random Field

End-To-End Chromosome Karyotyping with Data Augmentation Using GAN

A New Multiple-Distribution GAN Model to Solve Complexity in End-to-End Chromosome Karyotyping

Deep Anomaly Generation: An Image Translation Approach of Synthesizing Abnormal Banded Chromosome Images

Adversarial Multiscale Feature Learning Framework for Overlapping Chromosome Segmentation

Supervised Contrastive Learning for Fine-grained Chromosome Recognition

ChromTR: chromosome detection in raw metaphase cell images via deformable transformers

Karyotype AI for Precision Oncology

Subspace-based Prototyping and Classification of Chromosome Images

Chromosome Detection in Metaphase Cell Images Using Morphological Priors

Unpaired Stain Transfer Using Pathology-Consistent Constrained Generative Adversarial Networks

An automatic progressive chromosome segmentation approach using deep learning with traditional image processing

CellGAN: Conditional Cervical Cell Synthesis for Augmenting Cytopathological Image Classification

CytoGAN: Unpaired staining transfer by structure preservation for cytopathology image analysis

Varifocal-Net: A Chromosome Classification Approach Using Deep Convolutional Networks

Automatic Pattern Extraction and Classification for Chromosome Images