Abstract:Medical imaging, including the use of chest x-rays, is an important tool for modern healthcare, enabling early and accurate disease diagnosis, facilitating timely interventions to mitigate health issues. By capturing images of critical internal organs like the lungs and heart, x-rays enable doctors to make informed diagnoses and treatment decisions, especially concerning respiratory and cardiac conditions. The importance of early and accurate disease diagnosis, particularly with multiple pathologies, is paramount, as it greatly impacts patient outcomes by enabling timely and specific treatments. Recently, multi-label classification has become increasingly important in medical imaging, since several pathologies can be present within a single x-ray. While traditional convolutional neural networks (CNNs) have played a pivotal role in enhancing the accuracy of x-ray diagnoses, the expanding complexity of multi-label imaging demands more sophisticated methods. Vision Transformers (ViTs) have emerged as a promising approach in medical image classification, showcasing their ability to effectively process x-ray images and identify pathologies within them. While traditional ViTs perform well, they have significant drawbacks. Most ViT models utilize a large number of parameters, often ranging from millions to billions of parameters. Such parameter-intensive designs, while powerful, are computationally heavy. This not only increases the resource requirements, but also raises concerns about their feasibility and scalability in real-world, time-sensitive healthcare settings. We propose a novel Vision Transformer architecture aimed at effectively classifying multi-label x-ray images while significantly enhancing the efficiency of ViT-based multi-label medical image classification methods. By optimizing model architectures and exploring techniques for parameter reduction, we seek to develop more streamlined and resource-efficient approaches without completely sacrificing the efficacy of these methods. Our work endeavors to bridge the gap between cutting-edge technology and practical healthcare applications, promising a more efficient and accessible future for medical image analysis.

Asymmetric Vision Transformers for Multi-Label Classification

Region-Awared Transformer with Asymmetric Loss in Multi-Label Classification

Diverse Instance Discovery: Vision-Transformer for Instance-Aware Multi-Label Image Recognition.

Diverse Instance Discovery: Vision-Transformer for Instance-Aware Multi-Label Image Recognition

Multi-label classification of retinal disease via a novel vision transformer model

HSVLT: Hierarchical Scale-Aware Vision-Language Transformer for Multi-Label Image Classification

Query2Label: A Simple Transformer Way to Multi-Label Classification

Distance Restricted Transformer Encoder for Multi-Label Classification

GA-Based Weighted Ensemble Learning for Multi-Label Aerial Image Classification Using Convolutional Neural Networks and Vision Transformers

SST: Spatial and Semantic Transformers for Multi-Label Image Recognition

All Tokens Matter: Token Labeling for Training Better Vision Transformers

STMG: Swin transformer for multi-label image recognition with graph convolution network

MMViT: Multiscale Multiview Vision Transformers

MIL-ViT: A Multiple Instance Vision Transformer for Fundus Image Classification

Multimodal Fusion Transformer for Remote Sensing Image Classification

Multi-Attribute Vision Transformers are Efficient and Robust Learners

Towards efficient diagnostics: refining vision transformers for medical image multi-label classification

Transformer-based Multi-Modal Learning for Multi Label Remote Sensing Image Classification

TiC: Exploring Vision Transformer in Convolution

Data Augmentation Vision Transformer for Fine-grained Image Classification

Multi-criteria Token Fusion with One-step-ahead Attention for Efficient Vision Transformers