Abstract:With the development of deep learning, convolutional neural networks (CNNs) and Transformer-based methods have become key techniques for medical image classification tasks. However, many current neural network models have problems such as high complexity, a large number of parameters, and large model sizes; such models obtain higher classification accuracy at the expense of lightweight networks. Moreover, such larger-scale models pose a great challenge for practical clinical applications. Meanwhile, Transformer and multi-layer perceptron (MLP) methods have some shortcomings in terms of local modeling capability and high model complexity, and need to be used on larger datasets to show good performance. This makes it difficult to utilize these networks in clinical medicine. Based on this, we propose a lightweight and efficient pure CNN network for medical image classification (Eff-PCNet). On the one hand, we propose a multi-branch multi-scale CNN (M2C) module, which divides the feature map into four parallel branches along the channel dimensions by a certain scale factor and carries out a deep convolution operation using different scale convolution kernels, and this multi-branch multi-scale operation effectively replaces the large kernel convolution. This multi-branch multi-scale operation effectively replaces the large kernel convolution. It reduces the computational cost of the module while fusing the feature information between different channels and thus obtains richer feature information. Finally, the four feature maps are then spliced along the channel dimensions to fuse the multi-scale and multi-dimensional feature information. On the other hand, we introduce the structural reparameterization technique and propose the structural reparameterized CNN (Rep-C) module. Specifically, it utilizes multiple linear operators to generate different feature maps during the training process and fuses all the participants into one through parameter fusion to achieve fast inference while providing a more effective solution for feature reuse. A number of experimental results show that our Eff-PCNet performs better than current methods based on CNN, Transformer, and MLP in the classification of three publicly available medical image datasets. Among them, we achieve 87.4% Acc on the HAM10000 dataset, 91.06% Acc on the SkinCancer dataset, and 97.03% Acc on the Chest-Xray dataset. Meanwhile, our approach achieves a better trade-off between the number of parameters; computation; and other performance metrics as well.

An efficient medical image classification network based on multi-branch CNN, token grouping Transformer and mixer MLP

Eff-PCNet: an Efficient Pure CNN Network for Medical Image Classification

Multi-branch CNN and grouping cascade attention for medical image classification

Multi-Branch Cnn and Multi-Scale Multi-Dimensional Feature Fusion Mlp for Medical Image Classification

CTransCNN: Combining transformer and CNN in multilabel medical image classification

BMCS-Net: A Bi-directional multi-scale cascaded segmentation network based on transformer-guided feature Aggregation for medical images

TransMed: Transformers Advance Multi-Modal Medical Image Classification

MTANet: Multi-Task Attention Network for Automatic Medical Image Segmentation and Classification

TEC-Net: Vision Transformer Embrace Convolutional Neural Networks for Medical Image Segmentation

DBCvT: Double Branch Convolutional Transformer for Medical Image Classification

An Efficient and Robust 3D Medical Image Classification Approach Based on 3D CNN, Time‐Distributed 2D CNN‐BLSTM Models, and mRMR Feature Selection

Cross Attention Multi Scale CNN-Transformer Hybrid Encoder is General Medical Image Learner.

MLP-based classification of COVID-19 and skin diseases

Enhanced Capsule Network for Medical image classification

Using Multi-Task Learning to Improve Diagnostic Performance of Convolutional Neural Networks

CiT-Net: Convolutional Neural Networks Hand in Hand with Vision Transformers for Medical Image Segmentation

Real-Time Medical Image Classification with ML Framework and Dedicated CNN–LSTM Architecture

Effective High-to-low-level Feature Aggregation Network for Endoscopic Image Classification

Medical Image Classification Using a Light-Weighted Hybrid Neural Network Based on PCANet and DenseNet

MS-TCNet: An effective Transformer–CNN combined network using multi-scale feature learning for 3D medical image segmentation

A lightweight multi-modality medical image semantic segmentation network base on the novel UNeXt and Wave-MLP