Abstract:Currently, vision transformers (ViTs) have rivaled comparable performance to convolutional neural networks (CNNs). However, the computational demands of the transformers' self-attention mechanism pose challenges for their application on edge devices. Therefore, in this study, we propose a lightweight transformer-based network model called MixMobileNet. Similar to the ResNet block, this model only comprises a MixMobile block (MMb), which combines the efficient local inductive bias with the explicit modeling features of a transformer to achieve the fusion of the local–global feature interactions. For local, we propose the local-feature aggregation encoder (LFAE), which incorporates a PC2P (Partial-Conv→PWconv→PWconv) inverted bottleneck structure for residual connectivity. In particular, the kernel and channel scale are adaptive, reducing feature redundancy in adjacent layers and efficiently representing parameters. For global, we propose the global-feature aggregation encoder (GFAE), which employs a pooling strategy and computes the covariance matrix between channels instead of the spatial dimensions, changing the computational complexity from quadratic to linear, and this accelerates the inference of the model. We perform extensive image classification, object detection, and segmentation experiments to validate model performance. Our MixMobileNet-XXS/XS/S achieves 70.6%/75.1%/78.8% top-1 accuracy with 1.5 M/3.2 M/7.3 M parameters and 0.2 G/0.5 G/1.2 G FLOPs on ImageNet-1K, outperforming MobileViT-XXS/XS/S with an improvement of +1.6%↑/+0.4%↑/+0.4%↑ with −38.8%↓/−51.5%↓/−39.8%↓ reduction in FLOPs. In addition, the MixMobileNet-S assembly of SSDLite and DeepLabv3 achieves an accuracy of 28.5 mAP/79.5 mIoU at COCO2017/VOC2012 with lower computation, demonstrating the competitive performance of our lightweight model.

MobileACNet: ACNet-Based Lightweight Model for Image Classification.

Real-Time Facial Landmark Detection by Attention-driven Lightweight Network

MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications

Low-res MobileNet: An efficient lightweight network for low-resolution image classification in resource-constrained scenarios

Research on Image Classification of Lightweight Convolutional Neural Network

ANTNets: Mobile Convolutional Neural Networks for Resource Efficient Image Classification

A New Image Classification Approach via Improved MobileNet Models with Local Receptive Field Expansion in Shallow Layers

Rethinking Mobile Block for Efficient Attention-based Models

MixMobileNet: A Mixed Mobile Network for Edge Vision Applications

IremulbNet: Rethinking the inverted residual architecture for image recognition

Lightweight Network Research Based on Deep Learning

Face Recognition Based on Lightweight Convolutional Neural Networks

Redundancy-Reduced MobileNet Acceleration on Reconfigurable Logic for ImageNet Classification

LightCSPNet: A Lightweight Network for Image Classification and Objection Detection

White blood cell classification network using MobileNetv2 with multiscale feature extraction module and attention mechanism

Non-uniform Illumination Face Recognition Method Based on Improved MobileNetV1

Image recognition based on lightweight convolutional neural network: Recent advances

An Image Classification Method Based on Adaptive Attention Mechanism and Feature Extraction Network

Searching for MobileNetV3

MobileMamba: Lightweight Multi-Receptive Visual Mamba Network

CCNNet: a novel lightweight convolutional neural network and its application in traditional Chinese medicine recognition