Abstract:In recent years, the optimization of network architecture plays an increasingly important role in the performance improvement of neural networks. We introduce an interactive dual-branch attention mechanism and three different lightweight-oriented strategies to build an accurate and compact residual network model in this work. The channel attention and spatial attention are fused to construct a novel bottleneck to enhance the feature representation ability for accurate performance. Asymmetric convolutions with spatial factorization, channel splitting, depthwise separable convolution with width multiplier adjustment are further combined to compress the parameter size of the attention-driven model for a lightweight and compact residual network named ALResNet. The experimental results of 92.1% top-1 testing accuracy at the inference speed of 14.90 fps on Animals-10 and 89.4% top-1 testing accuracy at the inference speed of 16.21 fps on CIFAR-10, as well as 4.77M parameters and 736.82 MFLOPs, demonstrate that the proposed ALResNet achieves a decent tradeoff between accuracy and computing efficiency for fast inference on resource-limited mobile devices for vision-based tasks. ∗Corresponding author: Aiwen Luo (faith.awluo@gmail.com). Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. MLMI’21, September 17–19, 2021, Hangzhou, China © 2021 Association for Computing Machinery. ACM ISBN 978-1-4503-8424-7/21/09. . . $15.00 https://doi.org/10.1145/3490725.3490729 CCS CONCEPTS • Computing methodologies; • Object recognition; • Neural networks; • Model verification and validation;

DRFNet: A Lightweight and High Accuracy Network for Resource-Limited Implementation.

Dynamic Residual Dense Network For Image Denoising

LWRN: Light-Weight Residual Network for Edge Detection

DR-Net: An Improved Network for Building Extraction from High Resolution Remote Sensing Image

DRF-DRC: dynamic receptive field and dense residual connections for model compression

Double reuses based residual network

LRPRNet: Lightweight Deep Network by Low-Rank Pointwise Residual Convolution

FDDWNet: A Lightweight Convolutional Neural Network for Real-time Sementic Segmentation

LDCNet: A Lightweight Multi-Scale Convolutional Neural Network Using Local Dense Connectivity for Image Recognition

Dense Residual Network: Enhancing global dense feature flow for character recognition

LPRNet: Lightweight Deep Network by Low-rank Pointwise Residual Convolution

Image classification using regularized convolutional neural network design with dimensionality reduction modules: RCNN–DRM

Low-res MobileNet: An efficient lightweight network for low-resolution image classification in resource-constrained scenarios

FireNet: A Lightweight and Efficient Multi-Scenario Fire Object Detector

FRDet: Balanced and Lightweight Object Detector based on Fire-Residual Modules for Embedded Processor of Autonomous Driving

FRD-CNN: Object detection based on small-scale convolutional neural networks and feature reuse

L-Net: A lightweight convolutional neural network for devices with low computing power

Deeply Recursive Low- and High-Frequency Fusing Networks for Single Image Super-Resolution

KutralNet: A Portable Deep Learning Model for Fire Recognition

ADFireNet: An Anchor-Free Smoke and Fire Detection Network Based on Deformable Convolution

ALResNet: Attention-Driven Lightweight Residual Network for Fast and Accurate Image Recognition