RegNet: Self-Regulated Network for Image Classification

Jing Xu,Yu Pan,Xinglin Pan,Steven Hoi,Zhang Yi,Zenglin Xu
DOI: https://doi.org/10.1109/tnnls.2022.3158966
IF: 14.255
2023-01-01
IEEE Transactions on Neural Networks and Learning Systems
Abstract:The ResNet and its variants have achieved remarkable successes in various computer vision tasks. Despite its success in making gradient flow through building blocks, the information communication of intermediate layers of blocks is ignored. To address this issue, in this brief, we propose to introduce a regulator module as a memory mechanism to extract complementary features of the intermediate layers, which are further fed to the ResNet. In particular, the regulator module is composed of convolutional recurrent neural networks (RNNs) [e.g., convolutional long short-term memories (LSTMs) or convolutional gated recurrent units (GRUs)], which are shown to be good at extracting spatio-temporal information. We named the new regulated network as regulated residual network (RegNet). The regulator module can be easily implemented and appended to any ResNet architecture. Experimental results on three image classification datasets have demonstrated the promising performance of the proposed architecture compared with the standard ResNet, squeeze-and-excitation ResNet, and other state-of-the-art architectures.
What problem does this paper attempt to address?