Abstract:The past few years have witnessed the dramatic increase in layers of convolutional neural networks (CNN). Most studies focused on the CNN’s vertical structure design (e.g. residual structure, creating short paths architecture from early layers to later layers in vertical connections), but few people pay their attention to the process of feature generation and extraction in a single convolutional layer in CNN. In this paper, we find the non-feature suppression phenomenon in the process of extracting features. On the basis of this, we proposed an orthogonal approach named HSC (Horizontal Shortcut Connections) to improve feature representation fusion and computational efficiency for CNN. Especially, our HSC approach can effectively reduce interference overhead of non-feature areas and enhance the information fusion for depthwise convolution and group convolution which are the key blocks in lightweight neuron network. At HSC layer, the feature-maps of all preceding layer are properly connected with our strategy in horizon direction to constitute features and then produce a new representation which are used as input feature-maps passed on subsequent layers. Our HSC block can be plugged into convolution neural networks that include group convolution or depewise convolution, and can effectively improve accuracy of convolutional networks with slight additional computational cost. We evaluate our design on the popular lightweight neural networks and standard CNN structure. Compared with existing methods, we can achieve 1.63% accuracy improvement for MobileNet v2 on CIFAR-10 dataset and up to 3.70% accuracy improvement on CIFAR-100 dataset by adding HSC block after depthwise convolution, and 2.80% accuracy improvement on ImageNet dataset. For Mobilenet v3-small, we can achieve 0.8% accuracy improvement on ImageNet dataset. In order to prove the improvement effect of group convolution, the standard convolution is changed manually to group convolution and then the HSC block is added after group convolution, we can achieve 4X to 6X FLOPs improvement while maintaining the accuracy of neural networks. Notably, on ILSVRC- 2012, our method reduces more than 43% FLOPs on ResNet-50 without accuracy declines and reduces 60.1% FLOPs on ResNet-50 with 0.44% accuracy declines.We also present primary hardware experiment results when HSC framework running on special hardware platform.

Optimized Vectorizing of Building Structures With Switch: High-Efficiency Convolutional Channel-Switch Hybridization Strategy

Vectorized Building Extraction from High-Resolution Remote Sensing Images Using Spatial Cognitive Graph Convolution Model

UniNeXt: Exploring A Unified Architecture for Vision Recognition

IC-Network: Efficient Structure for Convolutional Neural Networks

Efficient Architecture Search by Network Transformation

SA-ConvONet: Sign-Agnostic Optimization of Convolutional Occupancy Networks

HSC: Leveraging Horizontal Shortcut Connections for Improving Accuracy and Computational Efficiency of Lightweight CNN.

An end-to-end shape modeling framework for vectorized building outline generation from aerial images

Asymmetric Network Combining CNN and Transformer for Building Extraction from Remote Sensing Images

Lightweight Convolutional Neural Networks with Model-Switching Architecture for Multi-Scenario Road Semantic Segmentation

Conv-MPN: Convolutional Message Passing Neural Network for Structured Outdoor Architecture Reconstruction

All You Need Is a Few Shifts: Designing Efficient Convolutional Neural Networks for Image Classification

Efficient Hybrid Feature Interaction Network for Stereo Image Super-Resolution

AddressNet: Shift-Based Primitives for Efficient Convolutional Neural Networks.

A Reconfigurable Spatial Architecture for Energy-Efficient Inception Neural Networks

CFNet: An Eigenvalue Preserved Approach to Multiscale Building Segmentation in High-Resolution Remote Sensing Images

STransU2Net: Transformer based hybrid model for building segmentation in detailed satellite imagery

HEAT: Holistic Edge Attention Transformer for Structured Reconstruction

OSNet & MNetO: Two Types of General Reconstruction Architectures for Linear Computed Tomography in Multi-Scenarios

Attention-Gate-Based Encoder–Decoder Network for Automatical Building Extraction

Shift-based Primitives for Efficient Convolutional Neural Networks