Abstract:Modeling in Computer Vision has evolved to MLPs. Vision MLPs naturally lack local modeling capability, to which the simplest treatment is combined with convolutional layers. Convolution, famous for its sliding window scheme, also suffers from this scheme of redundancy and lower parallel computation. In this paper, we seek to dispense with the windowing scheme and introduce a more elaborate and parallelizable method to exploit locality. To this end, we propose a new MLP module, namely Shifted-Pillars-Concatenation (SPC), that consists of two steps of processes: (1) Pillars-Shift, which generates four neighboring maps by shifting the input image along four directions, and (2) Pillars-Concatenation, which applies linear transformations and concatenation on the maps to aggregate local features. SPC module offers superior local modeling power and performance gains, making it a promising alternative to the convolutional layer. Then, we build a pure-MLP architecture called Caterpillar by replacing the convolutional layer with the SPC module in a hybrid model of sMLPNet. Extensive experiments show Caterpillar's excellent performance on both small-scale and ImageNet-1k classification benchmarks, with remarkable scalability and transfer capability possessed as well. The code is available at <a class="link-external link-https" href="https://github.com/sunjin19126/Caterpillar" rel="external noopener nofollow">this https URL</a>.

A Robust Model Based on Space-Partitioning Method

Applying SP-MLP to Complex Classification Problems

Feature Importance Measure of a Multilayer Perceptron Based on the Presingle-Connection Layer

Optimum Scheme Selection for Multilayer Perceptron-Based Monte Carlo Simulation of Slope System Reliability

Improving Model Robustness Against Adversarial Examples with Redundant Fully Connected Layer.

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

A SELF-ORGANIZING NEURAL NETWORK FOR PARTITIONING ON MCM

A MARKET CLEARING PRICE PREDICTOR BASED ON MODULAR NETWORKS

Efficient Language Modeling with Sparse all-MLP

Brain-inspired Multilayer Perceptron with Spiking Neurons

Boosting Single Positive Multi-label Classification with Generalized Robust Loss

Multilayer Perceptron for Sparse Functional Data

SPP-CNN: An Efficient Framework for Network Robustness Prediction

BCMLP: Binary-connected multilayer perceptrons

A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP

Robust Speech Recognition Based on Neighborhood Space

PAC-Bayesian Generalization Bounds for MultiLayer Perceptrons

Sparse-MLP: A Fully-MLP Architecture with Conditional Computation

Sparse DNNs with Improved Adversarial Robustness.

Caterpillar: A Pure-MLP Architecture with Shifted-Pillars-Concatenation

Subspace learning machine (SLM): Methodology and performance evaluation