Abstract:MLP-like models built entirely upon multi-layer perceptrons have recently been revisited, exhibiting the comparable performance with transformers. It is one of most promising architectures due to the excellent trade-off between network capability and efficiency in the large-scale recognition tasks. However, its generalization performance to heterogeneous tasks is inferior to other architectures (e.g., CNNs and transformers) due to the extensive retention of domain information. To address this problem, we propose a novel frequency-aware MLP architecture, in which the domain-specific features are filtered out in the transformed frequency domain, augmenting the invariant descriptor for label prediction. Specifically, we design an adaptive Fourier filter layer, in which a learnable frequency filter is utilized to adjust the amplitude distribution by optimizing both the real and imaginary parts. A low-rank enhancement module is further proposed to rectify the filtered features by adding the low-frequency components from SVD decomposition. Finally, a momentum update strategy is utilized to stabilize the optimization to fluctuation of model parameters and inputs by the output distillation with weighted historical states. To our best knowledge, we are the first to propose a MLP-like backbone for domain generalization. Extensive experiments on three benchmarks demonstrate significant generalization performance, outperforming the state-of-the-art methods by a margin of 3%, 4% and 9%, respectively.

Applying SP-MLP to Complex Classification Problems

A Robust Model Based on Space-Partitioning Method

Feature Importance Measure of a Multilayer Perceptron Based on the Presingle-Connection Layer

Brain-inspired Multilayer Perceptron with Spiking Neurons

Local design for multi-layer perceptron

Efficient Language Modeling with Sparse all-MLP

A Fuzzy MLP Approach for Non-linear Pattern Classification

Hypergraph-MLP: Learning on Hypergraphs without Message Passing

Multilayer Perceptron for Sparse Functional Data

Complex Functional Networks

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

SS-MLP: A Novel Spectral-Spatial MLP Architecture for Hyperspectral Image Classification

BCMLP: Binary-connected multilayer perceptrons

Caterpillar: A Pure-MLP Architecture with Shifted-Pillars-Concatenation

HyperMLP: Superpixel Prior and Feature Aggregated Perceptron Networks for Hyperspectral and LiDAR Hybrid Classification

SA-MLP: Enhancing Point Cloud Classification with Efficient Addition and Shift Operations in MLP Architectures

PAC-Bayesian Generalization Bounds for MultiLayer Perceptrons

Boosting Single Positive Multi-label Classification with Generalized Robust Loss

A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP

FAMLP: A Frequency-Aware MLP-Like Architecture For Domain Generalization

SA-MLP: Distilling Graph Knowledge from GNNs into Structure-Aware MLP