Abstract:Token interaction operation is one of the core modules in MLP-based models to exchange and aggregate information between different spatial locations. However, the power of token interaction on the spatial dimension is highly dependent on the spatial resolution of the feature maps, which limits the model's expressive ability, especially in deep layers where the feature are down-sampled to a small spatial size. To address this issue, we present a novel method called \textbf{Strip-MLP} to enrich the token interaction power in three ways. Firstly, we introduce a new MLP paradigm called Strip MLP layer that allows the token to interact with other tokens in a cross-strip manner, enabling the tokens in a row (or column) to contribute to the information aggregations in adjacent but different strips of rows (or columns). Secondly, a \textbf{C}ascade \textbf{G}roup \textbf{S}trip \textbf{M}ixing \textbf{M}odule (CGSMM) is proposed to overcome the performance degradation caused by small spatial feature size. The module allows tokens to interact more effectively in the manners of within-patch and cross-patch, which is independent to the feature spatial size. Finally, based on the Strip MLP layer, we propose a novel \textbf{L}ocal \textbf{S}trip \textbf{M}ixing \textbf{M}odule (LSMM) to boost the token interaction power in the local region. Extensive experiments demonstrate that Strip-MLP significantly improves the performance of MLP-based models on small datasets and obtains comparable or even better results on ImageNet. In particular, Strip-MLP models achieve higher average Top-1 accuracy than existing MLP-based models by +2.44\% on Caltech-101 and +2.16\% on CIFAR-100. The source codes will be available at~\href{<a class="link-external link-https" href="https://github.com/Med-Process/Strip_MLP" rel="external noopener nofollow">this https URL</a>{<a class="link-external link-https" href="https://github.com/Med-Process/Strip" rel="external noopener nofollow">this https URL</a>\_MLP}.

DuMLP-Pin: A Dual-MLP-dot-product Permutation-invariant Network for Set Feature Extraction

DuInNet: Dual-Modality Feature Interaction for Point Cloud Completion

Mini-PointNetPlus: a local feature descriptor in deep learning model for 3d environment perception

LPFE-Net: a local parallel feature extraction network for large-scale point cloud semantic segmentation

HyperMLP: Superpixel Prior and Feature Aggregated Perceptron Networks for Hyperspectral and LiDAR Hybrid Classification

SPDC: A SUPER-POINT AND POINT COMBINING BASED DUAL-SCALE CONTRASTIVE LEARNING NETWORK FOR POINT CLOUD SEMANTIC SEGMENTATION

Boosting Multiagent Reinforcement Learning via Permutation Invariant and Permutation Equivariant Networks

Learning-Based Dimensionality Reduction for Computing Compact and Effective Local Feature Descriptors

PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling

DPANet: Position‐aware feature encoding and decoding for accurate large‐scale point cloud semantic segmentation

Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Framework

EP-Net: Improving Point Cloud Learning Efficiency Through Feature Decoupling

Deep Neural Network for Point Sets Based on Local Feature Integration

PSVMLP: Point and Shifted Voxel MLP for 3D Deep Learning

Point is a Vector: A Feature Representation in Point Analysis

Improving Deep Learning on Point Cloud by Maximizing Mutual Information Across Layers

Point Deformable Network with Enhanced Normal Embedding for Point Cloud Analysis

Strip-MLP: Efficient Token Interaction for Vision MLP

Vision Permutator: A Permutable MLP-Like Architecture for Visual Recognition

MInet: A Novel Network Model for Point Cloud Processing by Integrating Multi-Modal Information

Enhancing Robustness to Noise Corruption for Point Cloud Recognition via Spatial Sorting and Set-Mixing Aggregation Module