Abstract:Token interaction operation is one of the core modules in MLP-based models to exchange and aggregate information between different spatial locations. However, the power of token interaction on the spatial dimension is highly dependent on the spatial resolution of the feature maps, which limits the model's expressive ability, especially in deep layers where the feature are down-sampled to a small spatial size. To address this issue, we present a novel method called \textbf{Strip-MLP} to enrich the token interaction power in three ways. Firstly, we introduce a new MLP paradigm called Strip MLP layer that allows the token to interact with other tokens in a cross-strip manner, enabling the tokens in a row (or column) to contribute to the information aggregations in adjacent but different strips of rows (or columns). Secondly, a \textbf{C}ascade \textbf{G}roup \textbf{S}trip \textbf{M}ixing \textbf{M}odule (CGSMM) is proposed to overcome the performance degradation caused by small spatial feature size. The module allows tokens to interact more effectively in the manners of within-patch and cross-patch, which is independent to the feature spatial size. Finally, based on the Strip MLP layer, we propose a novel \textbf{L}ocal \textbf{S}trip \textbf{M}ixing \textbf{M}odule (LSMM) to boost the token interaction power in the local region. Extensive experiments demonstrate that Strip-MLP significantly improves the performance of MLP-based models on small datasets and obtains comparable or even better results on ImageNet. In particular, Strip-MLP models achieve higher average Top-1 accuracy than existing MLP-based models by +2.44\% on Caltech-101 and +2.16\% on CIFAR-100. The source codes will be available at~\href{<a class="link-external link-https" href="https://github.com/Med-Process/Strip_MLP" rel="external noopener nofollow">this https URL</a>{<a class="link-external link-https" href="https://github.com/Med-Process/Strip" rel="external noopener nofollow">this https URL</a>\_MLP}.

Representation Learning Method for Circular Seal Based on Modified MLP-Mixer

A Novel Seal Imprint Verification Method Based On Analysis Of Difference Images And Symbolic Representation

Multi-Scale MLP-Mixer for image classification

A New Method on the Segmentation and Recognition of Chinese Characters for Automatic Chinese Seal Imprint Retrieval.

Seal Image Registration Based on Shape and Layout Characteristics

Automatic Seal Identification Based on Multiscale Wavelet Analysis and SVM

Strip-MLP: Efficient Token Interaction for Vision MLP

S$^2$-MLP: Spatial-Shift MLP Architecture for Vision

DynaMixer: A Vision MLP Architecture with Dynamic Mixing.

RMMLP:Rolling MLP and matrix decomposition for skin lesion segmentation

D2-MLP: Dynamic Decomposed MLP Mixer for Medical Image Segmentation

A new method for character segmentation and skew correction on Chinese seal images

TokenPacker: Efficient Visual Projector for Multimodal LLM

Seal: Advancing Speech Language Models to be Few-Shot Learners

Cardiac MRI segmentation using shifted-window multilayer perceptron mixer networks

Gesture Recognition Using MLP-Mixer With CNN and Stacking Ensemble for sEMG Signals

Enhanced diffusion-based model for rubber stamp removal

A Self-Supervised Learning Based Channel Attention MLP-Mixer Network for Motor Imagery Decoding

Status Recognition of Magnetic Fluid Seal Based on High-Order Cumulant Image and VGG16

Seal2Real: Prompt Prior Learning on Diffusion Model for Unsupervised Document Seal Data Generation and Realisation

DB-EAC and LSTR: DBnet based seal text detection and Lightweight Seal Text Recognition