Abstract:Point cloud analysis has seen substantial advancements due to deep learning, although previous Transformer-based methods excel at modeling long-range dependencies on this task, their computational demands are substantial. Conversely, the Mamba offers greater efficiency but shows limited potential compared with Transformer-based methods. In this study, we introduce PoinTramba, a pioneering hybrid framework that synergies the analytical power of Transformer with the remarkable computational efficiency of Mamba for enhanced point cloud analysis. Specifically, our approach first segments point clouds into groups, where the Transformer meticulously captures intricate intra-group dependencies and produces group embeddings, whose inter-group relationships will be simultaneously and adeptly captured by efficient Mamba architecture, ensuring comprehensive analysis. Unlike previous Mamba approaches, we introduce a bi-directional importance-aware ordering (BIO) strategy to tackle the challenges of random ordering effects. This innovative strategy intelligently reorders group embeddings based on their calculated importance scores, significantly enhancing Mamba's performance and optimizing the overall analytical process. Our framework achieves a superior balance between computational efficiency and analytical performance by seamlessly integrating these advanced techniques, marking a substantial leap forward in point cloud analysis. Extensive experiments on datasets such as ScanObjectNN, ModelNet40, and ShapeNetPart demonstrate the effectiveness of our approach, establishing a new state-of-the-art analysis benchmark on point cloud recognition. For the first time, this paradigm leverages the combined strengths of both Transformer and Mamba architectures, facilitating a new standard in the field. The code is available at <a class="link-external link-https" href="https://github.com/xiaoyao3302/PoinTramba" rel="external noopener nofollow">this https URL</a>.

Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategy

Point Cloud Mamba: Point Cloud Learning via State Space Model

PointMamba: A Simple State Space Model for Point Cloud Analysis

Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model

NIMBA: Towards Robust and Principled Processing of Point Clouds With SSMs

Serialized Point Mamba: A Serialized Point Cloud Mamba Segmentation Model

Point Cloud Domain Adaptation Via Masked Local 3D Structure Prediction

PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysis

Exploring contextual modeling with linear complexity for point cloud segmentation

PoinTramba: A Hybrid Transformer-Mamba Framework for Point Cloud Analysis

3DMambaComplete: Exploring Structured State Space Model for Point Cloud Completion

MAMBA4D: Efficient Long-Sequence Point Cloud Video Understanding with Disentangled Spatial-Temporal State Space Models

Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detection

Rethinking Efficient and Effective Point-based Networks for Event Camera Classification and Regression: EventMamba

LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling

OccMamba: Semantic Occupancy Prediction with State Space Models

Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Framework

Spatial-Mamba: Effective Visual State Space Models via Structure-Aware State Fusion

PointSSC: A Cooperative Vehicle-Infrastructure Point Cloud Benchmark for Semantic Scene Completion

3DMambaIPF: A State Space Model for Iterative Point Cloud Filtering via Differentiable Rendering

Point-SAM: Promptable 3D Segmentation Model for Point Clouds