Abstract:To navigate in new environments, an animal must be able to keep track of its position while simultaneously creating and updating an internal map of features in the environment, a problem formulated as simultaneous localization and mapping (SLAM) in the field of robotics. This requires integrating information from different domains, including self-motion cues, sensory, and semantic information. Several specialized neuron classes have been identified in the mammalian brain as being involved in solving SLAM. While biology has inspired a whole class of SLAM algorithms, the use of semantic information has not been explored in such work. We present a novel, biologically plausible SLAM model called SSP-SLAM-a spiking neural network designed using tools for large scale cognitive modeling. Our model uses a vector representation of continuous spatial maps, which can be encoded via spiking neural activity and bound with other features (continuous and discrete) to create compressed structures containing semantic information from multiple domains (e.g., spatial, temporal, visual, conceptual). We demonstrate that the dynamics of these representations can be implemented with a hybrid oscillatory-interference and continuous attractor network of head direction cells. The estimated self-position from this network is used to learn an associative memory between semantically encoded landmarks and their positions, i.e., an environment map, which is used for loop closure. Our experiments demonstrate that environment maps can be learned accurately and their use greatly improves self-position estimation. Furthermore, grid cells, place cells, and object vector cells are observed by this model. We also run our path integrator network on the NengoLoihi neuromorphic emulator to demonstrate feasibility for a full neuromorphic implementation for energy efficient SLAM.

31.1 A 65nm 8.79TOPS/W 23.82mW Mixed-Signal Oscillator-Based NeuroSLAM Accelerator for Applications in Edge Robotics

NanoSLAM: Enabling Fully Onboard SLAM for Tiny Robots

An FPGA Based Energy Efficient DS-SLAM Accelerator for Mobile Robots in Dynamic Environment

A compact neuromorphic system for ultra energy-efficient, on-device robot localization

Exploiting semantic information in a spiking neural SLAM system

Edgeslam2: Rethinking Edge-Assisted Visual SLAM with On-Chip Intelligence

Efficient Hardware Accelerator Design of Non-Linear Optimization Correlative Scan Matching Algorithm in 2D LiDAR SLAM for Mobile Robots

SLAM-CIM: A Visual SLAM Backend Processor with Dynamic-Range-Driven-Skipping Linear-Solving FP-CIM Macros

Hardware Acceleration for SLAM in Mobile Systems

An FPGA-based Real-Time Simultaneous Localization and Mapping System.

Reshaping Edge-Assisted Visual SLAM by Embracing On-Chip Intelligence

Edge Assisted Mobile Semantic Visual SLAM

A Brain-inspired SLAM System Based on ORB Features

FPSNET: An Architecture for Neural-Network-Based Feature Point Extraction for SLAM

Edge Robotics: Edge-Computing-Accelerated Multi-Robot Simultaneous Localization and Mapping

Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mapping

High-Speed Stereo Visual SLAM for Low-Powered Computing Devices

An All-Neuron Spiking 2-D Path Integration and Map Representation Model Implemented on Neuromorphic Chips

SPAQ-DL-SLAM: Towards Optimizing Deep Learning-based SLAM for Resource-Constrained Embedded Platforms

Application of Event Cameras and Neuromorphic Computing to VSLAM: A Survey