Abstract:This paper presents a new hybrid learning and control method that can tune their parameters based on reinforcement learning. In the new proposed method, nonlinear controllers are considered multi-input multi-output functions and then the functions are replaced with SNNs with reinforcement learning algorithms. Dopamine-modulated spike-timing-dependent plasticity (STDP) is used for reinforcement learning and manipulating the synaptic weights between the input and output of neuronal groups (for parameter adjustment). Details of the method are presented and some case studies are done on nonlinear controllers such as Fractional Order PID (FOPID) and Feedback Linearization. The structure and the dynamic equations for learning are presented, and the proposed algorithm is tested on robots and results are compared with other works. Moreover, to demonstrate the effectiveness of SNNFOPID, we conducted rigorous testing on a variety of systems including a two-wheel mobile robot, a double inverted pendulum, and a four-link manipulator robot. The results revealed impressively low errors of 0.01 m, 0.03 rad, and 0.03 rad for each system, respectively. The method is tested on another controller named Feedback Linearization, which provides acceptable results. Results show that the new method has better performance in terms of Integral Absolute Error (IAE) and is highly useful in hardware implementation due to its low energy consumption, high speed, and accuracy. The duration necessary for achieving full and stable proficiency in the control of various robotic systems using SNNFOPD, and SNNFL on an Asus Core i5 system within Simulink's Simscape environment is as follows: - Two-link robot manipulator with SNNFOPID: 19.85656 hours - Two-link robot manipulator with SNNFL: 0.45828 hours - Double inverted pendulum with SNNFOPID: 3.455 hours - Mobile robot with SNNFOPID: 3.71948 hours - Four-link robot manipulator with SNNFOPID: 16.6789 hours. This method can be generalized to other controllers and systems like robots.

Differential mapping spiking neural network for sensor-based robot control

A Bio-inspired Spiking Neural Network for Control of A 4-Dof Robotic Arm

A Novel Robotic Controller Using Neural Engineering Framework-Based Spiking Neural Networks

A Fully Spiking Neural Control System Based on Cerebellar Predictive Learning for Sensor-Guided Robots

From sensors to spikes: evolving receptive fields to enhance sensorimotor information in a robot-arm

A new hybrid learning control system for robots based on spiking neural networks

A Target-Reaching Controller for Mobile Robots Using Spiking Neural Networks

Adaptive Robotic Control Driven by a Versatile Spiking Cerebellar Network

A Navigation Cognitive System Driven by Hierarchical Spiking Neural Network.

Spatial Properties of STDP in a Self-Learning Spiking Neural Network Enable Controlling a Mobile Robot

Vision-Action Semantic Associative Learning Based on Spiking Neural Networks for Cognitive Robot.

Vision-Based Control for Robots by a Fully Spiking Neural System Relying on Cerebellar Predictive Learning

Neuromorphic Robust Framework for Concurrent Estimation and Control in Dynamical Systems using Spiking Neural Networks

A Spiking Neural Network Mimics the Oculomotor System to Control a Biomimetic Robotic Head without Learning on a Neuromorphic Hardware

Motorsrnn: A Spiking Recurrent Neural Network Inspired by Brain Topology for the Effective and Efficient Decoding of Cortical Spike Trains

Mapping Very Large Scale Spiking Neuron Network to Neuromorphic Hardware.

Learning over time using a neuromorphic adaptive control algorithm for robotic arms

Spiking neural networks: Towards bio-inspired multimodal perception in robotics

A Self-Organizing Network with Varying Density Structure for Characterizing Sensorimotor Transformations in Robotic Systems

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Closed-loop spiking control on a neuromorphic processor implemented on the iCub