Abstract:This paper presents a new hybrid learning and control method that can tune their parameters based on reinforcement learning. In the new proposed method, nonlinear controllers are considered multi-input multi-output functions and then the functions are replaced with SNNs with reinforcement learning algorithms. Dopamine-modulated spike-timing-dependent plasticity (STDP) is used for reinforcement learning and manipulating the synaptic weights between the input and output of neuronal groups (for parameter adjustment). Details of the method are presented and some case studies are done on nonlinear controllers such as Fractional Order PID (FOPID) and Feedback Linearization. The structure and the dynamic equations for learning are presented, and the proposed algorithm is tested on robots and results are compared with other works. Moreover, to demonstrate the effectiveness of SNNFOPID, we conducted rigorous testing on a variety of systems including a two-wheel mobile robot, a double inverted pendulum, and a four-link manipulator robot. The results revealed impressively low errors of 0.01 m, 0.03 rad, and 0.03 rad for each system, respectively. The method is tested on another controller named Feedback Linearization, which provides acceptable results. Results show that the new method has better performance in terms of Integral Absolute Error (IAE) and is highly useful in hardware implementation due to its low energy consumption, high speed, and accuracy. The duration necessary for achieving full and stable proficiency in the control of various robotic systems using SNNFOPD, and SNNFL on an Asus Core i5 system within Simulink's Simscape environment is as follows: - Two-link robot manipulator with SNNFOPID: 19.85656 hours - Two-link robot manipulator with SNNFL: 0.45828 hours - Double inverted pendulum with SNNFOPID: 3.455 hours - Mobile robot with SNNFOPID: 3.71948 hours - Four-link robot manipulator with SNNFOPID: 16.6789 hours. This method can be generalized to other controllers and systems like robots.

FPGA Implementation of Self-Organized Spiking Neural Network Controller for Mobile Robots

A Bio-inspired Spiking Neural Network for Control of A 4-Dof Robotic Arm

An Auditory and Olfactory Data Fusion Algorithm Based on Spiking Neural Network for Mobile Robot

An autonomous learning mobile robot using biological reward modulate STDP

An FPGA hardware/software co-design towards evolvable spiking neural networks for robotics application

Spatial Properties of STDP in a Self-Learning Spiking Neural Network Enable Controlling a Mobile Robot

A Target-Reaching Controller for Mobile Robots Using Spiking Neural Networks

A new hybrid learning control system for robots based on spiking neural networks

Neuromorphic Robust Framework for Concurrent Estimation and Control in Dynamical Systems using Spiking Neural Networks

FPGA-based Controller for a Mobile Robot

Closed-loop spiking control on a neuromorphic processor implemented on the iCub

Field-programmable gate array implementation of a probabilistic neural network for motor cortical decoding in rats.

Adaptive Robotic Arm Control with a Spiking Recurrent Neural Network on a Digital Accelerator

Real-time self-reaction of mobile robot with genetic fuzzy neural network in unknown environment

A Novel Robotic Controller Using Neural Engineering Framework-Based Spiking Neural Networks

Adaptive motor control and learning in a spiking neural network realised on a mixed-signal neuromorphic processor

Differential mapping spiking neural network for sensor-based robot control

Intelligent Control System for Brain-Controlled Mobile Robot Using Self-Learning Neuro-Fuzzy Approach

A Rapid Adapting and Continual Learning Spiking Neural Network Path Planning Algorithm for Mobile Robots

A Bioinspired Synthetic Nervous System Controller for Pick-and-Place Manipulation

An All-Neuron Spiking 2-D Path Integration and Map Representation Model Implemented on Neuromorphic Chips