Abstract:In recent years, spiking neural networks (SNNs) have been used inreinforcement learning (RL) due to their low power consumption and event-drivenfeatures. However, spiking reinforcement learning (SRL), which suffers fromfixed coding methods, still faces the problems of high latency and poorversatility. In this paper, we use learnable matrix multiplication to encodeand decode spikes, improving the flexibility of the coders and thus reducinglatency. Meanwhile, we train the SNNs using the direct training method and usetwo different structures for online and offline RL algorithms, which gives ourmodel a wider range of applications. Extensive experiments have revealed thatour method achieves optimal performance with ultra-low latency (as low as 0.8of other SRL methods) and excellent energy efficiency (up to 5X the DNNs) indifferent algorithms and different environments.

A Low Latency Adaptive Coding Spike Framework for Deep Reinforcement Learning