Abstract:Spiking neural networks (SNNs) are believed to be a powerful neural computation framework inspired by the vivo neurons. As a class of recurrent SNNs, liquid state machines (LSMs) are biologically more plausible models imitating the architecture and functions of the human brain for information processing. However, few LSM models can outperform conventional analogue neural networks for solving real-world classification or regression problems, which can mainly be attributed to the sensitivity of the training performance to the architecture of the reservoir and the parameters in the spiking neuron models. Most recently, many algorithms have been proposed for automated machine learning that aims to automatically design the architecture and parameters of deep neural networks without much human intervention. Although automated machine learning and neural architecture search have been extremely successful in conventional neural networks, little research on search for an optimal architecture and hyperparameters of LSMs has been reported. This work proposes on a surrogate-assisted evolutionary search method for optimization of the hyperparameters and neural architecture of the reservoir of LSMs using the covariance matrix adaptation evolution strategy (CMA-ES). For reducing the search space, the architecture of the LSM is encoded by a connectivity probability together with the hyperparameters in the spiking neuron models. To enhance the computational efficiency, a Gaussian process is adopted as the surrogate to assist the CMA-ES. The proposed GP-assisted CMA-ES is compared with the canonical CMA-ES and a Bayesian optimization algorithm on two popular datasets including image and action recognition. Our results confirm that the proposed algorithm is efficient and effective in optimizing the parameters and architecture of LSMs.

The Separation Property Enhancement of Liquid State Machine by Particle Swarm Optimization

Evolutionary Optimization Of Liquid State Machines For Robust Learning

Improving Liquid State Machine with Hybrid Plasticity

The Critical Dynamics in Neural Network Improve the Computational Capability of Liquid State Machines.

Surrogate-Assisted Cooperative Co-evolutionary Reservoir Architecture Search for Liquid State Machines

Computational Capability of Liquid State Machines with Spike-Timing-dependent Plasticity.

An Improved Particle Swarm Optimization Algorithm for Global Optimizations of Electromagnetic Devices

Surrogate-Assisted Evolutionary Search of Spiking Neural Architectures in Liquid State Machines

Learning Automata-Based Particle Swarm Optimizer.

Parallel Extreme Learning Machine Based on Improved Particle Swarm Optimization

Increasing Liquid State Machine Performance with Edge-of-Chaos Dynamics Organized by Astrocyte-modulated Plasticity

The Optimal Design and Application of LSTM Neural Network Based on the Hybrid Coding PSO Algorithm

Membrane computing based particle swarm optimization algorithm and its application

A multi-swarm optimizer with a reinforcement learning mechanism for large-scale optimization

A Self-Learning Particle Swarm Optimization Algorithm with Multi-Strategy Selection

Effects of Firing Patterns on Spike Strain Classification Performance of Liquid State Machine

Modified particle swarm optimization via probabilistic leap

Dynamic Training of Liquid State Machines

A chaotic quantum-behaved particle swarm optimization based on lateral inhibition for image matching

APSO-SL: An Adaptive Particle Swarm Optimization with State-Based Learning Strategy

A Particle Swarm Optimizer With Lifespan For Global Optimization On Multimodal Functions