Abstract:A key challenge for neural modeling is to explain how a continuous stream of multimodal input from a rapidly changing environment can be processed by stereotypical recurrent circuits of integrate-and-fire neurons in real time. We propose a new computational model for real-time computing on time-varying input that provides an alternative to paradigms based on Turing machines or attractor neural networks. It does not require a task-dependent construction of neural circuits. Instead, it is based on principles of high-dimensional dynamical systems in combination with statistical learning theory and can be implemented on generic evolved or found recurrent circuitry. It is shown that the inherent transient dynamics of the high-dimensional dynamical system formed by a sufficiently large and heterogeneous neural circuit may serve as universal analog fading memory. Readout neurons can learn to extract in real time from the current state of such recurrent neural circuit information about current and past inputs that may be needed for diverse tasks. Stable internal states are not required for giving a stable output, since transient internal states can be transformed by readout neurons into stable target outputs due to the high dimensionality of the dynamical system. Our approach is based on a rigorous computational model, the liquid state machine, that, unlike Turing machines, does not require sequential transitions between well-defined discrete internal states. It is supported, as the Turing machine is, by rigorous mathematical results that predict universal computational power under idealized conditions, but for the biologically more realistic scenario of real-time processing of time-varying inputs. Our approach provides new perspectives for the interpretation of neural coding, the design of experiments and data analysis in neurophysiology, and the solution of problems in robotics and neurotechnology.

Input-to-State Stable Neural Ordinary Differential Equations with Applications to Transient Modeling of Circuits

A Physics-Informed Neural Networks Algorithm for Simulating Semiconductor Devices

Chaos in A Neuron Model with Adaptive Feedback Synapse: Electronic Circuit Design

Input-to-state stability of impulsive reaction–diffusion neural networks with infinite distributed delays

Input-to-state stability of delayed memristor-based inertial neural networks via non-reduced order method

Input-to-state Stability of Discrete-Time Memristive Neural Networks with Two Delay Components.

Neural networks with transient state dynamics

Circuit Design of Tabu Learning Neuron Models and Their Dynamic Behavior

Constrained Neural Ordinary Differential Equations with Stability Guarantees

Learning Stable and Passive Neural Differential Equations

Delayed standard neural network models for control systems.

Virtual Analog Modeling of Distortion Circuits Using Neural Ordinary Differential Equations

Real-time computing without stable states: a new framework for neural computation based on perturbations

Analog-Digital Simulations of Full Conductance-Based Networks of Spiking Neurons with Spike Timing Dependent Plasticity

Compact hybrid type electronic neuron and computational model of its dynamics

Learning Neural Event Functions for Ordinary Differential Equations

Global multistability and analog circuit implementation of an adapting synapse-based neuron model

Input-to-state Stability Analysis of Stochastic Delayed Switching Systems

Exponential Input-to-state Stability of Stochastic Delay Reaction–diffusion Neural Networks

Exponential Input‐To‐State Stability of Quaternion‐Valued Memristive Neural Networks: Continuous and Discrete Cases

Relaxed Conditions for the Input-To-State Stability of Switched Nonlinear Time-Varying Systems