Abstract:Objective.The visual perception provided by retinal prostheses is limited by the overlapping current spread of adjacent electrodes. This reduces the spatial resolution attainable with unipolar stimulation. Conversely, simultaneous multipolar stimulation guided by the measured neural responses-neural activity shaping (NAS)-can attenuate excessive spread of excitation allowing for more precise control over the pattern of neural activation. However, defining effective multipolar stimulus patterns is a challenging task. Previous attempts focused on analytical solutions based on an assumed linear nonlinear model of retinal response; an analytical model inversion (AMI) approach. Here, we propose a model-free solution for NAS, using artificial neural networks (ANNs) that could be trained with data acquired from the implant.Approach.Our method consists of two ANNs trained sequentially. The measurement predictor network (MPN) is trained on data from the implant and is used to predict how the retina responds to multipolar stimulation. The stimulus generator network is trained on a large dataset of natural images and uses the trained MPN to determine efficient multipolar stimulus patterns by learning its inverse model. We validate our methodin silicousing a realistic model of retinal response to multipolar stimulation.Main results.We show that our ANN-based NAS approach produces sharper retinal activations than the conventional unipolar stimulation strategy. As a theoretical bench-mark of optimal NAS results, we implemented AMI stimulation by inverting the model used to simulate the retina. Our ANN strategy produced equivalent results to AMI, while not being restricted to any specific type of retina model and being three orders of magnitude more computationally efficient.Significance.Our novel protocol provides a method for efficient and personalized retinal stimulation, which may improve the visual experience and quality of life of retinal prosthesis users.

Transformer-based light-evoked retinal spiking activity prediction

Online Transformers with Spiking Neurons for Fast Prosthetic Hand Control

V1T: large-scale mouse V1 response prediction using a Vision Transformer

Spiking-timing based pattern recognition with real-world visual stimuli

HL-ESViT: High-Low Frequency Efficient Spiking Vision Transformer

Neural activity shaping in visual prostheses with deep learning

Predicting the Temporal Dynamics of Prosthetic Vision

Towards the Next Generation of Retinal Neuroprosthesis: Visual Computation with Spikes

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Temporal prediction captures retinal spiking responses across animal species

A Deep Learning-based in silico Framework for Optimization on Retinal Prosthetic Stimulation

Toward the Next Generation of Retinal Neuroprosthesis: Visual Computation with Spikes

Robust Decoding of Rich Dynamical Visual Scenes With Retinal Spikes

ViT-LCA: A Neuromorphic Approach for Vision Transformers

Electrical evoked potentials prediction model in visual prostheses based on support vector regression with multiple weights

Spatio-temporal transformers for decoding neural movement control

Optimizing Retinal Prosthetic Stimuli with Conditional Invertible Neural Networks

Deep Learning--Based Scene Simplification for Bionic Vision

Digital Implementation of the Retinal Spiking Neural Network under Light Stimulation

Predicting Electrical Evoked Potential in Optic Nerve Visual Prostheses by Using Support Vector Regression and Case-Based Prediction

Precise control of neural activity using dynamically optimized electrical stimulation