Abstract:Blindness affects millions of people around the world. A promising solution to restoring a form of vision for some individuals are cortical visual prostheses, which bypass part of the impaired visual pathway by converting camera input to electrical stimulation of the visual system. The artificially induced visual percept (a pattern of localized light flashes, or 'phosphenes') has limited resolution, and a great portion of the field's research is devoted to optimizing the efficacy, efficiency, and practical usefulness of the encoding of visual information. A commonly exploited method is non-invasive functional evaluation in sighted subjects or with computational models by using simulated prosthetic vision (SPV) pipelines. An important challenge in this approach is to balance enhanced perceptual realism, biologically plausibility, and real-time performance in the simulation of cortical prosthetic vision. We present a biologically plausible, PyTorch-based phosphene simulator that can run in real-time and uses differentiable operations to allow for gradient-based computational optimization of phosphene encoding models. The simulator integrates a wide range of clinical results with neurophysiological evidence in humans and non-human primates. The pipeline includes a model of the retinotopic organization and cortical magnification of the visual cortex. Moreover, the quantitative effects of stimulation parameters and temporal dynamics on phosphene characteristics are incorporated. Our results demonstrate the simulator's suitability for both computational applications such as end-to-end deep learning-based prosthetic vision optimization as well as behavioral experiments. The modular and open-source software provides a flexible simulation framework for computational, clinical, and behavioral neuroscientists working on visual neuroprosthetics.

Estimating the Position of Simulated Phosphenes Using A Tactile Guide

Study of tactile perception based on phosphene positioning using simulated prosthetic vision.

Estimation of simulated phosphene size based on tactile perception.

Dispersion and Accuracy of Simulated Phosphene Positioning Using Tactile Board.

Simulated Phosphene Model for Visual Prosthesis.

The Influence of Phosphene Synchrony in Driving Object Binding in a Simulation of Artificial Vision

Chinese Character Recognition Using Simulated Phosphene Maps

Virtual reality simulation of epiretinal stimulation highlights the relevance of the visual angle in prosthetic vision

Rehabilitation regimes based upon psychophysical studies of prosthetic vision

Predicting the Temporal Dynamics of Prosthetic Vision

Towards biologically plausible phosphene simulation for the differentiable optimization of visual cortical prostheses

C-Sight Visual Prostheses For The Blind - Optic Nerve Stimulation With Penetrating Electrode Array

Assessing visual acuity in visual prostheses through a virtual-reality system

Study of Simulated Phosphene Size Based on Tactile Perception with Three Distributions

Visual Prosthesis for Optic Nerve Stimulation

Clinical Progress and Optimization of Information Processing in Artificial Visual Prostheses

Phosphene Object Perception Employs Holistic Processing During Early Visual Processing Stage

Micro-stimulator Design for Visual Prosthesis Based on Optic Nerve Stimulation

Object recognition under distorted prosthetic vision.

Numerical Design of a Micro-LED Based Optogenetic Stimulator for Visual Cortical Prosthesis

Minimizing the number of phosphenes required for object recognition under prosthetic vision