Processing properties of ON and OFF pathways for Drosophila motion detection

Rudy Behnia,Damon A. Clark,Adam G. Carter,Thomas R. Clandinin,Claude Desplan

DOI: https://doi.org/10.1038/nature13427

IF: 64.8

2014-07-06

Nature

Abstract:Four medulla neurons implement two critical processing steps to incoming signals in Drosophila motion detection.

multidisciplinary sciences

What problem does this paper attempt to address?

Different spectral sensitivities of ON- and OFF-motion pathways enhance the detection of approaching color objects in Drosophila

Kit D. Longden,Edward M. Rogers,Aljoscha Nern,Heather Dionne,Michael B. Reiser

DOI: https://doi.org/10.1038/s41467-023-43566-8

IF: 16.6

2023-11-24

Nature Communications

Abstract:Abstract Color and motion are used by many species to identify salient objects. They are processed largely independently, but color contributes to motion processing in humans, for example, enabling moving colored objects to be detected when their luminance matches the background. Here, we demonstrate an unexpected, additional contribution of color to motion vision in Drosophila . We show that behavioral ON-motion responses are more sensitive to UV than for OFF-motion, and we identify cellular pathways connecting UV-sensitive R7 photoreceptors to ON and OFF-motion-sensitive T4 and T5 cells, using neurogenetics and calcium imaging. Remarkably, this contribution of color circuitry to motion vision enhances the detection of approaching UV discs, but not green discs with the same chromatic contrast, and we show how this could generalize for systems with ON- and OFF-motion pathways. Our results provide a computational and circuit basis for how color enhances motion vision to favor the detection of saliently colored objects.

multidisciplinary sciences
Behavioral state modulates the ON visual motion pathway of Drosophila

James A. Strother,Shiuan-Tze Wu,Edward M. Rogers,Jessica L. M. Eliason,Allan M. Wong,Aljoscha Nern,Michael B. Reiser

DOI: https://doi.org/10.1073/pnas.1703090115

IF: 11.1

2017-12-18

Proceedings of the National Academy of Sciences

Abstract:Significance Animal visual systems are typically thought of by analogy to cameras—sensory systems providing continuous information streams that are processed through fixed algorithms. However, studies in flies and mice have shown that visual neurons are dynamically and adaptively retuned by the behavioral state of the animal. In Drosophila , prominent higher-order neurons in the visual system respond more strongly to fast-moving stimuli once the animal starts walking or flying. In this study, we systematically investigated the neurobiological mechanism governing the behavioral-state modulation of directionally selective neurons in Drosophila . We show that behavioral activity modifies the physiological properties of critical neurons in this visual motion circuit and that neuromodulation by central feedback neurons recapitulates these effects.
The Emergence of Directional Selectivity in the Visual Motion Pathway of Drosophila

James A. Strother,Shiuan-Tze Wu,Allan M. Wong,Aljoscha Nern,Edward M. Rogers,Jasmine Q. Le,Gerald M. Rubin,Michael B. Reiser

DOI: https://doi.org/10.1016/j.neuron.2017.03.010

IF: 16.2

2017-04-01

Neuron

Abstract:The perception of visual motion is critical for animal navigation, and flies are a prominent model system for exploring this neural computation. In Drosophila, the T4 cells of the medulla are directionally selective and necessary for ON motion behavioral responses. To examine the emergence of directional selectivity, we developed genetic driver lines for the neuron types with the most synapses onto T4 cells. Using calcium imaging, we found that these neuron types are not directionally selective and that selectivity arises in the T4 dendrites. By silencing each input neuron type, we identified which neurons are necessary for T4 directional selectivity and ON motion behavioral responses. We then determined the sign of the connections between these neurons and T4 cells using neuronal photoactivation. Our results indicate a computational architecture for motion detection that is a hybrid of classic theoretical models.

neurosciences
Non-canonical Receptive Field Properties and Neuromodulation of Feature-Detecting Neurons in Flies

Carola Städele,Mehmet F Keleş,Jean-Michel Mongeau,Mark A Frye

DOI: https://doi.org/10.1016/j.cub.2020.04.069

2020-07-06

Abstract:Several fundamental aspects of motion vision circuitry are prevalent across flies and mice. Both taxa segregate ON and OFF signals. For any given spatial pattern, motion detectors in both taxa are tuned to speed, selective for one of four cardinal directions, and modulated by catecholamine neurotransmitters. These similarities represent conserved, canonical properties of the functional circuits and computational algorithms for motion vision. Less is known about feature detectors, including how receptive field properties differ from the motion pathway or whether they are under neuromodulatory control to impart functional plasticity for the detection of salient objects from a moving background. Here, we investigated 19 types of putative feature selective lobula columnar (LC) neurons in the optic lobe of the fruit fly Drosophila melanogaster to characterize divergent properties of feature selection. We identified LC12 and LC15 as feature detectors. LC15 encodes moving bars, whereas LC12 is selective for the motion of discrete objects, mostly independent of size. Neither is selective for contrast polarity, speed, or direction, highlighting key differences in the underlying algorithms for feature detection and motion vision. We show that the onset of background motion suppresses object responses by LC12 and LC15. Surprisingly, the application of octopamine, which is released during flight, reverses the suppressive influence of background motion, rendering both LCs able to track moving objects superimposed against background motion. Our results provide a comparative framework for the function and modulation of feature detectors and new insights into the underlying neuronal mechanisms involved in visual feature detection.
Neuronal ON/OFF Motion Detection Circuits Underlying Looming-Evoked Escape Behavior in Drosophila

Yeosun Kyung,Richard B. Dewell,Herman A. Dierick,Fabrizio Gabbiani

DOI: https://doi.org/10.1101/2019.12.26.883587

2019-12-27

Abstract:Abstract In Drosophila , early visual processing of motion information segregates in separate ON and OFF pathways. These pathways have been studied in the context of local directional motion detection leading to the encoding of optic flow that provides visual information for flight stabilization. Less is known about their role in detecting impending collision and generating escape behaviors. ‘Looming’, the simulated approach of an object at constant speed towards an animal, provides a powerful stimulus eliciting jump escape behaviors in stationary flies. We presented looming stimuli mimicking the approach of either a dark object on a bright background or a light object on a dark background, while inactivating neurons belonging either to the ON- or the OFF-motion detection pathways by expressing the dominant Drosophila temperature-sensitive mutant shibire ts in different cells of the ON/OFF pathway. Inactivation of ON, respectively OFF, neurons led to selective decreases in escape behavior to light, resp. dark, looming stimuli. Quantitative analysis showed a nearly perfect splitting of these effects according to the ON/OFF type of the targeted neural populations. Our results suggest that Drosophila ON/OFF motion detection pathways play an important role in controlling jump escape responses according to looming stimulus polarity. They further imply that the biophysical circuits triggering Drosophila jump escape behaviors likely differ substantially from those characterized in other arthropods. Summary Inactivating fly neurons of the ON or OFF directional motion detection pathways during escape behavior selectively reduced jump responses to light and dark looming stimuli, respectively.
Multiple Spectral Inputs Improve Motion Discrimination in the Drosophila Visual System.

Trevor J. Wardill,Olivier List,Xiaofeng Li,Sidhartha Dongre,Marie McCulloch,Chun-Yuan Ting,Cahir J. O'Kane,Shiming Tang,Chi-Hon Lee,Roger C. Hardie,Mikko Juusola

DOI: https://doi.org/10.1126/science.1215317

IF: 56.9

2012-01-01

Science

Abstract:Color and motion information are thought to be channeled through separate neural pathways, but it remains unclear whether and how these pathways interact to improve motion perception. In insects, such as Drosophila, it has long been believed that motion information is fed exclusively by one spectral class of photoreceptor, so-called R1 to R6 cells; whereas R7 and R8 photoreceptors, which exist in multiple spectral classes, subserve color vision. Here, we report that R7 and R8 also contribute to the motion pathway. By using electrophysiological, optical, and behavioral assays, we found that R7/R8 information converge with and shape the motion pathway output, explaining flies' broadly tuned optomotor behavior by its composite responses. Our results demonstrate that inputs from photoreceptors of different spectral sensitivities improve motion discrimination, increasing robustness of perception.
How fly neurons compute the direction of visual motion

Alexander Borst,Jürgen Haag,Alex S. Mauss

DOI: https://doi.org/10.1007/s00359-019-01375-9

2019-11-05

Journal of Comparative Physiology A

Abstract:Abstract Detecting the direction of image motion is a fundamental component of visual computation, essential for survival of the animal. However, at the level of individual photoreceptors, the direction in which the image is shifting is not explicitly represented. Rather, directional motion information needs to be extracted from the photoreceptor array by comparing the signals of neighboring units over time. The exact nature of this process as implemented in the visual system of the fruit fly Drosophila melanogaster has been studied in great detail, and much progress has recently been made in determining the neural circuits giving rise to directional motion information. The results reveal the following: (1) motion information is computed in parallel ON and OFF pathways. (2) Within each pathway, T4 (ON) and T5 (OFF) cells are the first neurons to represent the direction of motion. Four subtypes of T4 and T5 cells exist, each sensitive to one of the four cardinal directions. (3) The core process of direction selectivity as implemented on the dendrites of T4 and T5 cells comprises both an enhancement of signals for motion along their preferred direction as well as a suppression of signals for motion along the opposite direction. This combined strategy ensures a high degree of direction selectivity right at the first stage where the direction of motion is computed. (4) At the subsequent processing stage, tangential cells spatially integrate direct excitation from ON and OFF-selective T4 and T5 cells and indirect inhibition from bi-stratified LPi cells activated by neighboring T4/T5 terminals, thus generating flow-field-selective responses.

behavioral sciences,physiology,neurosciences,zoology
A visual motion detection circuit suggested by Drosophila connectomics

Shin-ya Takemura,Arjun Bharioke,Zhiyuan Lu,Aljoscha Nern,Shiv Vitaladevuni,Patricia K. Rivlin,William T. Katz,Donald J. Olbris,Stephen M. Plaza,Philip Winston,Ting Zhao,Jane Anne Horne,Richard D. Fetter,Satoko Takemura,Katerina Blazek,Lei-Ann Chang,Omotara Ogundeyi,Mathew A. Saunders,Victor Shapiro,Christopher Sigmund,Gerald M. Rubin,Louis K. Scheffer,Ian A. Meinertzhagen,Dmitri B. Chklovskii

DOI: https://doi.org/10.1038/nature12450

IF: 64.8

2013-08-07

Nature

Abstract:Animal behaviour arises from computations in neuronal circuits, but our understanding of these computations has been frustrated by the lack of detailed synaptic connection maps, or connectomes. For example, despite intensive investigations over half a century, the neuronal implementation of local motion detection in the insect visual system remains elusive. Here we develop a semi-automated pipeline using electron microscopy to reconstruct a connectome, containing 379 neurons and 8,637 chemical synaptic contacts, within the Drosophila optic medulla. By matching reconstructed neurons to examples from light microscopy, we assigned neurons to cell types and assembled a connectome of the repeating module of the medulla. Within this module, we identified cell types constituting a motion detection circuit, and showed that the connections onto individual motion-sensitive neurons in this circuit were consistent with their direction selectivity. Our results identify cellular targets for future functional investigations, and demonstrate that connectomes can provide key insights into neuronal computations.

multidisciplinary sciences
Genetic Identification of an On-Off Direction- Selective Retinal Ganglion Cell Subtype Reveals a Layer-Specific Subcortical Map of Posterior Motion

Andrew D. Huberman,Wei Wei,Justin Elstrott,Ben K. Stafford,Marla B. Feller,Ben A. Barres

DOI: https://doi.org/10.1016/j.neuron.2009.04.014

IF: 16.2

2009-05-01

Neuron

Abstract:Motion detection is an essential component of visual processing. On-Off direction-selective retinal ganglion cells (On-Off DSGCs) detect objects moving along specific axes of the visual field due to their precise retinal circuitry. The brain circuitry of On-Off DSGCs, however, is largely unknown. We report a mouse with GFP expressed selectively by the On-Off DSGCs that detect posterior motion (On-Off pDSGCs), allowing two-photon targeted recordings of their light responses and delineation of their complete map of central connections. On-Off pDSGCs project exclusively to the dorsal lateral geniculate nucleus and superior colliculus and in both targets form synaptic lamina that are separate from a lamina corresponding to non-DSGCs. Thus, individual On-Off DSGC subtypes are molecularly distinct and establish circuits that map specific qualities of directional motion to dedicated subcortical areas. This suggests that each RGC subtype represents a unique parallel pathway whose synaptic specificity in the retina is recapitulated in central targets.

neurosciences
A Disinhibitory Mechanism Biases Drosophila Innate Light Preference

Weiqiao Zhao,Peipei Zhou,Caixia Gong,Zhenhuan Ouyang,Jie Wang,Nenggan Zheng,Zhefeng Gong

DOI: https://doi.org/10.1038/s41467-018-07929-w

IF: 16.6

2019-01-01

Nature Communications

Abstract:Innate preference toward environmental conditions is crucial for animal survival. Although much is known about the neural processing of sensory information, how the aversive or attractive sensory stimulus is transformed through central brain neurons into avoidance or approaching behavior is largely unclear. Here we show that Drosophila larval light preference behavior is regulated by a disinhibitory mechanism. In the disinhibitory circuit, a pair of GABAergic neurons exerts tonic inhibition on one pair of contralateral projecting neurons that control larval reorientation behavior. When a larva enters the light area, the reorientation-controlling neurons are disinhibited to allow reorientation to occur as the upstream inhibitory neurons are repressed by light. When the larva exits the light area, the inhibition on the downstream neurons is restored to repress further reorientation and thus prevents the larva from re-entering the light area. We suggest that disinhibition may serve as a common neural mechanism for animal innate preference behavior.
Peripheral preprocessing in Drosophila facilitates odor classification

Palka Puri,Shiuan-Tze Wu,Chih-Ying Su,Johnatan Aljadeff

DOI: https://doi.org/10.1073/pnas.2316799121

2024-05-21

Abstract:The mammalian brain implements sophisticated sensory processing algorithms along multilayered ("deep") neural networks. Strategies that insects use to meet similar computational demands, while relying on smaller nervous systems with shallow architectures, remain elusive. Using Drosophila as a model, we uncover the algorithmic role of odor preprocessing by a shallow network of compartmentalized olfactory receptor neurons. Each compartment operates as a ratiometric unit for specific odor-mixtures. This computation arises from a simple mechanism: electrical coupling between two differently sized neurons. We demonstrate that downstream synaptic connectivity is shaped to optimally leverage amplification of a hedonic value signal in the periphery. Furthermore, peripheral preprocessing is shown to markedly improve novel odor classification in a higher brain center. Together, our work highlights a far-reaching functional role of the sensory periphery for downstream processing. By elucidating the implementation of powerful computations by a shallow network, we provide insights into general principles of efficient sensory processing algorithms.
Color Processing in the Early Visual System of Drosophila

Christopher Schnaitmann,Väinö Haikala,Eva Abraham,Vitus Oberhauser,Thomas Thestrup,Oliver Griesbeck,Dierk F Reiff

DOI: https://doi.org/10.1016/j.cell.2017.12.018

IF: 64.5

2018-01-11

Cell

Abstract:Color vision extracts spectral information by comparing signals from photoreceptors with different visual pigments. Such comparisons are encoded by color-opponent neurons that are excited at one wavelength and inhibited at another. Here, we examine the circuit implementation of color-opponent processing in the Drosophila visual system by combining two-photon calcium imaging with genetic dissection of visual circuits. We report that color-opponent processing of UVshort/blue and UVlong/green is already implemented in R7/R8 inner photoreceptor terminals of "pale" and "yellow" ommatidia, respectively. R7 and R8 photoreceptors of the same type of ommatidia mutually inhibit each other directly via HisCl1 histamine receptors and receive additional feedback inhibition that requires the second histamine receptor Ort. Color-opponent processing at the first visual synapse represents an unexpected commonality between Drosophila and vertebrates; however, the differences in the molecular and cellular implementation suggest that the same principles evolved independently.
A Circadian Output Circuit Controls Sleep-Wake Arousal in Drosophila

Fang Guo,Meghana Holla,Madelen M. Diaz,Michael Rosbash

DOI: https://doi.org/10.1016/j.neuron.2018.09.002

IF: 16.2

2018-01-01

Neuron

Abstract:The Drosophila core circadian circuit contains distinct groups of interacting neurons that give rise to diurnal sleep-wake patterns. Previous work showed that a subset of dorsal neurons 1 (DN1s) are sleep-promoting through their inhibition of activity-promoting circadian pacemakers. Here we show that these anterior-projecting DNs (APDNs) also "exit" the circadian circuitry and communicate with the homeostatic sleep center in higher brain regions to regulate sleep and sleep-wake arousal. These APDNs connect to a small, discrete subset of tubercular-bulbar neurons, which are connected in turn to specific sleep-centric ellipsoid body (EB)-ring neurons of the central complex. Remarkably, activation of the APDNs produces sleep-like oscillations in the EB and affects arousal. The data indicate that this APDN-Tu Bu-sup-EB circuit temporally regulates sleep-wake arousal in addition to the previously defined role of the TuBu-EB circuit in vision, navigation, and attention.
Object features and T4/T5 motion detectors modulate the dynamics of bar tracking by Drosophila

Mehmet F Keleş,Jean-Michel Mongeau,Mark A Frye

DOI: https://doi.org/10.1242/jeb.190017

2019-01-16

Abstract:Visual objects can be discriminated by static spatial features such as luminance or dynamic features such as relative movement. Flies track a solid dark vertical bar moving on a bright background, a behavioral reaction so strong that for a rigidly tethered fly, the steering trajectory is phase advanced relative to the moving bar, apparently in anticipation of its future position. By contrast, flickering bars that generate no coherent motion or have a surface texture that moves in the direction opposite to the bar generate steering responses that lag behind the stimulus. It remains unclear how the spatial properties of a bar influence behavioral response dynamics. Here, we show that a dark bar defined by its luminance contrast to the uniform background drives a co-directional steering response that is phase advanced relative to the response to a textured bar defined only by its motion relative to a stationary textured background. The textured bar drives an initial contra-directional turn and phase-locked tracking. The qualitatively distinct response dynamics could indicate parallel visual processing of a luminance versus motion-defined object. Calcium imaging shows that T4/T5 motion-detecting neurons are more responsive to a solid dark bar than a motion-defined bar. Genetically blocking T4/T5 neurons eliminates the phase-advanced co-directional response to the luminance-defined bar, leaving the orientation response largely intact. We conclude that T4/T5 neurons mediate a co-directional optomotor response to a luminance-defined bar, thereby driving phase-advanced wing kinematics, whereas separate unknown visual pathways elicit the contra-directional orientation response.
Neuronal basis for parallel visual processing in the fly

N J Strausfeld,J K Lee

DOI: https://doi.org/10.1017/s0952523800010919

Abstract:Behavioral and electrophysiological studies of insects demonstrate both spectrally independent and chromatically dependent behaviors and interneurons. This account describes the neuroanatomical identification of two parallel retinotropic subsystems, one supplying descending channels to spectrally independent neck and flight motor circuits, the other supplying polychromatic channels to neuropils associated with leg motor circuits in the thoracic ganglia. In the compound eye, two classes of photoreceptors contribute to each of several thousand sampling units. High-sensitivity, chromatically uniform short-axon photoreceptors (R1-R6) supply the lamina's external plexiform layer and are presynaptic to L1, L2 efferents. These project in parallel with a second system of trichromatic long-axon receptors and the L3 efferent. Both pathways supply columns of the medulla, equal in number to ommatidia. Golgi and cobalt-silver impregnation demonstrates that neurons from the medulla diverge to two deeper regions, the lobula plate and lobula, the former a thin tectum of neuropil dorsal to the more substantial lobula. Layer relationships between medulla neurons and their afferent supply suggest that the lobula plate and lobula are each supplied by one or the other, but not both, of the two parallel subsystems. Independence of the two parallel pathways is suggested by ablation of the photoreceptor layer leading to selective degeneration of the motion-sensitive lobula plate neuropil. In addition, octets of small-field neurons associated with the R1-R6/L1, L2 pathway give rise to synaptic complexes with motion-sensitive neurons of the lobula plate. A variety of behavioral and electrophysiological studies provide supporting evidence that certain insects possess parallel visual pathways comparable to the magnocellular and parvocellular subsystems of primates.
State-dependent performance of optic-flow processing interneurons

Kit D Longden,Holger G Krapp

DOI: https://doi.org/10.1152/jn.00395.2009

Abstract:Active locomotive states are metabolically expensive and require efficient sensory processing both to avoid wasteful movements and to cope with an extended bandwidth of sensory stimuli. This is particularly true for flying animals because flight, as opposed to walking or resting, imposes a steplike increase in metabolism for the precise execution and control of movements. Sensory processing itself carries a significant metabolic cost, but the principles governing the adjustment of sensory processing to different locomotor states are not well understood. We use the blowfly as a model system to study the impact on visual processing of a neuromodulator, octopamine, which is known to be involved in the regulation of flight physiology. We applied an octopamine agonist and recorded the directional motion responses of identified visual interneurons known to process self-motion-induced optic flow to directional motion stimuli. The neural response range of these neurons is increased and the response latency is reduced. We also found that, due to an elevated spontaneous spike rate, the cells' negative signaling range is increased. Meanwhile, the preferred self-motion parameters the cells encode were state independent. Our results indicate that in the blowfly energetically expensive sensory coding strategies, such as rapid, large responses, and high spontaneous spike activity could be adjusted by the neuromodulator octopamine, likely to save energy during quiet locomotor states.
Complementary mechanisms create direction selectivity in the fly

Juergen Haag,Alexander Arenz,Etienne Serbe,Fabrizio Gabbiani,Alexander Borst

DOI: https://doi.org/10.7554/elife.17421

IF: 7.7

2016-08-09

eLife

Abstract:How neurons become sensitive to the direction of visual motion represents a classic example of neural computation. Two alternative mechanisms have been discussed in the literature so far: preferred direction enhancement, by which responses are amplified when stimuli move along the preferred direction of the cell, and null direction suppression, where one signal inhibits the response to the subsequent one when stimuli move along the opposite, i.e. null direction. Along the processing chain in the Drosophila optic lobe, directional responses first appear in T4 and T5 cells. Visually stimulating sequences of individual columns in the optic lobe with a telescope while recording from single T4 neurons, we find both mechanisms at work implemented in different sub-regions of the receptive field. This finding explains the high degree of directional selectivity found already in the fly’s primary motion-sensing neurons and marks an important step in our understanding of elementary motion detection.

biology
PDF Neuron Firing Phase-Shifts Key Circadian Activity Neurons in Drosophila

Fang Guo,Isadora Cerullo,Xiao Chen,Michael Rosbash

DOI: https://doi.org/10.7554/elife.02780

IF: 7.7

2014-01-01

eLife

Abstract:Our experiments address two long-standing models for the function of the Drosophila brain circadian network: a dual oscillator model, which emphasizes the primacy of PDF-containing neurons, and a cell-autonomous model for circadian phase adjustment. We identify five different circadian (E) neurons that are a major source of rhythmicity and locomotor activity. Brief firing of PDF cells at different times of day generates a phase response curve (PRC), which mimics a light-mediated PRC and requires PDF receptor expression in the five E neurons. Firing also resembles light by causing TIM degradation in downstream neurons. Unlike light however, firing-mediated phase-shifting is CRY-independent and exploits the E3 ligase component CUL-3 in the early night to degrade TIM. Our results suggest that PDF neurons integrate light information and then modulate the phase of E cell oscillations and behavioral rhythms. The results also explain how fly brain rhythms persist in constant darkness and without CRY.
Fundamental mechanisms of visual motion detection: models, cells and functions

C W G Clifford,M R Ibbotson

DOI: https://doi.org/10.1016/s0301-0082(02)00154-5

Abstract:Taking a comparative approach, data from a range of visual species are discussed in the context of ideas about mechanisms of motion detection. The cellular basis of motion detection in the vertebrate retina, sub-cortical structures and visual cortex is reviewed alongside that of the insect optic lobes. Special care is taken to relate concepts from theoretical models to the neural circuitry in biological systems. Motion detection involves spatiotemporal pre-filters, temporal delay filters and non-linear interactions. A number of different types of non-linear mechanism such as facilitation, inhibition and division have been proposed to underlie direction selectivity. The resulting direction-selective mechanisms can be combined to produce speed-tuned motion detectors. Motion detection is a dynamic process with adaptation as a fundamental property. The behavior of adaptive mechanisms in motion detection is discussed, focusing on the informational basis of motion adaptation, its phenomenology in human vision, and its cellular basis. The question of whether motion adaptation serves a function or is simply the result of neural fatigue is critically addressed.
Insect-Inspired Elementary Motion Detection Embracing Resistive Memory and Spiking Neural Networks

Thomas Dalgaty,Elisa Vianello,Denys Ly,Giacomo Indiveri,Barbara De Salvo,Etienne Nowak,Jerome Casas

DOI: https://doi.org/10.1007/978-3-319-95972-6_13

2018-01-01

Abstract:Computation of the direction of motion and the detection of collisions are important features of autonomous robotic systems for course steering and avoidance manoeuvres. Current approaches typically rely on computing these features in software using algorithms implemented on a microprocessor. However, the power consumption, computational latency and form factor limit their applicability. In this work we take inspiration from motion detection studied in the Drosophila visual system to implement an alternative. The nervous system of the Drosophila contains 150000 neurons [1] and computes information in a parallel fashion. We propose a topology comprising a dynamic vision sensor (DVS) which provides input to spiking neural networks (SNN). The network is realised through interconnecting leaky-integrate and fire (LIF) complementary metal oxide semiconductor (CMOS) neurons with hafnium dioxide (HfO2) based resistive random access memories (RRAM) acting as the synaptic connections between them. A genetic algorithm (GA) is used to optimize the parameters of the network, within an experimentally determined range of RRAM conductance values, and through simulation it is demonstrated that the system can compute the direction of motion of a grating. Finally, we demonstrate that by modulating RRAM conductances and adjusting network component time constants the range of grating velocities to which it is most sensitive can be adapted. It is also shown that this allows for the system to reduce power consumption when sensitive to lower velocity stimulus. This mimics the behavior observed in Drosophila whereby the neuromodulator octopamine adjusts the response of the motion detection system when the insect is resting or flying.

Processing properties of ON and OFF pathways for Drosophila motion detection

Different spectral sensitivities of ON- and OFF-motion pathways enhance the detection of approaching color objects in Drosophila

Behavioral state modulates the ON visual motion pathway of Drosophila

The Emergence of Directional Selectivity in the Visual Motion Pathway of Drosophila

Non-canonical Receptive Field Properties and Neuromodulation of Feature-Detecting Neurons in Flies

Neuronal ON/OFF Motion Detection Circuits Underlying Looming-Evoked Escape Behavior in Drosophila

Multiple Spectral Inputs Improve Motion Discrimination in the Drosophila Visual System.

How fly neurons compute the direction of visual motion

A visual motion detection circuit suggested by Drosophila connectomics

Genetic Identification of an On-Off Direction- Selective Retinal Ganglion Cell Subtype Reveals a Layer-Specific Subcortical Map of Posterior Motion

A Disinhibitory Mechanism Biases Drosophila Innate Light Preference

Peripheral preprocessing in Drosophila facilitates odor classification

Color Processing in the Early Visual System of Drosophila

A Circadian Output Circuit Controls Sleep-Wake Arousal in Drosophila

Object features and T4/T5 motion detectors modulate the dynamics of bar tracking by Drosophila

Neuronal basis for parallel visual processing in the fly

State-dependent performance of optic-flow processing interneurons

Complementary mechanisms create direction selectivity in the fly

PDF Neuron Firing Phase-Shifts Key Circadian Activity Neurons in Drosophila

Fundamental mechanisms of visual motion detection: models, cells and functions

Insect-Inspired Elementary Motion Detection Embracing Resistive Memory and Spiking Neural Networks