Cyclic operation as optimal control reflux policy of binary mixture batch distillation

M. Stojković,V. Gerbaud,N. Shcherbakova

DOI: https://doi.org/10.1016/j.compchemeng.2017.09.004

2018-01-04

Abstract:

What problem does this paper attempt to address?

Incremental grouping of image elements in vision

Pieter R Roelfsema,Roos Houtkamp

DOI: https://doi.org/10.3758/s13414-011-0200-0

Abstract:One important task for the visual system is to group image elements that belong to an object and to segregate them from other objects and the background. We here present an incremental grouping theory (IGT) that addresses the role of object-based attention in perceptual grouping at a psychological level and, at the same time, outlines the mechanisms for grouping at the neurophysiological level. The IGT proposes that there are two processes for perceptual grouping. The first process is base grouping and relies on neurons that are tuned to feature conjunctions. Base grouping is fast and occurs in parallel across the visual scene, but not all possible feature conjunctions can be coded as base groupings. If there are no neurons tuned to the relevant feature conjunctions, a second process called incremental grouping comes into play. Incremental grouping is a time-consuming and capacity-limited process that requires the gradual spread of enhanced neuronal activity across the representation of an object in the visual cortex. The spread of enhanced neuronal activity corresponds to the labeling of image elements with object-based attention.
How the brain learns to parse images using an attentional, incremental grouping process

Sami Mollard,Sander Bohte,Pieter Roelfsema

DOI: https://doi.org/10.1101/2024.06.17.599272

2024-06-17

Abstract:Natural scenes usually contain a vast number of objects that need to be segmented and segregated from each other and from the background to guide behaviour. In the visual brain, object-based attention is the process by which image fragments belonging to the same objects are grouped together. The curve-tracing task is a special case of a perceptual grouping task that tests our ability to group image elements of an elongated curve. The task consists in determining which image elements belong to the same curve, and in the brain, neurons spread an enhanced activity level over the representation of the relevant curve. A previous "growth-cone model of attention" accounted for the scale invariance of tracing by proposing that the enhanced activity propagates at multiple levels of the visual cortical hierarchy. However, the precise neuronal circuitry for learning and implementing scale-invariant tracing remains unknown. We propose a new recurrent architecture for the scale-invariant labelling of curves and objects. The architecture is composed of a feedforward pathway that dynamically selects the right scale and prevents the spilling over of the enhanced activity to other curves, and a recurrent pathway for tag spreading that involves horizontal and feedback interactions, mediated by a disinhibitory loop involving VIP and SOM interneurons. We trained the network with curves up to seven pixels long using reinforcement learning and a learning rule local in time and space and we found that it generalized to curves of any length and to spatially extended objects. The network chose the appropriate scale and switched to higher or lower scales as dictated by the distance between curves, just has as been observed in human psychophysics and in the visual cortex of monkeys. Our work provide a mechanistic account of the learning of scale-invariant perceptual grouping in the brain.

Neuroscience
Multi-Scale Extension in an Entorhinal-Hippocampal Model for Cognitive Map Building.

Jiru Wang,Rui Yan,Huajin Tang

DOI: https://doi.org/10.3389/fnbot.2020.592057

IF: 3.493

2021-01-01

Frontiers in Neurorobotics

Abstract:Neuroscience research shows that, by relying on internal spatial representations provided by the hippocampus and entorhinal cortex, mammals are able to build topological maps of environments and navigate. Taking inspiration from mammals' spatial cognition mechanism, entorhinal-hippocampal cognitive systems have been proposed for robots to build cognitive maps. However, path integration and vision processing are time-consuming, and the existing model of grid cells is hard to achieve in terms of adaptive multi-scale extension for different environments, resulting in the lack of viability for real environments. In this work, an optimized dynamical model of grid cells is built for path integration in which recurrent weight connections between grid cells are parameterized in a more optimized way and the non-linearity of sigmoidal neural transfer function is utilized to enhance grid cell activity packets. Grid firing patterns with specific spatial scales can thus be accurately achieved for the multi-scale extension of grid cells. In addition, a hierarchical vision processing mechanism is proposed for speeding up loop closure detection. Experiment results on the robotic platform demonstrate that our proposed entorhinal-hippocampal model can successfully build cognitive maps, reflecting the robot's spatial experience and environmental topological structures.
Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Qi Xu,Yaxin Li,Jiangrong Shen,Pingping Zhang,Jian K. Liu,Huajin Tang,Gang Pan

DOI: https://doi.org/10.1109/tnnls.2022.3232106

IF: 14.255

2024-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Thanks to their event-driven nature, spiking neural networks (SNNs) are surmised to be great computation-efficient models. The spiking neurons encode beneficial temporal facts and possess excessive anti-noise properties. However, the high-quality encoding of spatio-temporal complexity and also its training optimization of SNNs are restricted by means of the contemporary problem, this article proposes a novel hierarchical event-driven visual device to explore how information transmits and signifies in the retina the usage of biologically manageable mechanisms. This cognitive model is an augmented spiking-based framework consisting of the function learning capacity of convolutional neural networks (CNNs) with the cognition capability of SNNs. Furthermore, this visual device is modeled in a biological realism way with unsupervised learning rules and advanced spike firing rate encoding methods. We train and test them on some image datasets (Modified National Institute of Standards and Technology (MNIST), Canadian Institute for Advanced Research (CIFAR)10, and its noisy versions) to show that our mannequin can process greater vital data than present cognitive models. This article also proposes a novel quantization approach to make the proposed spiking-based model more efficient for neuromorphic hardware implementation. The outcomes show this joint CNN-SNN model can reap excessive focus accuracy and get more effective generalization ability.
Learning compact generalizable neural representations supporting perceptual grouping

Vijay Veerabadran,Virginia R. de Sa

DOI: https://doi.org/10.48550/arXiv.2006.11716

2020-06-21

Abstract:Work at the intersection of vision science and deep learning is starting to explore the efficacy of deep convolutional networks (DCNs) and recurrent networks in solving perceptual grouping problems that underlie primate visual recognition and segmentation. Here, we extend this line of work to investigate the compactness and generalizability of DCN solutions to learning low-level perceptual grouping routines involving contour integration. We introduce V1Net, a bio-inspired recurrent unit that incorporates lateral connections ubiquitous in cortical circuitry. Feedforward convolutional layers in DCNs can be substituted with V1Net modules to enhance their contextual visual processing support for perceptual grouping. We compare the learning efficiency and accuracy of V1Net-DCNs to that of 14 carefully selected feedforward and recurrent neural architectures (including state-of-the-art DCNs) on MarkedLong -- a synthetic forced-choice contour integration dataset of 800,000 images we introduce here -- and the previously published Pathfinder contour integration benchmarks. We gauged solution generalizability by measuring the transfer learning performance of our candidate models trained on MarkedLong that were fine-tuned to learn PathFinder. Our results demonstrate that a compact 3-layer V1Net-DCN matches or outperforms the test accuracy and sample efficiency of all tested comparison models which contain between 5x and 1000x more trainable parameters; we also note that V1Net-DCN learns the most compact generalizable solution to MarkedLong. A visualization of the temporal dynamics of a V1Net-DCN elucidates its usage of interpretable grouping computations to solve MarkedLong. The compact and rich representations of V1Net-DCN also make it a promising candidate to build on-device machine vision algorithms as well as help better understand biological cortical circuitry.

Computer Vision and Pattern Recognition
Accentuation, Boolean maps and perception of (dis)similarity in a neural model of visual segmentation

Dražen Domijan,Ivana Ivančić

DOI: https://doi.org/10.1016/j.visres.2024.108506

IF: 1.8

2024-11-02

Vision Research

Abstract:We developed an interactive cortical circuit for visual segmentation that integrates bottom-up and top-down processing to segregate or group visual elements. A bottom-up pathway incorporates stimulus-driven saliency computation, top-down feature-based weighting by relevance and winner-take-all selection. A top-down pathway encompasses multiscale feedback projections, an object-based attention network and a visual segmentation network. Computer simulations have shown that a salient element in the stimulus guides spatial attention and further influences the decomposition of the nearby object into its parts, as postulated by the principle of accentuation. By contrast, when no single salient element is present, top-down feature-based attention highlights all locations occupied by the attended feature and the model forms a Boolean map, i.e., a spatial representation that makes the feature-based grouping explicit. The same distinction between bottom-up and top-down influences in perceptual organization can also be applied to texture perception. The model suggests that the principle of accentuation and feature-based similarity grouping are two manifestations of the same cortical circuit designed to detect similarities and dissimilarities of visual elements in a stimulus.

psychology,neurosciences,ophthalmology
The quest for multiscale brain modeling

Egidio D'Angelo,Viktor Jirsa

DOI: https://doi.org/10.1016/j.tins.2022.06.007

Abstract:Addressing the multiscale organization of the brain, which is fundamental to the dynamic repertoire of the organ, remains challenging. In principle, it should be possible to model neurons and synapses in detail and then connect them into large neuronal assemblies to explain the relationship between microscopic phenomena, large-scale brain functions, and behavior. It is more difficult to infer neuronal functions from ensemble measurements such as those currently obtained with brain activity recordings. In this article we consider theories and strategies for combining bottom-up models, generated from principles of neuronal biophysics, with top-down models based on ensemble representations of network activity and on functional principles. These integrative approaches are hoped to provide effective multiscale simulations in virtual brains and neurorobots, and pave the way to future applications in medicine and information technologies.
Incremental Deep Neural Network for Visual Categories

Jingjing HU,Ran WANG,Lingli ZHAN,Yuanqing WANG

DOI: https://doi.org/10.3969/j.issn.1005-9490.2018.01.014

2018-01-01

Abstract:In order to solve the problem of model structure fossilization,generating huge memory consumption and time consumption in image classification task,an incremental depth neural network(IDNN)is proposed. IDNN divides input samples into branches and trains them separately. If the input sample activates one of the existing clusters,IDNN updates parameters of the corresponding cluster;otherwise,IDNN creates new branch and learns an independent feature set.Experiments reported on Caltech-101,ORL Face and ETH-80 dataset show that IDNN can automatically adjust the network structure and is suitable for incremental learning in different environments such as contour variation,texture variation and viewpoint diversity. Also,we prove experimentally that its classification performance outperforms the VGGNet by 5.08% and AlexNet by 3.44% on Caltech-101 dataset.
Neurobiologically realistic neural network enables cross-scale modeling of neural dynamics

Yin-Jui Chang,Yuan-I Chen,Hsin-Chih Yeh,Samantha R. Santacruz

DOI: https://doi.org/10.1038/s41598-024-54593-w

IF: 4.6

2024-03-02

Scientific Reports

Abstract:Fundamental principles underlying computation in multi-scale brain networks illustrate how multiple brain areas and their coordinated activity give rise to complex cognitive functions. Whereas brain activity has been studied at the micro- to meso-scale to reveal the connections between the dynamical patterns and the behaviors, investigations of neural population dynamics are mainly limited to single-scale analysis. Our goal is to develop a cross-scale dynamical model for the collective activity of neuronal populations. Here we introduce a bio-inspired deep learning approach, termed NeuroBondGraph Network (NBGNet), to capture cross-scale dynamics that can infer and map the neural data from multiple scales. Our model not only exhibits more than an 11-fold improvement in reconstruction accuracy, but also predicts synchronous neural activity and preserves correlated low-dimensional latent dynamics. We also show that the NBGNet robustly predicts held-out data across a long time scale (2 weeks) without retraining. We further validate the effective connectivity defined from our model by demonstrating that neural connectivity during motor behaviour agrees with the established neuroanatomical hierarchy of motor control in the literature. The NBGNet approach opens the door to revealing a comprehensive understanding of brain computation, where network mechanisms of multi-scale activity are critical.

multidisciplinary sciences
Scaling Laws for Task-Optimized Models of the Primate Visual Ventral Stream

Abdulkadir Gokce,Martin Schrimpf

2024-11-09

Abstract:When trained on large-scale object classification datasets, certain artificial neural network models begin to approximate core object recognition (COR) behaviors and neural response patterns in the primate visual ventral stream (VVS). While recent machine learning advances suggest that scaling model size, dataset size, and compute resources improve task performance, the impact of scaling on brain alignment remains unclear. In this study, we explore scaling laws for modeling the primate VVS by systematically evaluating over 600 models trained under controlled conditions on benchmarks spanning V1, V2, V4, IT and COR behaviors. We observe that while behavioral alignment continues to scale with larger models, neural alignment saturates. This observation remains true across model architectures and training datasets, even though models with stronger inductive bias and datasets with higher-quality images are more compute-efficient. Increased scaling is especially beneficial for higher-level visual areas, where small models trained on few samples exhibit only poor alignment. Finally, we develop a scaling recipe, indicating that a greater proportion of compute should be allocated to data samples over model size. Our results suggest that while scaling alone might suffice for alignment with human core object recognition behavior, it will not yield improved models of the brain's visual ventral stream with current architectures and datasets, highlighting the need for novel strategies in building brain-like models.

Machine Learning,Computer Vision and Pattern Recognition,Neurons and Cognition
A model for integrating elementary neural functions into delayed-response behavior

Thomas Gisiger,Michel Kerszberg

DOI: https://doi.org/10.1371/journal.pcbi.0020025

Abstract:It is well established that various cortical regions can implement a wide array of neural processes, yet the mechanisms which integrate these processes into behavior-producing, brain-scale activity remain elusive. We propose that an important role in this respect might be played by executive structures controlling the traffic of information between the cortical regions involved. To illustrate this hypothesis, we present a neural network model comprising a set of interconnected structures harboring stimulus-related activity (visual representation, working memory, and planning), and a group of executive units with task-related activity patterns that manage the information flowing between them. The resulting dynamics allows the network to perform the dual task of either retaining an image during a delay (delayed-matching to sample task), or recalling from this image another one that has been associated with it during training (delayed-pair association task). The model reproduces behavioral and electrophysiological data gathered on the inferior temporal and prefrontal cortices of primates performing these same tasks. It also makes predictions on how neural activity coding for the recall of the image associated with the sample emerges and becomes prospective during the training phase. The network dynamics proves to be very stable against perturbations, and it exhibits signs of scale-invariant organization and cooperativity. The present network represents a possible neural implementation for active, top-down, prospective memory retrieval in primates. The model suggests that brain activity leading to performance of cognitive tasks might be organized in modular fashion, simple neural functions becoming integrated into more complex behavior by executive structures harbored in prefrontal cortex and/or basal ganglia.
Disentangling neural mechanisms for perceptual grouping

Junkyung Kim,Drew Linsley,Kalpit Thakkar,Thomas Serre

DOI: https://doi.org/10.48550/arXiv.1906.01558

2020-10-28

Abstract:Forming perceptual groups and individuating objects in visual scenes is an essential step towards visual intelligence. This ability is thought to arise in the brain from computations implemented by bottom-up, horizontal, and top-down connections between neurons. However, the relative contributions of these connections to perceptual grouping are poorly understood. We address this question by systematically evaluating neural network architectures featuring combinations bottom-up, horizontal, and top-down connections on two synthetic visual tasks, which stress low-level "Gestalt" vs. high-level object cues for perceptual grouping. We show that increasing the difficulty of either task strains learning for networks that rely solely on bottom-up connections. Horizontal connections resolve straining on tasks with Gestalt cues by supporting incremental grouping, whereas top-down connections rescue learning on tasks with high-level object cues by modifying coarse predictions about the position of the target object. Our findings dissociate the computational roles of bottom-up, horizontal and top-down connectivity, and demonstrate how a model featuring all of these interactions can more flexibly learn to form perceptual groups.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning,Neural and Evolutionary Computing
Multi-scale Image Analysis Based on Non-Classical Receptive Field Mechanism.

Hui Wei,Qingsong Zuo,Bo Lang

DOI: https://doi.org/10.1007/978-3-642-24965-5_68

2011-01-01

Abstract:In the real world, the biological visual system is more efficient than the machine visual system in analyzing visual information. Physiology theories show that this efficiency owes to the multi-layer neural network in human visual system, in which every layer accomplishes different tasks and is related with other layers. The low-level stages of the human visual system, especially the retina, can provide certain scale information for the high-level stages of visual system through using the non-classical receptive field (nCRF) mechanism. This mechanism that the nCRF size can be adjusted automatically by ganglion cell (GC) can achieve a multi-scale image analysis. The results, reflecting the distribution of the image information, can be shared by several algorithms or processes solving different visual tasks, such as contour detection and image segmentation. A model of multi-scale image analysis based on GC has been proposed in this paper, which retains the key information and reduces the redundancy information for the further stages of the visual system. Experimental results on N-cut and contour detection show that this multi-scale image analysis model provides distinctive improvement for these image processing tasks.
Gossamer: Scaling Image Processing and Reconstruction to Whole Brains

Karl Marrett,Keivan Moradi,Chris Sin Park,Ming Yan,Chris Choi,Muye Zhu,Masood Akram,Sumit Nanda,Qing Xue,Hyun-Seung Mun,Adriana E Gutierrez,Mitchell Rudd,Brian Zingg,Gabrielle Magat,Kathleen Wijaya,Hongwei Dong,X. William Yang,Jason Cong

DOI: https://doi.org/10.1101/2024.04.07.588466

2024-07-04

Abstract:Neuronal reconstruction-a process that transforms image volumes into 3D geometries and skeletons of cells-bottlenecks the study of brain function, connectomics and pathology. Domain scientists need exact and complete segmentations to study subtle topological differences. Existing methods are diskbound, dense-access, coupled, single-threaded, algorithmically unscalable and require manual cropping of small windows and proofreading of skeletons due to low topological accuracy. Designing a data-intensive parallel solution suited to a neurons' shape, topology and far-ranging connectivity is particularly challenging due to I/O and load-balance, yet by abstracting these vision tasks into strategically ordered specializations of search, we progressively lower memory by 4 orders of magnitude. This enables 1 mouse brain to be fully processed in-memory on a single server, at 67X the scale with 870X less memory while having 78% higher automated yield than APP2, the previous state of the art in performant reconstruction.

Neuroscience
iNeMo: Incremental Neural Mesh Models for Robust Class-Incremental Learning

Tom Fischer,Yaoyao Liu,Artur Jesslen,Noor Ahmed,Prakhar Kaushik,Angtian Wang,Alan Yuille,Adam Kortylewski,Eddy Ilg

2024-08-19

Abstract:Different from human nature, it is still common practice today for vision tasks to train deep learning models only initially and on fixed datasets. A variety of approaches have recently addressed handling continual data streams. However, extending these methods to manage out-of-distribution (OOD) scenarios has not effectively been investigated. On the other hand, it has recently been shown that non-continual neural mesh models exhibit strong performance in generalizing to such OOD scenarios. To leverage this decisive property in a continual learning setting, we propose incremental neural mesh models that can be extended with new meshes over time. In addition, we present a latent space initialization strategy that enables us to allocate feature space for future unseen classes in advance and a positional regularization term that forces the features of the different classes to consistently stay in respective latent space regions. We demonstrate the effectiveness of our method through extensive experiments on the Pascal3D and ObjectNet3D datasets and show that our approach outperforms the baselines for classification by $2-6\%$ in the in-domain and by $6-50\%$ in the OOD setting. Our work also presents the first incremental learning approach for pose estimation. Our code and model can be found at <a class="link-external link-https" href="https://github.com/Fischer-Tom/iNeMo" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Machine Learning
Advancing Spiking Neural Networks towards Multiscale Spatiotemporal Interaction Learning

Yimeng Shan,Malu Zhang,Rui-jie Zhu,Xuerui Qiu,Jason K. Eshraghian,Haicheng Qu

2024-05-27

Abstract:Recent advancements in neuroscience research have propelled the development of Spiking Neural Networks (SNNs), which not only have the potential to further advance neuroscience research but also serve as an energy-efficient alternative to Artificial Neural Networks (ANNs) due to their spike-driven characteristics. However, previous studies often neglected the multiscale information and its spatiotemporal correlation between event data, leading SNN models to approximate each frame of input events as static images. We hypothesize that this oversimplification significantly contributes to the performance gap between SNNs and traditional ANNs. To address this issue, we have designed a Spiking Multiscale Attention (SMA) module that captures multiscale spatiotemporal interaction information. Furthermore, we developed a regularization method named Attention ZoneOut (AZO), which utilizes spatiotemporal attention weights to reduce the model's generalization error through pseudo-ensemble training. Our approach has achieved state-of-the-art results on mainstream neural morphology datasets. Additionally, we have reached a performance of 77.1% on the Imagenet-1K dataset using a 104-layer ResNet architecture enhanced with SMA and AZO. This achievement confirms the state-of-the-art performance of SNNs with non-transformer architectures and underscores the effectiveness of our method in bridging the performance gap between SNN models and traditional ANN models.

Computer Vision and Pattern Recognition
Adaptive scales of integration and response latencies in a critically-balanced model of the primary visual cortex

Keith Hayton,Dimitrios Moirogiannis,Marcelo Magnasco

DOI: https://doi.org/10.1371/journal.pone.0196566

IF: 3.7

2018-04-27

PLoS ONE

Abstract:The primary visual cortex (V1) integrates information over scales in visual space, which have been shown to vary, in an input-dependent manner, as a function of contrast and other visual parameters. Which algorithms the brain uses to achieve this feat are largely unknown and an open problem in visual neuroscience. We demonstrate that a simple dynamical mechanism can account for this contrast-dependent scale of integration in visuotopic space as well as connect this property to two other stimulus-dependent features of V1: extents of lateral integration on the cortical surface and response latencies.

multidisciplinary sciences
Accessory Kvbeta1 subunits differentially modulate the functional expression of voltage-gated K+ channels in mouse ventricular myocytes.

F. Aimond,S. Kwak,K. Rhodes,J. Nerbonne

IF: 23.213

Circulation Research

Abstract:Voltage-gated K+ (Kv) channel accessory (beta) subunits associate with pore-forming Kv alpha subunits and modify the properties and/or cell surface expression of Kv channels in heterologous expression systems. There is very little presently known, however, about the functional role(s) of Kv beta subunits in the generation of native cardiac Kv channels. Exploiting mice with a targeted disruption of the Kvbeta1 gene (Kvbeta1-/-), the studies here were undertaken to explore directly the role of Kvbeta1 in the generation of ventricular Kv currents. Action potential waveforms and peak Kv current densities are indistinguishable in myocytes isolated from the left ventricular apex (LVA) of Kvbeta1-/- and wild-type (WT) animals. Analysis of Kv current waveforms, however, revealed that mean+/-SEM I(to,f) density is significantly (P< or =0.01) lower in Kvbeta1-/- (21.0+/-0.9 pA/pF; n=68), than in WT (25.3+/-1.4 pA/pF; n=42), LVA myocytes, and that mean+/-SEM I(K,slow) density is significantly (P< or =0.01) higher in Kvbeta1-/- (19.1+/-0.9 pA/pF; n=68), compared with WT (15.9+/-0.7 pA/pF; n=42), LVA cells. Pharmacological studies demonstrated that the TEA-sensitive component of I(K,slow), I(K,slow2,) is selectively increased in Kvbeta1-/- LVA myocytes. In parallel with the alterations in I(to,f) and I(K,slow2) densities, Kv4.3 expression is decreased and Kv2.1 expression is increased in Kvbeta1-/- ventricles. Taken together, these results demonstrate that Kvbeta1 differentially regulates the functional cell surface expression of myocardial I(to,f) and I(K,slow2) channels.
Running Large-Scale Simulations on the Neurorobotics Platform to Understand Vision – The Case of Visual Crowding

Alban Bornet,Jacques Kaiser,Alexander Kroner,Egidio Falotico,Alessandro Ambrosano,Kepa Cantero,Michael H. Herzog,Gregory Francis

DOI: https://doi.org/10.3389/fnbot.2019.00033

IF: 3.493

2019-05-29

Frontiers in Neurorobotics

Abstract:Traditionally, human vision research has focused on specific paradigms and proposed models to explain very specific properties of visual perception. However, the complexity and scope of modern psychophysical paradigms undermine the success of this approach. For example, perception of an element strongly deteriorates when neighboring elements are presented in addition (visual crowding). As it was shown recently, the magnitude of deterioration depends not only on the directly neighboring elements but on almost all elements and their specific configuration. Hence, to fully explain human visual perception, one needs to take large parts of the visual field into account and combine all the aspects of vision that become relevant at such scale. These efforts require sophisticated and collaborative modeling. The Neurorobotics Platform (NRP) of the Human Brain Project offers a unique opportunity to connect models of all sorts of visual functions, even those developed by different research groups, into a coherently functioning system. Here, we describe how we used the NRP to connect and simulate a segmentation model, a retina model, and a saliency model to explain complex results about visual perception. The combination of models highlights the versatility of the NRP and provides novel explanations for inward-outward anisotropy in visual crowding.

robotics,computer science, artificial intelligence,neurosciences
Mechanisms of Adaptive Spatial Integration in a Neural Model of Cortical Motion Processing

Stefan Ringbauer,Stephan Tschechne,Heiko Neumann

DOI: https://doi.org/10.1007/978-3-642-20282-7_12

2011-01-01

Abstract:In visual cortex information is processed along a cascade of neural mechanisms that pool activations from the surround with spatially increasing receptive fields. Watching a scenery of multiple moving objects leads to object boundaries on the retina defined by discontinuities in feature domains such as luminance or velocities. Spatial integration across the boundaries mixes distinct sources of input signals and leads to unreliable measurements. Previous work [6] proposed a luminance-gated motion integration mechanism, which does not account for the presence of discontinuities in other feature domains. Here, we propose a biologically inspired model that utilizes the low and intermediate stages of cortical motion processing, namely V1, MT and MSTl, to detect motion by locally adapting spatial integration fields depending on motion contrast. This mechanism generalizes the concept of bilateral filtering proposed for anisotropic smoothing in image restoration in computer vision.

Cyclic operation as optimal control reflux policy of binary mixture batch distillation

Incremental grouping of image elements in vision

How the brain learns to parse images using an attentional, incremental grouping process

Multi-Scale Extension in an Entorhinal-Hippocampal Model for Cognitive Map Building.

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Learning compact generalizable neural representations supporting perceptual grouping

Accentuation, Boolean maps and perception of (dis)similarity in a neural model of visual segmentation

The quest for multiscale brain modeling

Incremental Deep Neural Network for Visual Categories

Neurobiologically realistic neural network enables cross-scale modeling of neural dynamics

Scaling Laws for Task-Optimized Models of the Primate Visual Ventral Stream

A model for integrating elementary neural functions into delayed-response behavior

Disentangling neural mechanisms for perceptual grouping

Multi-scale Image Analysis Based on Non-Classical Receptive Field Mechanism.

Gossamer: Scaling Image Processing and Reconstruction to Whole Brains

iNeMo: Incremental Neural Mesh Models for Robust Class-Incremental Learning

Advancing Spiking Neural Networks towards Multiscale Spatiotemporal Interaction Learning

Adaptive scales of integration and response latencies in a critically-balanced model of the primary visual cortex

Accessory Kvbeta1 subunits differentially modulate the functional expression of voltage-gated K+ channels in mouse ventricular myocytes.

Running Large-Scale Simulations on the Neurorobotics Platform to Understand Vision – The Case of Visual Crowding

Mechanisms of Adaptive Spatial Integration in a Neural Model of Cortical Motion Processing