A new perspective on border completion in visual cortex as bicycle rear wheel geodesics paths via sub-Riemannian Hamiltonian formalism

R.Fioresi,A. Marraffa,J. Petkovic

2023-04-01

Abstract:We present a review of known models and a new simple mathematical modelling for border completion in the visual cortex V1 highlighting the striking analogies with bicycle rear wheel motions in the plane.

Differential Geometry

What problem does this paper attempt to address?

A Computational Model of Topological and Geometric Recovery for Visual Curve Completion.

Hongwei Lin,Zihao Wang,Panpan Feng,Xingjiang Lu,Jinhui Yu

DOI: https://doi.org/10.1007/s41095-016-0055-3

IF: 4.1268

2016-01-01

Computational Visual Media

Abstract:Visual curve completion is a fundamental problem in understanding the principles of the human visual system. This problem is usually divided into two problems: a grouping problem and a shape problem. On one hand, though perception of the visually completed curve is clearly a global task (for example, a human perceives the Kanizsa triangle only when seeing all three black objects), conventional methods for solving the grouping problem are generally based on local Gestalt laws. On the other hand, the shape of the visually completed curve is usually recovered by minimizing shape energy in existing methods. However, not only do these methods lack mechanisms to adjust the shape of the recovered visual curve using perceptual, psychophysical, and neurophysiological knowledge, but it is also difficult to calculate an explicit representation of the visually completed curve. In this paper, we present a systematic computational model for generating a visually completed curve. Firstly, based on recent studies of perception, psychophysics, and neurophysiology, we formulate a grouping procedure based on the human visual system by seeking a minimum Hamiltonian cycle in a graph, solving the grouping problem in a global manner. Secondly, we employ a Bézier curve-based model to represent the visually completed curve. Not only is an explicit representation deduced, but we also present a means to integrate knowledge from related areas, such as perception, psychophysics, and neurophysiology, and so on. The proposed computational model has been validated using many modal and amodal completion examples, and desirable results were obtained.
A Cortical-Inspired Contour Completion Model Based on Contour Orientation and Thickness

Ivan Galyaev,Alexey Mashtakov

DOI: https://doi.org/10.3390/jimaging10080185

2024-07-31

Abstract:An extended four-dimensional version of the traditional Petitot-Citti-Sarti model on contour completion in the visual cortex is examined. The neural configuration space is considered as the group of similarity transformations, denoted as M=SIM(2). The left-invariant subbundle of the tangent bundle models possible directions for establishing neural communication. The sub-Riemannian distance is proportional to the energy expended in interneuron activation between two excited border neurons. According to the model, the damaged image contours are restored via sub-Riemannian geodesics in the space M of positions, orientations and thicknesses (scales). We study the geodesic problem in M using geometric control theory techniques. We prove the existence of a minimal geodesic between arbitrary specified boundary conditions. We apply the Pontryagin maximum principle and derive the geodesic equations. In the special cases, we find explicit solutions. In the general case, we provide a qualitative analysis. Finally, we support our model with a simulation of the association field.
Computer Simulation of Crossing Line Based Geometric Illusions

Lingchen Dai,Jinhui Yu

DOI: https://doi.org/10.1088/1757-899x/563/4/042017

2019-01-01

Abstract:Computer modelling of visual illusions may offer useful insights into visual illusions from different perspectives. Focusing on crossing line based geometric illusions where target lines illusorily change their shapes under the influence of context elements, we show that, by taking into account the crossing angles between target and context lines and the distance between intersection points along the target lines, it is possible to simulate some typical crossing line based geometric illusions with a simple model. Compared with a recent work which requires the context lines to be differential, our model eliminates this restriction so that it is applicable to simulating many more crossing line based geometric illusions.
A sub-Riemannian model of the functional architecture of M1 for arm movement direction

Caterina Mazzetti,Alessandro Sarti,Giovanna Citti

2023-06-13

Abstract:In this paper we propose a neurogeometrical model of the behaviour of cells of the arm area of the primary motor cortex (M1). We mathematically express the hypercolumnar organization of M1 discovered by Georgopoulos, as a fiber bundle, as in classical sub-riemannian models of the visual cortex (Hoffmann, Petitot, Citti-Sarti). On this structure, we consider the selective tuning of M1 neurons of kinematic variables of positions and directions of movement. We then extend this model to encode the notion of fragments of movements introduced by Hatsopoulos. In our approach fragments are modelled as integral curves of vector fields in a suitable sub-Riemannian space. These fragments are in good agreements with movement decomposition from neural activity data. Here, we recover these patterns through a spectral clustering algorithm in the subriemannian structure we introduced, and compare our results with the neurophysiological ones of Kadmon-Harpaz et al.

Neurons and Cognition
Geometry of the Visual Cortex with Applications to Image Inpainting and Enhancement

Francesco Ballerin,Erlend Grong

2024-11-27

Abstract:Equipping the rototranslation group $SE(2)$ with a sub-Riemannian structure inspired by the visual cortex V1, we propose algorithms for image inpainting and enhancement based on hypoelliptic diffusion. We innovate on previous implementations of the methods by Citti, Sarti, and Boscain et al., by proposing an alternative that prevents fading and is capable of producing sharper results in a procedure that we call WaxOn-WaxOff. We also exploit the sub-Riemannian structure to define a completely new unsharp filter using $SE(2)$, analogous to the classical unsharp filter for 2D image processing. We demonstrate our method on blood vessels enhancement in retinal scans.

Computer Vision and Pattern Recognition
A model of reaching via subriemannian geodesics in Engel-type group

Caterina Mazzetti,Alessandro Sarti,Giovanna Citti

DOI: https://doi.org/10.48550/arXiv.2301.05765

2023-01-14

Abstract:In this paper, we propose a model of arm reaching movements expressed in terms of geodesics in a sub-Riemannian space. We will choose a set of kinematic variables to which motor cortical cells are selective with the purpose of modelling the specific task of reaching. Minimizing trajectories will be recovered as suitable geodesics of the geometric spaces arising from the selective behaviour of M1 neurons. We will then extend this model by including the direction of arm movement. On this set, we will define a suitable sub-Riemannian metric able to provide a geometric interpretation of two-dimensional task-dependent arm reaching movements.

Optimization and Control
Birational geometry of critical loci in Algebraic Vision

Marina Bertolini,Roberto Notari,Cristina Turrini

2024-08-04

Abstract:In Algebraic Vision, the projective reconstruction of the position of each camera and scene point from the knowledge of many enough corresponding points in the views is called the structure from motion problem. It is known that the reconstruction is ambiguous if the scene points are contained in particular algebraic varieties, called critical loci. To be more precise, from the definition of criticality, for the same reconstruction problem, two critical loci arise in a natural way. In the present paper, we investigate the relations between these two critical loci, and we prove that, under some mild smoothness hypotheses, (some of) their irreducible components are birational. To this end, we introduce a unified critical locus that restores the symmetry between the two critical loci, and a natural commutative diagram relating the unified critical locus and the two single critical loci. For technical reasons, but of interest in its own, we also consider how a critical locus change when one increases the number of views.

Algebraic Geometry
A metric model for the functional architecture of the visual cortex

Noemi Montobbio,Alessandro Sarti,Giovanna Citti

DOI: https://doi.org/10.48550/arXiv.1807.02479

2019-10-11

Abstract:The purpose of this work is to construct a model for the functional architecture of the primary visual cortex (V1), based on a structure of metric measure space induced by the underlying organization of receptive profiles (RPs) of visual cells. In order to account for the horizontal connectivity of V1 in such a context, a diffusion process compatible with the geometry of the space is defined following the classical approach of K.-T. Sturm. The construction of our distance function does neither require any group parameterization of the family of RPs, nor involve any differential structure. As such, it adapts to non-parameterized sets of RPs, possibly obtained through numerical procedures; it also allows to model the lateral connectivity arising from non-differential metrics such as the one induced on a pinwheel surface by a family of filters of vanishing scale. On the other hand, when applied to the classical framework of Gabor filters, this construction yields a distance approximating the sub-Riemannian structure proposed as a model for V1 by G. Citti and A. Sarti [J Math Imaging Vis 24: 307 (2006)], thus showing itself to be consistent with existing cortex models.

Metric Geometry,Neurons and Cognition
Understanding visual processing of motion: Completing the picture using experimentally driven computational models of MT

Parvin Zarei Eskikand,David B Grayden,Tatiana Kameneva,Anthony N Burkitt,Michael R Ibbotson

2023-09-21

Abstract:Computational modeling helps neuroscientists to integrate and explain experimental data obtained through neurophysiological and anatomical studies, thus providing a mechanism by which we can better understand and predict the principles of neural computation. Computational modeling of the neuronal pathways of the visual cortex has been successful in developing theories of biological motion processing. This review describes a range of computational models that have been inspired by neurophysiological experiments. Theories of local motion integration and pattern motion processing are presented, together with suggested neurophysiological experiments designed to test those hypotheses.

Neurons and Cognition,Quantitative Methods
Cortical Functional architectures as contact and sub-Riemannian geometry

Giovanna Citti,Alessandro Sarti

2023-10-16

Abstract:In a joint paper, Jean Petitot together with the authors of the present paper described the functional geometry of the visual cortex as the symplectization of a contact form to describe the family of cells sensitive to position, orientation and scale. In the present paper, as a "homage" to the enormous contribution of Jean Petitot to neurogeometry, we will extend this approach to more complex functional architectures built as a sequence of contactization or a symplectization process, able to extend the dimension of the space. We will also outline a few examples where a sub-Riemannian lifting is needed.

Neurons and Cognition,Differential Geometry
Problems and related results in Algebraic Vision and Multiview Geometry

Marina Bertolini,Cristina Turrini

2024-01-31

Abstract:The article presents a survey of results in algebraic vision and multiview geometry. The starting points is the study of projective algebraic varieties critical for scene reconstruction. Initially studied for reconstructing static scenes in three-dimensional spaces, these critical loci are later investigated for dynamic and segmented scenes in higher-dimensional projective spaces. The formal analysis of the ideals of critical loci employs Grassmann tensors, introduced as crucial tools for determining these ideals and aiding the reconstruction process away from critical loci. A long-term goal of the authors with other co-authors involves two main aspects: firstly studying properties of Grassmann tensors, as rank, multi-rank and core, along with the varieties that parameterize these tensors; concurrently conducting an analysis of families of critical loci in various scenarios.

Algebraic Geometry
Individuation of 3D perceptual units from neurogeometry of binocular cells

Maria Virginia Bolelli,Giovanna Citti,Alessandro Sarti,Steven W. Zucker

2024-10-04

Abstract:We model the functional architecture of the early stages of three-dimensional vision by extending the neurogeometric sub-Riemannian model for stereo-vision introduced in \cite{BCSZ23}. A new framework for correspondence is introduced that integrates a neural-based algorithm to achieve stereo correspondence locally while, simultaneously, organizing the corresponding points into global perceptual units. The result is an effective scene segmentation. We achieve this using harmonic analysis on the sub-Riemannian structure and show, in a comparison against Riemannian distance, that the sub-Riemannian metric is central to the solution.

Neurons and Cognition,Computer Vision and Pattern Recognition,Differential Geometry
A connectomics-driven analysis reveals novel characterization of border regions in mouse visual cortex

Neehal Tumma,Linghao Kong,Shashata Sawmya,Tony T. Wang,Nir Shavit

DOI: https://doi.org/10.1101/2024.05.24.595837

2024-05-26

Abstract:Leveraging retinotopic maps to parcellate the visual cortex into its respective sub-regions has long been a canonical approach to characterizing the functional organization of visual areas in the mouse brain. However, with the advent of extensive connectomics datasets like MICrONS, we can now perform more granular analyses on biological neural networks, enabling us to better characterize the structural and functional profile of the visual cortex. In this work, we propose a statistical framework for analyzing the MICrONS dataset, focusing our efforts on the network encompassed by the retinotopically-induced V1, RL, and AL visual areas. In particular, we bridge the gap between connectomics and retinotopy by identifying several structural and functional differences between these regions. Most notably, by placing our attention on the borders between these regions, we demonstrate how connectomics, in some ways, supersedes retinotopy, providing evidence for two major findings. One, by comparing the V1-RL and RL-AL border regions, we show that not all borders in the visual cortex are the same with respect to structure and function. Two, we propose a novel interpretation for the V1-RL border region in particular, motivating it as a subnetwork that possesses heightened synaptic connectivity and more synchronous neural activity. Going one step further, we analyze structure and function in tandem by measuring information flow along synapses, demonstrating that the V1-RL border serves as a bridge for communication between the V1 and RL visual areas, offering justification as to why it presents itself uniquely with respect to both structure and function.

Neuroscience
Spatial and color hallucinations in a mathematical model of primary visual cortex

Olivier D. Faugeras,Anna Song,Romain Veltz

DOI: https://doi.org/10.5802/crmath.289

2021-10-19

Abstract:We study a simplified model of the representation of colors in the primate primary cortical visual area V1. The model is described by an initial value problem related to a Hammerstein equation. The solutions to this problem represent the variation of the activity of populations of neurons in V1 as a function of space and color. The two space variables describe the spatial extent of the cortex while the two color variables describe the hue and the saturation represented at every location in the cortex. We prove the well-posedness of the initial value problem. We focus on its stationary, i.e. independent of time, and periodic in space solutions. We show that the model equation is equivariant with respect to the direct product G of the group of the Euclidean transformations of the planar lattice determined by the spatial periodicity and the group of color transformations, isomorphic to O(2), and study the equivariant bifurcations of its stationary solutions when some parameters in the model vary. Their variations may be caused by the consumption of drugs and the bifurcated solutions may represent visual hallucinations in space and color. Some of the bifurcated solutions can be determined by applying the Equivariant Branching Lemma (EBL) by determining the axial subgroups of G . These define bifurcated solutions which are invariant under the action of the corresponding axial subgroup. We compute analytically these solutions and illustrate them as color images. Using advanced methods of numerical bifurcation analysis we then explore the persistence and stability of these solutions when varying some parameters in the model. We conjecture that we can rely on the EBL to predict the existence of patterns that survive in large parameter domains but not to predict their stability. On our way we discover the existence of spatially localized stable patterns through the phenomenon of "snaking".

Neurons and Cognition,Dynamical Systems,Numerical Analysis,Pattern Formation and Solitons
Role of the Cerebellum in the Construction of Functional and Geometrical Spaces

Eya Torkhani Langlois,Daniel Bennequin,Giovanni de Marco

DOI: https://doi.org/10.1007/s12311-024-01693-y

2024-04-18

The Cerebellum

Abstract:The perceptual and motor systems appear to have a set of movement primitives that exhibit certain geometric and kinematic invariances. Complex patterns and mental representations can be produced by (re)combining some simple motor elements in various ways using basic operations, transformations, and respecting a set of laws referred to as kinematic laws of motion. For example, point-to-point hand movements are characterized by straight hand paths with single-peaked-bell-shaped velocity profiles, whereas hand speed profiles for curved trajectories are often irregular and more variable, with speed valleys and inflections extrema occurring at the peak curvature. Curvature and speed are generically related by the 2/3 power law. Mathematically, such laws can be deduced from a combination of Euclidean, affine, and equi-affine geometries, whose neural correlates have been partially detected in various brain areas including the cerebellum and the basal ganglia. The cerebellum has been found to play an important role in the control of coordination, balance, posture, and timing over the past years. It is also assumed that the cerebellum computes forward internal models in relationship with specific cortical and subcortical brain regions but its motor relationship with the perceptual space is unclear. A renewed interest in the geometrical and spatial role of the cerebellum may enable a better understanding of its specific contribution to the action-perception loop and behavior's adaptation. In this sense, we complete this overview with an innovative theoretical framework that describes a possible implementation and selection by the cerebellum of geometries adhering to different mathematical laws.

neurosciences
Tire Tracks and Integrable Curve Evolution

Gil Bor,Mark Levi,Ron Perline,Sergei Tabachnikov

DOI: https://doi.org/10.1093/imrn/rny087

2018-05-17

International Mathematics Research Notices

Abstract:Abstract We study a simple model of bicycle motion: a segment of fixed length in multi-dimensional Euclidean space, moving so that the velocity of the rear end is always aligned with the segment. If the front track is prescribed, the trajectory of the rear wheel is uniquely determined via a certain first order differential equation—the bicycle equation. The same model, in dimension two, describes another mechanical device, the hatchet planimeter. Here is a sampler of our results. We express the linearized flow of the bicycle equation in terms of the geometry of the rear track; in dimension three, for closed front and rear tracks, this is a version of the Berry phase formula. We show that in all dimensions a sufficiently long bicycle also serves as a planimeter: it measures, approximately, the area bivector defined by the closed front track. We prove that the bicycle equation also describes rolling, without slipping and twisting, of hyperbolic space along Euclidean space. We relate the bicycle problem with two completely integrable systems: the Ablowitz, Kaup, Newell, and Segur (AKNS) system and the vortex filament equation. We show that “bicycle correspondence” of space curves (front tracks sharing a common back track) is a special case of a Darboux transformation associated with the AKNS system. We show that the filament hierarchy, encoded as a single generating equation, describes a three-dimensional bike of imaginary length. We show that a series of examples of “ambiguous” closed bicycle curves (front tracks admitting self bicycle correspondence), found recently F. Wegner, are buckled rings, or solitons of the planar filament equation. As a case study, we give a detailed analysis of such curves, arising from bicycle correspondence with multiply traversed circles.

mathematics
Building egocentric models of local space from retinal input

Dylan M. Martins,Joy M. Manda,Michael J. Goard,Philip R.L. Parker

DOI: https://doi.org/10.1016/j.cub.2024.10.057

IF: 9.2

2024-12-03

Current Biology

Abstract:Visual input reaches the brain in retina-centered coordinates but is transformed into new reference frames to support spatial cognition and behavioral outputs. Martins et al. review the neural circuit and computational implementations of this transformation in the nervous systems of diverse animal species and discuss future avenues for experimental investigation.

cell biology,biochemistry & molecular biology,biology
A computational model for grid maps in neural populations

Fabio Anselmi,Micah M Murray,Benedetta Franceschiello

DOI: https://doi.org/10.1007/s10827-020-00742-9

Abstract:Grid cells in the entorhinal cortex, together with head direction, place, speed and border cells, are major contributors to the organization of spatial representations in the brain. In this work we introduce a novel theoretical and algorithmic framework able to explain the optimality of hexagonal grid-like response patterns. We show that this pattern is a result of minimal variance encoding of neurons together with maximal robustness to neurons' noise and minimal number of encoding neurons. The novelty lies in the formulation of the encoding problem considering neurons as an overcomplete basis (a frame) where the position information is encoded. Through the modern Frame Theory language, specifically that of tight and equiangular frames, we provide new insights about the optimality of hexagonal grid receptive fields. The proposed model is based on the well-accepted and tested hypothesis of Hebbian learning, providing a simplified cortical-based framework that does not require the presence of velocity-driven oscillations (oscillatory model) or translational symmetries in the synaptic connections (attractor model). We moreover demonstrate that the proposed encoding mechanism naturally explains axis alignment of neighbor grid cells and maps shifts, rotations and scaling of the stimuli onto the shape of grid cells' receptive fields, giving a straightforward explanation of the experimental evidence of grid cells remapping under transformations of environmental cues.
Hyperbolic planforms in relation to visual edges and textures perception

Pascal Chossat,Olivier Faugeras

DOI: https://doi.org/10.1371/journal.pcbi.1000625

2009-11-07

Abstract:We propose to use bifurcation theory and pattern formation as theoretical probes for various hypotheses about the neural organization of the brain. This allows us to make predictions about the kinds of patterns that should be observed in the activity of real brains through, e.g. optical imaging, and opens the door to the design of experiments to test these hypotheses. We study the specific problem of visual edges and textures perception and suggest that these features may be represented at the population level in the visual cortex as a specific second-order tensor, the structure tensor, perhaps within a hypercolumn. We then extend the classical ring model to this case and show that its natural framework is the non-Euclidean hyperbolic geometry. This brings in the beautiful structure of its group of isometries and certain of its subgroups which have a direct interpretation in terms of the organization of the neural populations that are assumed to encode the structure tensor. By studying the bifurcations of the solutions of the structure tensor equations, the analog of the classical Wilson and Cowan equations, under the assumption of invariance with respect to the action of these subgroups, we predict the appearance of characteristic patterns. These patterns can be described by what we call hyperbolic or H-planforms that are reminiscent of Euclidean planar waves and of the planforms that were used in [1, 2] to account for some visual hallucinations. If these patterns could be observed through brain imaging techniques they would reveal the built-in or acquired invariance of the neural organization to the action of the corresponding subgroups.

Pattern Formation and Solitons
The functional architecture of the early vision and neurogeometric models

Dmitri V. Alekseevsky,Andrea Spiro

2024-10-26

Abstract:The initial sections of the paper give a concise presentation, specially designed for a mathematically oriented audience, of some of the most basic facts on the functional architecture of early vision. Such information is usually scattered in a variety of papers and books, which are not easily accessible by non-specialists. Our goal is thus to offer a handy and short introduction to this topics, which might be helpful for researchers willing to enter the area of the applications of modern Differential Geometry in studies on the visual systems, baptized neurogeometry by J. Petitot. We then offer a survey of three of the most important neurogeometric models: Petitot's contact model of the primary visual cortex, its extension to A. Sarti, G. Citti and J. Petitot's symplectic model, and P. C. Bressloff and J. D. Cowan's spherical model of hypercolumns. We finally discuss the main points of the so-called ``conformal model'' for hypercolumns (a model that was briefly presented in [D. V. Alekseevsky, Conformal model of hypercolumns in V1 cortex and the Moebius group, in ``Geometric science of information'', pp. 65--72, Springer, 2021] and given in detail in [D. V. Alekseevsky and A. Spiro, Conformal models for hypercolumns in the primary visual cortex V1, arXiv 2024]), which can be considered as a synthesis of the symplectic and the spherical models.

Neurons and Cognition,Differential Geometry

A new perspective on border completion in visual cortex as bicycle rear wheel geodesics paths via sub-Riemannian Hamiltonian formalism

A Computational Model of Topological and Geometric Recovery for Visual Curve Completion.

A Cortical-Inspired Contour Completion Model Based on Contour Orientation and Thickness

Computer Simulation of Crossing Line Based Geometric Illusions

A sub-Riemannian model of the functional architecture of M1 for arm movement direction

Geometry of the Visual Cortex with Applications to Image Inpainting and Enhancement

A model of reaching via subriemannian geodesics in Engel-type group

Birational geometry of critical loci in Algebraic Vision

A metric model for the functional architecture of the visual cortex

Understanding visual processing of motion: Completing the picture using experimentally driven computational models of MT

Cortical Functional architectures as contact and sub-Riemannian geometry

Problems and related results in Algebraic Vision and Multiview Geometry

Individuation of 3D perceptual units from neurogeometry of binocular cells

A connectomics-driven analysis reveals novel characterization of border regions in mouse visual cortex

Spatial and color hallucinations in a mathematical model of primary visual cortex

Role of the Cerebellum in the Construction of Functional and Geometrical Spaces

Tire Tracks and Integrable Curve Evolution

Building egocentric models of local space from retinal input

A computational model for grid maps in neural populations

Hyperbolic planforms in relation to visual edges and textures perception

The functional architecture of the early vision and neurogeometric models