[Diagnostic statistics from neurological clinics during 1953].

W. Jakimowicz,F. Banachowska,B. Dobrowolska,M. Goldsztajn,Z. Czarski,Z. Kuberski,H. Sulat,J. Szulc,W. Zietkiewicz,A. Seidel-Kolodziejowa,R. Michalowicz,M. Dowgiallo,K. Pucilowska,J. Gaj,W. Chłopicki

Abstract:

What problem does this paper attempt to address?

Somatotopic Reorganization of Hand Representation in Bilateral Arm Amputees with or Without Special Foot Movement Skill.

Xiao Jing Yu,Hong Jian He,Qiao Wei Zhang,Feng Zhao,Chi Shing Zee,Shi Zheng Zhang,Xiang Yang Gong

DOI: https://doi.org/10.1016/j.brainres.2013.12.025

IF: 3.61

2014-01-01

Brain Research

Abstract:Bilateral arm amputees usually are excellent foot users. To explore the plasticity of the primary motor cortex in upper-extremities amputees and to determine if the acquisition of special foot movement skill is related with the bilateral hand amputation, we studied the primary motor cortex by using combined task and resting state functional magnetic resonance imaging (fMRI). We investigated 6 bilateral arm amputees with or without special foot movement skill. In the task fMRI study, we found that toe tapping of all the amputees activated the bilateral hand area, including cases without special foot skill. In addition, cases without special foot skill mainly activated the precentral gyrus, which differed from those with more adept foot motor skill who activated both the precentral and postcentral gyri. To further understand the plasticity of the hand area, the resting state functional connectivity was investigated between the foot and hand regions. One-tailed two-sample t-test suggested that the connections between two areas became significantly stronger in the amputee group. Our study demonstrates that hand region of the cortex does not remain 'silent' after bilateral arm amputation, but rather is recruited by other modalities such as adjacent or nonadjacent cortexes to process motor information in a functionally relevant manner. From the data presented, it seems that the bilateral arm amputees have a strong potential to develop new skills in their remaining extremities and practice may further enhance this potential.
Extending tactile space with hand-held tools: A re-analysis and review

Luke E. Miller,Alessandro Farnè

DOI: https://doi.org/10.1101/2024.04.01.587537

2024-04-02

Abstract:Tools can extend the sense of touch beyond the body, allowing the user to extract sensory information about distal objects in their environment. Though research on this topic has trickled in over the last few decades, little is known about the neurocomputational mechanisms of extended touch. In 2016, along with our late collaborator Vincent Hayward, we began a series of studies that attempted to fill this gap. We specifically focused on the ability to localize touch on the surface of a rod, as if it were part of the body. We have conducted eight behavioral experiments over the last several years, all of which have found that humans are incredibly accurate at tool-extended tactile localization. In the present article, we perform a model-driven reanalysis of these findings with an eye towards estimating the underlying parameters that map sensory input into spatial perception. This reanalysis revealed that users can almost perfectly localize touch on hand-held tools. This raises the question of how humans can be so good at localizing touch on an inert non-corporeal object. The remainder of the paper focuses on three aspects of this process that occupied much of our collaboration with Vincent: the mechanical information used by participants for localization; the speed by which the nervous system can transform this information into a spatial percept; and whether body-based computations are repurposed for tool-extended touch. In all, these studies underscore the special relationship between bodies and tools.

Neuroscience
Intrinsic Horizontal Connections Process Global Tactile Features in the Primary Somatosensory Cortex: Neuroanatomical Evidence

Laszlo Negyessy,Emese Palfi,Maria Ashaber,Cory Palmer,Balazs Jakli,Robert M. Friedman,Li M. Chen,Anna W. Roe

DOI: https://doi.org/10.1002/cne.23317

2013-01-01

Abstract:To understand manual tactile functions in primates, it is essential to explore the interactions between the finger pad representations in somatosensory cortex. To this end, we used optical imaging and electrophysiological mapping to guide neuroanatomical tracer injections into distal digit tip representations of Brodmann area 3b in the squirrel monkey. Retrogradely labeled cell densities and anterogradely labeled fibers and terminal patches in somatosensory areas were plotted and quantified with respect to tangential distribution. Within area 3b, reciprocal patchy distribution of anterograde and retrograde labeling spanned the representation of the distal pad of multiple digits, indicating strong cross-digit connectivity. Inter-areal connections revealed bundles of long-range fibers projecting anteroposteriorly, connecting area 3b with clusters of labeled neurons and terminal axon arborizations in area 1. Inter-areal linkage appeared to be largely confined to the representation of the injected finger. These findings provide the neuroanatomical basis for the interaction between distal finger pad representations observed by recent electrophysiological studies. We propose that intra-areal connectivity may be heavily involved in interdigit integration such as shape discrimination, whereas long-range inter-areal connections may subserve active touch in a digit-specific manner.
Tool use fine-tunes arm and tool maps

Valeria C Peviani,Leo N Pfeifer,Gaia Risso,Michela Bassolino,Luke Miller

DOI: https://doi.org/10.1101/2024.06.06.597694

2024-06-06

Abstract:There is evidence that the sensorimotor system builds fine-grained spatial maps of the limbs based on somatosensory signals. Can a hand-held tool be mapped in space with a comparable spatial resolution? Do spatial maps change following tool use? In order to address these questions, we used a spatial mapping task on healthy participants to measure the accuracy and precision of spatial estimates pertaining to several locations on their arm and on a hand-held tool. To study spatial accuracy, we first fitted linear regressions with real location as predictor and estimated location as dependent variables. Intercepts and slopes, representing constant offset and estimation error, were compared between arm and tool, and before to after tool use. We further investigated changes induced by tool use in terms of variable error associated with spatial estimates, representing their precision. We found that the spatial maps for the arm and tool were comparably accurate, suggesting that holding the tool provides enough information to the sensorimotor system to map it in space. Further, using the tool fine-tuned the user spatial maps, increasing the precision of the tool map to a greater extent than their arm map. Furthermore, this increased precision is focal to specific tool locations, i.e., the tool tip, which may work as a spatial anchor following tool use. Our results demonstrate that tool users possess dynamic maps of tool space that are comparable to body space.

Neuroscience
α-Lipoic Acid Alters Post-Translational Modifications and Protects the Chaperone Activity of Lens α-Crystallin in Naphthalene-Induced Cataract

Yan Chen,L. Yi,Guo-quan Yan,Yanwen Fang,Y. Jang,Xin-hua Wu,Xin-wen Zhou,Liming Wei

DOI: https://doi.org/10.3109/02713681003768211

2010-07-01

Current Eye Research

Abstract:Purpose: To evaluate whether α-lipoic acid (LA) inhibits lens opacity of naphthalene-induced cataract by altering post-translational modifications (PTMs) and protecting the chaperone activity of α-crystallins. Methods: Forty-five Sprague-Dawley rats were divided into three groups: control, naphthalene, and naphthalene plus LA. Cataracts were induced by oral administration of 1 g naphthalene/kg body weight/day. Rats in the naphthalene plus LA group were also fed 30 mg LA/day. The development of naphthalene-initiated cataract was monitored every week by slit lamp microscopy for nine weeks, then the lens proteins were separated by HPLC, and peaks corresponding to α-crystallins were resolved on 2-DE. The spots of 2-DE were subjected to mass spectrometry to identify PTMs. Chaperone activity of α-crystallins was measured by heat-induced aggregation of βL-crystallin. Results: The lenses of rats fed with naphthalene plus LA exhibited less light scattering than that fed with only naphthalene at three weeks after treatment (P < 0.01). C-terminal truncated αA crystallin was detected in naphthalene-induced cataract and was abrogated by LA treatment. Several other post-translational modifications were identified including methylation, phosphorylation, acetylation, carbamylation, and oxidation. Conclusions: Our data are the first to show PTM changes induced by naphthalene in rat lenses. Our findings also indicate that LA can inhibit naphthalene-induced lens opacity by altering PTM and protecting the chaperone activity of α-crystallins.
Tactile stimulation designs adapted to clinical settings result in reliable fMRI-based somatosensory digit maps

Till Steinbach,Judith Eck,Inge Timmers,Emma E. Biggs,Rainer Goebel,Renate Schweizer,Amanda L. Kaas

DOI: https://doi.org/10.1186/s12868-024-00892-x

2024-10-03

BMC Neuroscience

Abstract:Movement constraints in stroke survivors are often accompanied by additional impairments in related somatosensory perception. A complex interplay between the primary somatosensory and motor cortices is essential for adequate and precise movements. This necessitates investigating the role of the primary somatosensory cortex in movement deficits of stroke survivors. The first step towards this goal could be a fast and reliable functional Magnetic Resonance Imaging (fMRI)-based mapping of the somatosensory cortex applicable for clinical settings. Here, we compare two 3 T fMRI-based somatosensory digit mapping techniques adapted for clinical usage in seven neurotypical volunteers and two sessions, to assess their validity and retest-reliability. Both, the traveling wave and the blocked design approach resulted in complete digit maps in both sessions of all participants, showing the expected layout. Similarly, no evidence for differences in the volume of activation, nor the activation overlap between neighboring activations could be detected, indicating the general feasibility of the clinical adaptation and their validity. Retest-reliability, indicated by the Dice coefficient, exhibited reasonable values for the spatial correspondence of single digit activations across sessions, but low values for the spatial correspondence of the area of overlap between neighboring digits across sessions. Parameters describing the location of the single digit activations exhibited very high correlations across sessions, while activation volume and overlap only exhibited medium to low correlations. The feasibility and high retest-reliabilities for the parameters describing the location of the single digit activations are promising concerning the implementation into a clinical context to supplement diagnosis and treatment stratification in upper limb stroke patients.

neurosciences
[Neuronal connections within the hand representation in areas 3b and 1 of the somatosensory cortex in primates].

Emese Pálfi,Mária Ashaber,Cory Palmer,Robert M Friedman,Anna W Roe,László Négyessy

DOI: https://doi.org/10.1556/650.2016.30499

2016-01-01

Orvosi Hetilap

Abstract:Introduction: The close functional relationship between areas 3b and 1 of the somatosensory cortex is based on their reciprocal connections indicating that tactile sensation depends on the interaction of these two areas. Aim: The aim of the authors was to explore this neuronal circuit at the level of the distal finger pad representation. Method: The study was made by bidirectional tract tracing aided by neurophysiological mapping in squirrel monkeys ( Saimiri sciureus). Results: Inter-areal connections between the two areas preferred the homologues representations. However, intra-areal connections were formed between the neighboring finger pad representations supporting the physiological observations. Interestingly, the size of the local input area of the injected cortical micro-region, which differed in the two areas, represented the same skin area. Conclusions: The authors propose that intra-areal connections are important in integrating information across fingers, while inter-areal connections are important in maintaining input localization during hand movement.
The homunculus for proprioception: Toward learning the representation of a humanoid robot's joint space using self-organizing maps

Filipe Gama,Matej Hoffmann

DOI: https://doi.org/10.48550/arXiv.1909.02295

2019-09-05

Abstract:In primate brains, tactile and proprioceptive inputs are relayed to the somatosensory cortex which is known for somatotopic representations, or, "homunculi". Our research centers on understanding the mechanisms of the formation of these and more higher-level body representations (body schema) by using humanoid robots and neural networks to construct models. We specifically focus on how spatial representation of the body may be learned from somatosensory information in self-touch configurations. In this work, we target the representation of proprioceptive inputs, which we take to be joint angles in the robot. The inputs collected in different body postures serve as inputs to a Self-Organizing Map (SOM) with a 2D lattice on the output. With unrestricted, all-to-all connections, the map is not capable of representing the input space while preserving the topological relationships, because the intrinsic dimensionality of the body posture space is too large. Hence, we use a method we developed previously for tactile inputs (Hoffmann, Straka et al. 2018) called MRF-SOM, where the Maximum Receptive Field of output neurons is restricted so they only learn to represent specific parts of the input space. This is in line with the receptive fields of neurons in somatosensory areas representing proprioception that often respond to combination of few joints (e.g. wrist and elbow).

Robotics,Neurons and Cognition
Body Models in Humans and Robots

Matej Hoffmann,Matthew R. Longo

DOI: https://doi.org/10.48550/arXiv.2201.08319

IF: 3.7

2022-01-20

Robotics

Abstract:Neurocognitive models of higher-level somatosensory processing have emphasised the role of stored body representations in interpreting real-time sensory signals coming from the body (Longo, Azanon and Haggard, 2010; Tame, Azanon and Longo, 2019). The need for such stored representations arises from the fact that immediate sensory signals coming from the body do not specify metric details about body size and shape. Several aspects of somatoperception, therefore, require that immediate sensory signals be combined with stored body representations. This basic problem is equally true for humanoid robots and, intriguingly, neurocognitive models developed to explain human perception are strikingly similar to those developed independently for localizing touch on humanoid robots, such as the iCub, equipped with artificial electronic skin on the majority of its body surface (Roncone et al., 2014; Hoffmann, 2021). In this chapter, we will review the key features of these models, discuss their similarities and differences to each other, and to other models in the literature. Using robots as embodied computational models is an example of synthetic methodology or 'understanding by building' (e.g., Hoffmann and Pfeifer, 2018), computational embodied neuroscience (Caligiore et al., 2010) or 'synthetic psychology of the self' (Prescott and Camilleri, 2019). Such models have the advantage that they need to be worked out into every detail, making any theory explicit and complete. There is also an additional way of (pre)validating such a theory other than comparing to the biological or psychological phenomenon studied by simply verifying that a particular implementation really performs the task: can the robot localize where it is being touched (see https://youtu.be/pfse424t5mQ)?
NeuralFeels with neural fields: Visuotactile perception for in-hand manipulation.

Sudharshan Suresh,Tingfan Wu,Luis Pineda,Mrinal Kalakrishnan,Mustafa Mukadam,Roberto Calandra,Joseph Ortiz,Mike Lambeta,Taosha Fan,Haozhi Qi,Michael Kaess,Jitendra Malik

DOI: https://doi.org/10.1126/scirobotics.adl0628

IF: 25

2024-11-13

Science Robotics

Abstract:To achieve human-level dexterity, robots must infer spatial awareness from multimodal sensing to reason over contact interactions. During in-hand manipulation of novel objects, such spatial awareness involves estimating the object's pose and shape. The status quo for in-hand perception primarily uses vision and is restricted to tracking a priori known objects. Moreover, visual occlusion of objects in hand is imminent during manipulation, preventing current systems from pushing beyond tasks without occlusion. We combined vision and touch sensing on a multifingered hand to estimate an object's pose and shape during in-hand manipulation. Our method, NeuralFeels, encodes object geometry by learning a neural field online and jointly tracks it by optimizing a pose graph problem. We studied multimodal in-hand perception in simulation and the real world, interacting with different objects via a proprioception-driven policy. Our experiments showed final reconstruction F scores of 81% and average pose drifts of 4.7 millimeters, which was further reduced to 2.3 millimeters with known object models. In addition, we observed that, under heavy visual occlusion, we could achieve improvements in tracking up to 94% compared with vision-only methods. Our results demonstrate that touch, at the very least, refines and, at the very best, disambiguates visual estimates during in-hand manipulation. We release our evaluation dataset of 70 experiments, FeelSight, as a step toward benchmarking in this domain. Our neural representation driven by multimodal sensing can serve as a perception backbone toward advancing robot dexterity.

Medicine,Computer Science,Engineering
Eyes and hand are both reliable at localizing somatosensory targets

Marion Naffrechoux,Eric Koun,Frederic Volland,Alessandro Farnè,Alice Catherine Roy,Denis Pélisson

DOI: https://doi.org/10.1007/s00221-024-06922-8

2024-09-29

Experimental Brain Research

Abstract:Body representations (BR) for action are critical to perform accurate movements. Yet, behavioral measures suggest that BR are distorted even in healthy people. However, the upper limb has mostly been used as a probe so far, making difficult to decide whether BR are truly distorted or whether this depends on the effector used as a readout. Here, we aimed to assess in healthy humans the accuracy of the eye and hand effectors in localizing somatosensory targets, to determine whether they may probe BR similarly. Twenty-six participants completed two localization tasks in which they had to localize an unseen target (proprioceptive or tactile) with either their eyes or hand. Linear mixed model revealed in both tasks a larger horizontal (but not vertical) localization error for the ocular than for the manual localization performance. However, despite better hand mean accuracy, manual and ocular localization performance positively correlated to each other in both tasks. Moreover, target position also affected localization performance for both eye and hand responses: accuracy was higher for the more flexed position of the elbow in the proprioceptive task and for the thumb than for the index finger in the tactile task, thus confirming previous results of better performance for the thumb. These findings indicate that the hand seems to beat the eyes along the horizontal axis when localizing somatosensory targets, but the localization patterns revealed by the two effectors seemed to be related and characterized by the same target effect, opening the way to assess BR with the eyes when upper limb motor control is disturbed.

neurosciences
Vibrotactile information improves proprioceptive reaching target localization

Laura Mikula,Sofia Sahnoun,Laure Pisella,Gunnar Blohm,Aarlenne Zein Khan

DOI: https://doi.org/10.1371/journal.pone.0199627

IF: 3.7

2018-07-06

PLoS ONE

Abstract:When pointing to parts of our own body (e.g., the opposite index finger), the position of the target is derived from proprioceptive signals. Consistent with the principles of multisensory integration, it has been found that participants better matched the position of their index finger when they also had visual cues about its location. Unlike vision, touch may not provide an additional information about finger position in space, since fingertip tactile information theoretically remains the same irrespective of the postural configuration of the upper limb. However, since tactile and proprioceptive information are ultimately coded within the same population of posterior parietal neurons within high-level spatial representations, we nevertheless hypothesized that additional tactile information could benefit the processing of proprioceptive signals. To investigate the influence of tactile information on proprioceptive localization, we asked 19 participants to reach with the right hand towards the opposite unseen index finger (proprioceptive target). Vibrotactile stimuli were applied to the target index finger prior to movement execution. We found that participants made smaller errors and more consistent reaches following tactile stimulation. These results demonstrate that transient touch provided at the proprioceptive target improves subsequent reaching precision and accuracy. Such improvement was not observed when tactile stimulation was delivered to a distinct body part (the shoulder). This suggests a specific spatial integration of touch and proprioception at the level of high-level cortical body representations, resulting in touch improving position sense.

multidisciplinary sciences
Digit somatotopy within cortical areas of the postcentral gyrus in humans.

A. Nelson,Robert Chen

DOI: https://doi.org/10.1093/cercor/bhm257

IF: 4.861

2008-10-01

Cerebral Cortex

Abstract:Characterizing the cortical representation of the body surface is fundamental to understanding the neural basis of human somatic sensation. Monkey studies benefited from the detailed somatotopic maps obtained from electrophysiology methods. Advances in noninvasive neuroimaging techniques now permit such questions to be probed in humans. The present study characterizes the detailed somatotopic representation of individual digits within subregions of the postcentral gyrus in humans using high-spatial resolution functional magnetic resonance imaging and surface-based mapping. Four areas of consistent activation included area 3b, area 2, and 2 discrete foci within area 1. Area 3b and the superior area 1 foci demonstrated an orderly somatotopic distribution for all digits of the hand, whereby the thumb was represented most lateral, anterior, and inferior and the fifth digit was most medial, posterior, and superior. Compared with area 3b, somatotopic variability was greater in area 1 and the digits spanned less cortical territory. This study additionally identified the specific digit pairs that are separable in areas 3b and 1 using current imaging methods. Somatotopy was not resolved in area 2 or in the inferior area 1 foci.

Psychology,Biology,Medicine
Connectivity defines the distinctive anatomy and function of the hand-knob area

Ahmad Beyh,Henrietta Howells,Davide Giampiccolo,Daniele Cancemi,Francisco De Santiago Requejo,Salvatore Citro,Hannah Keeble,José Pedro Lavrador,Ranjeev Bhangoo,Keyoumars Ashkan,Flavio Dell'Acqua,Marco Catani,Francesco Vergani

DOI: https://doi.org/10.1093/braincomms/fcae261

2024-08-13

Abstract:Control of the hand muscles during fine digit movements requires a high level of sensorimotor integration, which relies on a complex network of cortical and subcortical hubs. The components of this network have been extensively studied in human and non-human primates, but discrepancies in the findings obtained from different mapping approaches are difficult to interpret. In this study, we defined the cortical and connectional components of the hand motor network in the same cohort of 20 healthy adults and 3 neurosurgical patients. We used multimodal structural magnetic resonance imaging (including T1-weighted imaging and diffusion tractography), as well as functional magnetic resonance imaging and navigated transcranial magnetic stimulation (nTMS). The motor map obtained from nTMS compared favourably with the one obtained from functional magnetic resonance imaging, both of which overlapped well within the 'hand-knob' region of the precentral gyrus and in an adjacent region of the postcentral gyrus. nTMS stimulation of the precentral and postcentral gyri led to motor-evoked potentials in the hand muscles in all participants, with more responses recorded from precentral stimulations. We also observed that precentral stimulations tended to produce motor-evoked potentials with shorter latencies and higher amplitudes than postcentral stimulations. Tractography showed that the region of maximum overlap between terminations of precentral-postcentral U-shaped association fibres and somatosensory projection tracts colocalizes with the functional motor maps. The relationships between the functional maps, and between them and the tract terminations, were replicated in the patient cohort. Three main conclusions can be drawn from our study. First, the hand-knob region is a reliable anatomical landmark for the functional localization of fine digit movements. Second, its distinctive shape is determined by the convergence of highly myelinated long projection fibres and short U-fibres. Third, the unique role of the hand-knob area is explained by its direct action on the spinal motoneurons and the access to high-order somatosensory information for the online control of fine movements. This network is more developed in the hand region compared to other body parts of the homunculus motor strip, and it may represent an important target for enhancing motor learning during early development.
Touch Sensors with Overlapping Signals: Concept Investigation on Planar Sensors with Resistive or Optical Transduction

Pedro Piacenza,Emily Hannigan,Clayton Baumgart,Yuchen Xiao,Steve Park,Keith Behrman,Weipeng Dang,Jeremy Espinal,Ikram Hussain,Ioannis Kymissis,Matei Ciocarlie

DOI: https://doi.org/10.48550/arXiv.1802.08209

2019-07-12

Abstract:Traditional methods for achieving high localization accuracy on tactile sensors usually involve a matrix of miniaturized individual sensors distributed on the area of interest. This approach usually comes at a price of increased complexity in fabrication and circuitry, and can be hard to adapt to non-planar geometries. We propose a method where sensing terminals are embedded in a volume of soft material. Mechanical strain in this material results in a measurable signal between any two given terminals. By having multiple terminals and pairing them against each other in all possible combinations, we obtain a rich signal set using few wires. We mine this data to learn the mapping between the signals we extract and the contact parameters of interest. Our approach is general enough that it can be applied with different transduction methods, and achieves high accuracy in identifying indentation location and depth. Moreover, this method lends itself to simple fabrication techniques and makes no assumption about the underlying geometry, potentially simplifying future integration in robot hands.

Robotics
Cortical activations associated with spatial remapping of finger touch using EEG

Anaëlle Alouit,Martine Gavaret,Céline Ramdani,Påvel G Lindberg,Lucile Dupin

DOI: https://doi.org/10.1093/cercor/bhae161

IF: 4.861

2024-04-20

Cerebral Cortex

Abstract:The spatial coding of tactile information is functionally essential for touch-based shape perception and motor control. However, the spatiotemporal dynamics of how tactile information is remapped from the somatotopic reference frame in the primary somatosensory cortex to the spatiotopic reference frame remains unclear. This study investigated how hand position in space or posture influences cortical somatosensory processing. Twenty-two healthy subjects received electrical stimulation to the right thumb (D1) or little finger (D5) in three position conditions: palm down on right side of the body (baseline), hand crossing the body midline (effect of position), and palm up (effect of posture). Somatosensory-evoked potentials (SEPs) were recorded using electroencephalography. One early-, two mid-, and two late-latency neurophysiological components were identified for both fingers: P50, P1, N125, P200, and N250. D1 and D5 showed different cortical activation patterns: compared with baseline, the crossing condition showed significant clustering at P1 for D1, and at P50 and N125 for D5; the change in posture showed a significant cluster at N125 for D5. Clusters predominated at centro-parietal electrodes. These results suggest that tactile remapping of fingers after electrical stimulation occurs around 100–125 ms in the parietal cortex.

neurosciences
Unraveling somatotopic organization in the human brain using machine learning and adaptive supervoxel-based parcellations

Kyle B See,David J Arpin,David E Vaillancourt,Ruogu Fang,Stephen A Coombes

DOI: https://doi.org/10.1016/j.neuroimage.2021.118710

IF: 5.7

2021-12-15

NeuroImage

Abstract:In addition to the well-established somatotopy in the pre- and post-central gyrus, there is now strong evidence that somatotopic organization is evident across other regions in the sensorimotor network. This raises several experimental questions: To what extent is activity in the sensorimotor network effector-dependent and effector-independent? How important is the sensorimotor cortex when predicting the motor effector? Is there redundancy in the distributed somatotopically organized network such that removing one region has little impact on classification accuracy? To answer these questions, we developed a novel experimental approach. fMRI data were collected while human subjects performed a precisely controlled force generation task separately with their hand, foot, and mouth. We used a simple linear iterative clustering (SLIC) algorithm to segment whole-brain beta coefficient maps to build an adaptive brain parcellation and then classified effectors using extreme gradient boosting (XGBoost) based on parcellations at various spatial resolutions. This allowed us to understand how data-driven adaptive brain parcellation granularity altered classification accuracy. Results revealed effector-dependent activity in regions of the post-central gyrus, precentral gyrus, and paracentral lobule. SMA, regions of the inferior and superior parietal lobule, and cerebellum each contained effector-dependent and effector-independent representations. Machine learning analyses showed that increasing the spatial resolution of the data-driven model increased classification accuracy, which reached 94% with 1755 supervoxels. Our SLIC-based supervoxel parcellation outperformed classification analyses using established brain templates and random simulations. Occlusion experiments further demonstrated redundancy across the sensorimotor network when classifying effectors. Our observations extend our understanding of effector-dependent and effector-independent organization within the human brain and provide new insight into the functional neuroanatomy required to predict the motor effector used in a motor control task.
Neural feels with neural fields: Visuo-tactile perception for in-hand manipulation

Sudharshan Suresh,Haozhi Qi,Tingfan Wu,Taosha Fan,Luis Pineda,Mike Lambeta,Jitendra Malik,Mrinal Kalakrishnan,Roberto Calandra,Michael Kaess,Joseph Ortiz,Mustafa Mukadam

2023-12-21

Abstract:To achieve human-level dexterity, robots must infer spatial awareness from multimodal sensing to reason over contact interactions. During in-hand manipulation of novel objects, such spatial awareness involves estimating the object's pose and shape. The status quo for in-hand perception primarily employs vision, and restricts to tracking a priori known objects. Moreover, visual occlusion of objects in-hand is imminent during manipulation, preventing current systems to push beyond tasks without occlusion. We combine vision and touch sensing on a multi-fingered hand to estimate an object's pose and shape during in-hand manipulation. Our method, NeuralFeels, encodes object geometry by learning a neural field online and jointly tracks it by optimizing a pose graph problem. We study multimodal in-hand perception in simulation and the real-world, interacting with different objects via a proprioception-driven policy. Our experiments show final reconstruction F-scores of $81$% and average pose drifts of $4.7\,\text{mm}$, further reduced to $2.3\,\text{mm}$ with known CAD models. Additionally, we observe that under heavy visual occlusion we can achieve up to $94$% improvements in tracking compared to vision-only methods. Our results demonstrate that touch, at the very least, refines and, at the very best, disambiguates visual estimates during in-hand manipulation. We release our evaluation dataset of 70 experiments, FeelSight, as a step towards benchmarking in this domain. Our neural representation driven by multimodal sensing can serve as a perception backbone towards advancing robot dexterity. Videos can be found on our project website <a class="link-external link-https" href="https://suddhu.github.io/neural-feels/" rel="external noopener nofollow">this https URL</a>

Robotics,Computer Vision and Pattern Recognition,Machine Learning
Vicarious Somatotopic Maps Tile Visual Cortex

Nicholas Hedger,Thomas Naselaris,Kendrick Kay,Tomas Knapen

DOI: https://doi.org/10.1101/2024.10.21.619382

2024-10-22

Abstract:Our sensory systems work together to generate a cohesive experience of the world around us. Watching others being touched activates brain areas representing our own sense of touch: the visual system recruits touch-related computations to simulate bodily consequences of visual inputs. One long-standing question is how the brain implements this interface between visual and somatosensory representations. To address this question, we developed a method to simultaneously map somatosensory body part tuning and visual field tuning throughout the brain. Applying this method on ongoing co-activations during rest resulted in detailed maps of the body-part tuning in the brain's endogenous somatotopic network. During movie watching, somatotopic tuning explains responses throughout the entire dorsolateral visual system, revealing an array of somatotopic body maps that tile the cortical surface. The tuning of these maps aligned with those of visual maps, and predicted both preferences for visual field locations and the visual-category preferences for body parts. These results reveal a mode of brain organization in which aligned visual-somatosensory topographic maps connect visual and bodily reference frames. This cross-modal interface is ideally situated to translate raw sensory impressions into more abstract formats useful for action, social cognition, and semantic processing.

Neuroscience
From Skin Mechanics to Tactile Neural Coding: Predicting Afferent Neural Dynamics During Active Touch and Perception

Yuyang Wei,Francis P McGlone,Andrew G Marshall,Adarsh Makdani,Zhenmin Zou,Lei Ren,Guowu Wei

DOI: https://doi.org/10.1109/TBME.2022.3177006

Abstract:First order cutaneous neurons allow object recognition, texture discrimination, and sensorimotor feedback. Their function is well-investigated under passive stimulation while their role during active touch or sensorimotor control is understudied. To understand how human perception and sensorimotor controlling strategy depend on cutaneous neural signals under active tactile exploration, the finite element (FE) hand and Izhikevich neural dynamic model were combined to predict the cutaneous neural dynamics and the resulting perception during a discrimination test. Using in-vivo microneurography generated single afferent recordings, 75% of the data was applied for the model optimization and another 25% was used for validation. By using this integrated numerical model, the predicted tactile neural signals of the single afferent fibers agreed well with the microneurography test results, achieving the out-of-sample values of 0.94 and 0.82 for slowly adapting type I (SAI) and fast adapting type I unit (FAI) respectively. Similar discriminating capability with the human subject was achieved based on this computational model. Comparable performance with the published numerical model on predicting the cutaneous neural response under passive stimuli was also presented, ensuring the potential applicability of this multi-level numerical model in studying the human tactile sensing mechanisms during active touch. The predicted population-level 1st order afferent neural signals under active touch suggest that different coding strategies might be applied to the afferent neural signals elicited from different cutaneous neurons simultaneously.

[Diagnostic statistics from neurological clinics during 1953].

Somatotopic Reorganization of Hand Representation in Bilateral Arm Amputees with or Without Special Foot Movement Skill.

Extending tactile space with hand-held tools: A re-analysis and review

Intrinsic Horizontal Connections Process Global Tactile Features in the Primary Somatosensory Cortex: Neuroanatomical Evidence

Tool use fine-tunes arm and tool maps

α-Lipoic Acid Alters Post-Translational Modifications and Protects the Chaperone Activity of Lens α-Crystallin in Naphthalene-Induced Cataract

Tactile stimulation designs adapted to clinical settings result in reliable fMRI-based somatosensory digit maps

[Neuronal connections within the hand representation in areas 3b and 1 of the somatosensory cortex in primates].

The homunculus for proprioception: Toward learning the representation of a humanoid robot's joint space using self-organizing maps

Body Models in Humans and Robots

NeuralFeels with neural fields: Visuotactile perception for in-hand manipulation.

Eyes and hand are both reliable at localizing somatosensory targets

Vibrotactile information improves proprioceptive reaching target localization

Digit somatotopy within cortical areas of the postcentral gyrus in humans.

Connectivity defines the distinctive anatomy and function of the hand-knob area

Touch Sensors with Overlapping Signals: Concept Investigation on Planar Sensors with Resistive or Optical Transduction

Cortical activations associated with spatial remapping of finger touch using EEG

Unraveling somatotopic organization in the human brain using machine learning and adaptive supervoxel-based parcellations

Neural feels with neural fields: Visuo-tactile perception for in-hand manipulation

Vicarious Somatotopic Maps Tile Visual Cortex

From Skin Mechanics to Tactile Neural Coding: Predicting Afferent Neural Dynamics During Active Touch and Perception