Abstract:Functional magnetic resonance imaging (fMRI) provides excellent functional brain imaging via the BOLD signal with advantages including non-ionizing radiation, millimeter spatial accuracy of anatomical and functional data, and nearly real-time analyses. Haptic robots provide precise measurement and control of position and force of a cursor in a reasonably confined space. Here we combine these two technologies to allow precision experiments involving motor control with haptic/tactile environment interaction such as reaching or grasping. The basic idea is to attach an 8 foot end effecter supported in the center to the robot allowing the subject to use the robot, but shielding it and keeping it out of the most extreme part of the magnetic field from the fMRI machine (Figure 1). The Phantom Premium 3.0, 6DoF, high-force robot (SensAble Technologies, Inc.) is an excellent choice for providing force-feedback in virtual reality experiments, but it is inherently non-MR safe, introduces significant noise to the sensitive fMRI equipment, and its electric motors may be affected by the fMRI's strongly varying magnetic field. We have constructed a table and shielding system that allows the robot to be safely introduced into the fMRI environment and limits both the degradation of the fMRI signal by the electrically noisy motors and the degradation of the electric motor performance by the strongly varying magnetic field of the fMRI. With the shield, the signal to noise ratio (SNR: mean signal/noise standard deviation) of the fMRI goes from a baseline of ~380 to ~330, and ~250 without the shielding. The remaining noise appears to be uncorrelated and does not add artifacts to the fMRI of a test sphere (Figure 2). The long, stiff handle allows placement of the robot out of range of the most strongly varying parts of the magnetic field so there is no significant effect of the fMRI on the robot. The effect of the handle on the robot's kinematics is minimal since it is lightweight (~2.6 lbs) but extremely stiff 3/4" graphite and well balanced on the 3DoF joint in the middle. The end result is an fMRI compatible, haptic system with about 1 cubic foot of working space, and, when combined with virtual reality, it allows for a new set of experiments to be performed in the fMRI environment including naturalistic reaching, passive displacement of the limb and haptic perception, adaptation learning in varying force fields, or texture identification.

Haptic fMRI: Reliability and performance of electromagnetic haptic interfaces for motion and force neuroimaging experiments

Evaluation of Non-Collocated Force Feedback Driven by Signal-Independent Noise

Adaptation of a haptic robot in a 3T fMRI

Introducing Haptic Feedback in Real-Time fMRI Neurofeedback: A Novel Approach to Modulate Primary Motor Cortex Activity

Functional conductivity imaging: quantitative mapping of brain activity

Challenges in developing a magnetic resonance-compatible haptic hand-controller for neurosurgical training

Haptic Stimulation for Improving Training of a Motor Imagery BCI Developed for a Hand-Exoskeleton in Rehabilitation

High-resolution awake mouse fMRI at 14 Tesla

Haptics in Teleoperated Medical Interventions: Force Measurement, Haptic Interfaces and Their Influence on User's Performance

Enhancing fNIRS Analysis Using EEG Rhythmic Signatures: An EEG-Informed fNIRS Analysis Study

A 3D-Printed Soft Haptic Device with Built-in Force Sensing Delivering Bio-Mimicked Feedback

Real-time fMRI for brain-computer interfacing

CNNATT: Deep EEG & fNIRS Real-Time Decoding of bimanual forces

MRI-compatible and sensorless haptic feedback for cable-driven medical robotics to perform teleoperated needle-based interventions

Unleashing the potential of fNIRS with machine learning: classification of fine anatomical movements to empower future brain-computer interface

Towards machine to brain interfaces: sensory stimulation enhances sensorimotor dynamic functional connectivity in upper limb amputees

Force-Aware Interface via Electromyography for Natural VR/AR Interaction

Evaluating Force-based Haptics for Immersive Tangible Interactions with Surface Visualizations

Exploring the Non-Invasive Methods of Brain- Computer Interface: A Comprehensive Review of their Advances and Applications

Differential Hemodynamic Responses to Motor and Tactile Imagery: Insights from Multichannel fNIRS Mapping