Abstract:BACKGROUND: Neurorehabilitation therapies exploiting the use-dependent plasticity of our neuromuscular system are devised to help patients who suffer from injuries or diseases of this system. These therapies take advantage of the fact that the motor activity alters the properties of our neurons and muscles, including the pattern of their connectivity, and thus their functionality. Hence, a sensor-motor treatment where patients makes certain movements will help them (re)learn how to move the affected body parts. But these traditional rehabilitation processes are usually repetitive and lengthy, reducing motivation and adherence to the treatment, and thus limiting the benefits for the patients.OBJECTIVE: Our goal was to create innovative neurorehabilitation therapies based on THERAPIST, a socially assistive robot. THERAPIST is an autonomous robot that is able to find and execute plans and adapt them to new situations in real-time. The software architecture of THERAPIST monitors and determines the course of action, learns from previous experiences, and interacts with people using verbal and non-verbal channels. THERAPIST can increase the adherence of the patient to the sessions using serious games. Data are recorded and can be used to tailor patient sessions.METHODS: We hypothesized that pediatric patients would engage better in a therapeutic non-physical interaction with a robot, facilitating the design of new therapies to improve patient motivation. We propose RoboCog, a novel cognitive architecture. This architecture will enhance the effectiveness and time-of-response of complex multi-degree-of-freedom robots designed to collaborate with humans, combining two core elements: a deep and hybrid representation of the current state, own, and observed; and a set of task-dependent planners, working at different levels of abstraction but connected to this central representation through a common interface. Using RoboCog, THERAPIST engages the human partner in an active interactive process. But RoboCog also endows the robot with abilities for high-level planning, monitoring, and learning. Thus, THERAPIST engages the patient through different games or activities, and adapts the session to each individual.RESULTS: RoboCog successfully integrates a deliberative planner with a set of modules working at situational or sensorimotor levels. This architecture also allows THERAPIST to deliver responses at a human rate. The synchronization of the multiple interaction modalities results from a unique scene representation or model. THERAPIST is now a socially interactive robot that, instead of reproducing the phrases or gestures that the developers decide, maintains a dialogue and autonomously generate gestures or expressions. THERAPIST is able to play simple games with human partners, which requires humans to perform certain movements, and also to capture the human motion, for later analysis by clinic specialists.CONCLUSIONS: The initial hypothesis was validated by our experimental studies showing that interaction with the robot results in highly attentive and collaborative attitudes in pediatric patients. We also verified that RoboCog allows the robot to interact with patients at human rates. However, there remain many issues to overcome. The development of novel hands-off rehabilitation therapies will require the intersection of multiple challenging directions of research that we are currently exploring.

Geodesic restricted aruco-based positioning for VR rehabilitation robotics

Upper limb posture estimation in robotic and virtual reality-based rehabilitation

An Approach to Physical Rehabilitation Using State-of-the-art Virtual Reality and Motion Tracking Technologies

Development of a Human–Robot Interface for Cobot Trajectory Planning Using Mixed Reality

Evaluating Visual-Spatiotemporal Co-Registration of a Physics-Based Virtual Reality Haptic Interface

Flexible Virtual Reality System for Neurorehabilitation and Quality of Life Improvement

Immersive Virtual Reality and Robotics for Upper Extremity Rehabilitation

Virtual reality system in conjunction with neurorobotics and neuroprosthetics for rehabilitation of motor disorders

THERAPIST: Towards an Autonomous Socially Interactive Robot for Motor and Neurorehabilitation Therapies for Children

A Mixed-Reality Tele-Operation Method for High-Level Control of a Legged-Manipulator Robot

Game Scene Construction for Lower Limb Rehabilitation Robot Based on Virtual Reality

Rehabilitation of Patients with Arthrogenic Muscular Inhibition in Pathologies of Knee Using Virtual Reality

Joint Scene and Object Tracking for Cost-Effective Augmented Reality Assisted Patient Positioning in Radiation Therapy

Mixed-reality for quadruped-robotic guidance in SAR tasks

Virtual Reality Platform to Develop and Test Applications on Human-Robot Social Interaction

Industrial robot control and operator training using virtual reality interfaces

Connected Elbow Exoskeleton System for Rehabilitation Training Based on Virtual Reality and Context-Aware

A co-design approach for a rehabilitation robot coach for physical rehabilitation based on the error classification of motion errors

Reflective-AR Display: An Interaction Methodology for Virtual-Real Alignment in Medical Robotics

Virtual Hand Training Platform Controlled Through Online Recognition of Motion Intention

Robot-Assisted Rehabilitation Architecture Supported by a Distributed Data Acquisition System