Abstract:Humans are skillful at manipulating objects that possess nonlinear underactuated dynamics, such as clothes or containers filled with liquids. Several studies suggested that humans implement a predictive model-based strategy to control such objects. However, these studies only considered unconstrained reaching without any object involved or, at most, linear mass-spring systems with relatively simple dynamics. It is not clear what internal model humans develop of more complex objects, and what level of granularity is represented. To answer these questions, this study examined a task where participants physically interacted with a nonlinear underactuated system mimicking a cup of sloshing coffee: a cup with a ball rolling inside. The cup and ball were simulated in a virtual environment and subjects interacted with the system via a haptic robotic interface. Participants were instructed to move the system and arrive at a target region with both cup and ball at rest, 'zeroing out' residual oscillations of the ball. This challenging task affords a solution known as 'input shaping', whereby a series of pulses moves the dynamic object to the target leaving no residual oscillations. Since the timing and amplitude of these pulses depend on the controller's internal model of the object, input shaping served as a tool to identify the subjects' internal representation of the cup-and-ball. Five simulations with different internal models were compared against the human data. Results showed that the features in the data were correctly predicted by a simple internal model that represented the cup-and-ball as a single rigid mass coupled to the hand impedance. These findings provide evidence that humans use simplified internal models along with mechanical impedance to manipulate complex objects. In their daily life, humans interact with objects that possess complex dynamics. Some examples include picking up containers filled with liquids, tying shoelaces, and folding laundry. To allow for dexterous interactions with these objects, we hypothesized that the brain develops an internal representation of their dynamics. But what form does this representation take? Is it a detailed representation or an approximate one? To answer these questions, we had subjects interact with a simplified cup of coffee in a virtual environment: a 2D cup moving on a horizontal line, and with a ball rolling inside. Subjects were instructed to move the cup from a start position and quickly arrive at a target position, with both the cup and ball completely stopped, i.e., the ball should not be rolling once the cup reaches the target position. The manner by which subjects moved the cup-and-ball prior to arriving at the target location allowed us to infer what internal representation subjects developed of the system's dynamics. Experimental and modeling results showed that subjects developed a simple and approximate representation of the system's dynamics rather than a complex and detailed one.

A Model-Based Approach to Analysis and Calibration of Sensor-Based Human Interaction Loops

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

Beyond End-Effector: Utilizing High-Resolution Tactile Signals for Physical Human–Robot Interaction

Learning-model-based Control for Robot Manipulators Sensorless Kinesthetic Teaching Using Sparse Feature Dynamics

A human-aware control paradigm for human-robot interactions, a simulation study

Controller–observer design and dynamic parameter identification for model-based control of an electromechanical lower-limb rehabilitation system

Gesture-Based Interactions: Integrating Accelerometer and Gyroscope Sensors in the Use of Mobile Apps

Natural Human–Robot Interface Using Adaptive Tracking System with the Unscented Kalman Filter

On Model Adaptation for Sensorimotor Control of Robots

Sensorless Human-Robot Interaction: Real-Time Estimation of Co-Grasped Object Mass and Human Wrench for Compliant Interaction

An Overview of Software Sensor Applications in Biosystem Monitoring and Control

Human-Variability-Respecting Optimal Control for Physical Human-Machine Interaction

A Lyapunov-Stable Adaptive Method to Approximate Sensorimotor Models for Sensor-Based Control

Bayesian Integration And Non-Linear Feedback Control In A Full-Body Motor Task

A Model Predictive Approach for Online Mobile Manipulation of Nonholonomic Objects using Learned Dynamics

A Wearable-Based and Markerless Human-Manipulator Interface with Feedback Mechanism and Kalman Filters

Analyzing Human Models that Adapt Online

On human-in-the-loop optimization of human–robot interaction

Automated Controller Calibration by Kalman Filtering

Learning body models: from humans to humanoids

Simplified internal models in human control of complex objects