Abstract:Abstract Human-centered computing is rapidly becoming a major research direction as new developments in sensor technology make it increasingly feasible to obtain signals from human beings. At the same time, the pervasiveness of computing devices is also encouraging more research in human–computer interaction, especially in the direction of personalized and adaptive user interfaces. Among the various research issues, affective computing, or the ability of computers to understand and react according to what a user “feels,” has been gaining in importance. In order to recognize the human affect (feeling), computers rely on the analysis of signal inputs captured by a multitude of means. This paper proposes the use of human physiological signals as a new form of modality in determining human affects, in a non-intrusive manner. The principle of non-invasiveness is very important, since it imposes no extra burden on the user, which improves user accessibility and encourages user adoption. This goal is realized via the physiological mouse, as a first step toward the support of affective computing. The conventional mouse is converted with a small optical component for capturing user photoplethysmographic (PPG) signal. With the PPG signal, it is possible to compute and derive human physiological signals. A prototype of the physiological mouse was built and raw PPG readings measured. The accuracy of the approach was evaluated through empirical studies to determine human physiological signals from the mouse PPG data. Finally, pilot experiments to correlate human physiological signals with various modes of human–computer interaction, namely gaming and video watching, were conducted. The trend in physiological signals could be used as feedback to the computer system which in turn adapts to the needs or the mood of the user, for instance change the volume and the light intensity when watching a video or playing a game based on current user emotion. The authors argue that this research will provide a new dimension for multimodal affective computing research, and the pilot study has already shed some light toward this research goal.

Show me How You Use Your Mouse and I Tell You How You Feel? Sensing Affect with the Computer Mouse

Physiological mouse: toward an emotion-aware mouse

Wandering minds, wandering mice: Computer mouse tracking as a method to detect mind wandering

Reading Personality Preferences from Motion Patterns in Computer Mouse Operations

Design factors in mouse-tracking: What makes a difference?

Is your mouse attracted by your eyes: Non-intrusive stress detection in off-the-shelf desktop environments

Feature analysis of mouse dynamics in identity authentication and monitoring

Measuring Network User Trust Via Mouse Behavior Characteristics under Different Emotions

Predicting respondent difficulty in web surveys: A machine-learning approach based on mouse movement features

Poster: Can It Be More Practical? Improving Mouse Dynamics Biometric Performance

Mouse Dynamics Behavioral Biometrics: A Survey

Machine Learning in Modeling of Mouse Behavior

A New Concept of Product Design by Involving Emotional Factors using EEG: A Case Study of Computer Mouse Design

A smart computer mouse with biometric sensors for unobtrusive office work-related stress monitoring

Computer Mouse Use Captures Ataxia and Parkinsonism, Enabling Accurate Measurement and Detection

Multimodal human attention detection for reading from facial expression, eye gaze, and mouse dynamics

User Authentication Through Mouse Dynamics

An Evaluation of the Fun Factor for the Microsoft Easyball Mouse

Optimal Sensor Position for a Computer Mouse

Identification of Trusted Interactive Behavior Based on Mouse Behavior Considering Web User's Emotions

Modeling user preferences in online stores based on user mouse behavior on page elements