Relaxed or Tense? Mutual Biosignal Transmission with Heartbeat Vibrations during Online Gameplay

Yoshiki Mori,Sohta Takada,Masayuki Kajiura,Modar Suleiman Hassan,Taku Hachisu

2024-11-08

Abstract:Esports offers a platform for players to engage in competitive and cooperative gaming with others remotely via the Internet. Despite these opportunities for social interaction, many players may still experience loneliness while playing online games. This study aims to enhance the social presence of partner players during online gameplay. The demonstration system, designed for 1-on-1 online competitive games, mutually transmits the partner's biosignals, through heartbeat-like vibrotactile stimuli. The system generates vibrotactile signals that represent two-dimensional emotions, arousal and valence, based on biosignals such as heart rate and electrodermal activity.

Human-Computer Interaction

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: In esports, although players can remotely participate in competitive and cooperative games via the Internet, many players still feel lonely when playing online games. This sense of loneliness may stem from the lack of strong social connections and direct physical interactions, especially when players are anonymous or have temporary relationships.

To solve this problem, this research aims to enhance the social presence among partners during the online gaming process through a new system. Specifically, this system is designed for one - on - one online competitive games and transmits each other's biological signals (such as heart rate and skin electrical activity) in the form of heartbeat vibrations. These vibration signals represent two - dimensional emotions (arousal and valence), thus helping players better perceive each other's emotional states and enhancing social interactions between them.

### System Overview

The main components of this system include:
- **Smart Watch**: Used to measure heart rate (HR) and skin electrical activity (EDA) in real - time.
- **Smartphone**: Downloads the other party's HR and EDA data from the cloud database and generates corresponding audio signals.
- **Wristband Device**: Receives audio signals and generates heartbeat vibrations through a vibrator.
- **Host Computer**: Runs software to visualize the remote player's HR and EDA values and displays them on the player's game screen.

### Vibration Signal Generation Formula

The vibration signal \( V(t') \) consists of two parts, which respectively simulate the first heart sound (S1) and the second heart sound (S2):

\[
V(t') = V_1(t') + V_2(t')
\]

where:

\[
V_1(t') = A\exp(-Bt')\sin(2\pi ft')
\]

\[
V_2(t') =
\begin{cases}
0 & \text{if } t' \geq \varphi \\
C V_1(t' - \varphi) & \text{if } 0 < t' < \varphi
\end{cases}
\]

\[
t' = t - 60H\left\lfloor\frac{t}{60/H}\right\rfloor
\]

Parameter Explanation:
- \( A \): Initial amplitude
- \( B \): Decay rate
- \( C \): Amplitude ratio between S1 and S2
- \( \varphi \): Asynchronous time between S1 and S2
- \( H \): Heart rate (unit: times/minute)
- \( f \): Frequency (unit: Hertz)

Preliminary tests show that increasing heart rate \( H \) and frequency \( f \) can increase arousal and decrease valence.

### Experimental Process

Participants wear smart watches and wristband devices and experience each other's heartbeat vibrations while playing games. The experiment is divided into multiple 3 - minute sessions. In each session, participants can feel vibration signals in different emotional states, such as drowsiness, pleasure, and anger.

In this way, this research hopes to enhance social interactions and emotional exchanges between players without relying on video calls, thereby reducing the sense of loneliness in online games.