Having Different Dialog Roles in Telecommunication by Using Two Teleoperated Robots Reduces an Operator's Guilt

Reina Nozawa,Kazuki Sakai,Megumi Kawata,Hiroshi Ishiguro,Yuichiro Yoshikawa

DOI: https://doi.org/10.1007/s12369-024-01125-1

IF: 3.802

2024-04-11

International Journal of Social Robotics

Abstract:In recent years, applications of social robots as the operator's avatar have been widely studied for remote conversation with rich nonverbal information. Having another side-participant robot beside the avatar robot of the operator was found to be effective for providing long-lasting backchannels to the interlocutor. The side-participant robot is also expected to play a role in assisting human participation in multiparty conversations. However, such a focus has not been applied to remote conversations with multiple robots. Here, we propose a multiple-robot telecommunication system with which the operator can use a side-participant robot to assist conversation that is developed by the operator through the main speaker robot to verify its effectiveness. In the laboratory experiment where the subjects were made to feel stressed by being forced to provide rude questions to the interlocutor, the proposed system was shown to reduce guilt and to improve the overall mood of operators. The result encourages the application of a multi robot remote conversation system to allow the user to participate in remote conversations with less anxiety of potential failure in maintaining the conversation.

robotics

What problem does this paper attempt to address?

This paper attempts to address the issue of how to reduce the operator's guilt and improve their overall mood during remote conversations by using two teleoperated robots. Specifically, the paper proposes a multi-robot remote communication system where one robot acts as the main speaker to convey the operator's voice, and the other robot acts as an auxiliary participant to assist in the conversation. Experimental results show that this system can reduce the operator's negative emotions during conversations that may induce guilt or stress.

### Background and Motivation
1. **Limitations of Remote Communication**:
- Traditional remote communication devices (such as telephones and video conferencing systems) cannot fully convey non-verbal information, thereby affecting social presence.
- The lack of social presence reduces the willingness to continue the conversation and social coherence.

2. **Using Robots as Communication Media**:
- Some studies suggest that using robots as communication media can transmit non-verbal information and allow the operator to share physical space with the interlocutor through the robot's body.
- However, operators find it difficult to quickly and accurately control the robot to convey the required non-verbal information.

3. **Potential Advantages of Multi-Robot Systems**:
- Introducing multiple robots can reduce the interference between actions generated by the operator and the system.
- Auxiliary robots can play an active role in the conversation, helping the operator to better engage in the dialogue.

### Research Objectives
- **Reduce Operator's Guilt and Stress**: By using two teleoperated robots, one as the main speaker and the other as an auxiliary participant, to reduce the operator's negative emotions during conversations that may induce guilt or stress.
- **Improve Operator's Mood**: To verify whether the system can improve the operator's overall mood during the conversation.

### Methods
- **System Configuration**:
- The operator can control two robots simultaneously through voice and buttons, one for conveying voice and the other for assisting in the conversation.
- The system includes modules such as voice recognition, speech recommendation, and multi-robot controllers to coordinate the behavior of the two robots.

- **Experimental Design**:
- Subjects engage in conversations under two conditions: one with an auxiliary robot and one without an auxiliary robot.
- The conversations include some questions that may induce guilt or stress to verify the system's effectiveness.

### Results
- **Reduce Guilt and Stress**: Experimental results show that the system with the auxiliary robot can significantly reduce the operator's guilt and stress.
- **Improve Mood**: The operator's overall mood improved under the condition with the auxiliary robot.

### Conclusion
- This study encourages the application of multi-robot remote conversation systems in real scenarios to help users reduce anxiety and improve conversation quality during remote dialogues.