Abstract:On the one hand, speech is a key aspect to people's communication. On the other, it is widely acknowledged that language proficiency is related to intelligence. Therefore, intelligent robots should be able to understand, at least, people's orders within their application domain. These insights are not new in RoboCup@Home, but we lack of a long-term plan to evaluate this approach. In this paper we conduct a brief review of the achievements on automated speech recognition and natural language understanding in RoboCup@Home. Furthermore, we discuss main challenges to tackle in spoken human-robot interaction within the scope of this competition. Finally, we contribute by presenting a pipelined road map to engender research in the area of natural language understanding applied to domestic service robotics.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to achieve natural language interaction between robots and humans in the RoboCup@Home competition. Specifically, the paper focuses on the following aspects: 1. **Evaluation of natural language understanding**: In the RoboCup@Home competition, although the importance of natural language interaction is widely recognized, there is a lack of long - term evaluation plans in this area. The paper aims to propose a systematic evaluation method to promote the development of natural language processing technology. 2. **Technical challenges in speech recognition and natural language understanding**: The paper reviews the progress in automatic speech recognition (ASR) and natural language understanding (NLU) in the RoboCup@Home competition over the past nine years and points out the main challenges faced by current technologies, such as recognition in noisy environments, the diversity of non - native speakers, and the use of command generators. 3. **Naturalness of human - robot interaction**: The paper emphasizes that current interaction methods mostly rely on simple commands and lack truly natural conversations. To improve the naturalness of interaction, the paper proposes a phased roadmap to gradually introduce more complex and natural conversation scenarios. 4. **Creation of data sets**: To support research and development, the paper suggests creating a large - scale annotated data set containing interaction records between untrained and unbiased operators and robots. This will help improve the robustness and generalization ability of natural language processing algorithms. ### Main contributions of the paper - **Historical review**: A detailed review of the development of the RoboCup@Home competition over the past nine years, especially the progress in ASR and NLU technologies. - **Challenge analysis**: An in - depth analysis of the challenges faced by current technologies, including noisy environments, operator diversity, and limitations of command generators. - **Roadmap**: Proposes a phased roadmap to gradually achieve the transition from simple commands to complex natural conversations. - **Data set creation**: Suggests collecting a large amount of natural conversation data through competitions to support research and development. ### Key stages of the roadmap 1. **From commands to goal expressions**: - **In 2019**: The operator reads out the generated commands. - **In 2020**: The operator tries to remember the commands and repeat them to the robot, allowing slight variations. - **In 2022**: The referee explains the task to the operator, and the operator rephrases it in their own words. - **In 2024**: The operator asks the robot to complete the task, but not necessarily in imperative language. - **In 2028**: The operator tries to explain the goal to the robot instead of specific action steps. 2. **Dialogue - based interaction**: - **In 2032**: After receiving a set of examples, the operator guides the robot to perform similar behaviors. - **In 2036**: After receiving a topic and examples, the operator requests the robot to complete tasks of similar difficulty without providing specific commands. 3. **Unconstrained interaction**: - **In 2040**: The operator explains to the robot how to complete a completely new task and states the expected results. - **In 2044**: The operator can freely request the robot to do anything within its capabilities, and all planning is done by the robot. Through these stages, the paper aims to promote research and technological progress in human - machine natural language interaction in the RoboCup@Home competition.

From Commands to Goal-based Dialogs: A Roadmap to Achieve Natural Language Interaction in RoboCup@Home

Design of a speech interaction system for man-machine confrontation

Design of Kinect-Based Human Robot Interaction Systems for A Robocup Middle Size League Soccer Robot

Coordination and Machine Learning in Multi-Robot Systems: Applications in Robotic Soccer

RoboCup@Home: Summarizing achievements in over eleven years of competition

Interaction and Autonomy in RoboCup@Home and Building-Wide Intelligence

The human in the loop Perspectives and challenges for RoboCup 2050

The RobotSlang Benchmark: Dialog-guided Robot Localization and Navigation

Real-Time Multimodal Signal Processing for HRI in RoboCup: Understanding a Human Referee

Developing high-level cognitive functions for service robots

Conversational Language Models for Human-in-the-Loop Multi-Robot Coordination

Language Understanding for Field and Service Robots in a Priori Unknown Environments

Natural Language Understanding for Navigation of Service Robots in Low-Resource Domains and Languages: Scenarios in Spanish and Nahuatl

Current and Future Challenges in Humanoid Robotics -- An Empirical Investigation

Spoken language interaction with robots: Recommendations for future research

KeJia Project : Towards Integrated Intelligence for Service Robots

Natural Language for Human-Robot Collaboration: Problems Beyond Language Grounding

The Conversation is the Command: Interacting with Real-World Autonomous Robot Through Natural Language

Collaborative Effort Towards Common Ground in Situated Human-Robot Dialogue.

A service robot architecture supporting individualized coordination

Dialogue with Robots: Proposals for Broadening Participation and Research in the SLIVAR Community