Proceedings of the Dialogue Robot Competition 2022

Ryuichiro Higashinaka,Takashi Minato,Hiromitsu Nishizaki,Takayuki Nagai

DOI: https://doi.org/10.48550/arXiv.2210.12034

2022-10-26

Abstract:The proceedings contain papers on the dialogue systems developed by the twelve teams participating in DRC2022, as well as an overview paper summarizing the competition.

Robotics

What problem does this paper attempt to address?

Proceedings of the Dialogue Robot Competition 2023

Ryuichiro Higashinaka,Takashi Minato,Hiromitsu Nishizaki,Takayuki Nagai

DOI: https://doi.org/10.48550/arXiv.2312.14430

IF: 3.7

2023-12-22

Robotics

Abstract:The Dialogic Robot Competition 2023 (DRC2023) is a competition for humanoid robots (android robots that closely resemble humans) to compete in interactive capabilities. This is the third year of the competition. The top four teams from the preliminary competition held in November 2023 will compete in the final competition on Saturday, December 23. The task for the interactive robots is to recommend a tourism plan for a specific region. The robots can employ multimodal behaviors, such as language and gestures, to engage the user in the sightseeing plan they recommend. In the preliminary round, the interactive robots were stationed in a travel agency office, where visitors conversed with them and rated their performance via a questionnaire. In the final round, dialogue researchers and tourism industry professionals interacted with the robots and evaluated their performance. This event allows visitors to gain insights into the types of dialogue services that future dialogue robots should offer. The proceedings include papers on dialogue systems developed by the 12 teams participating in DRC2023, as well as an overview of the papers provided by all the teams.
Overview of Dialogue Robot Competition 2022

Takashi Minato,Ryuichiro Higashinaka,Kurima Sakai,Tomo Funayama,Hiromitsu Nishizaki,Takayuki Nagai

DOI: https://doi.org/10.48550/arXiv.2210.12863

2022-10-24

Abstract:Although many competitions have been held on dialogue systems in the past, no competition has been organized specifically for dialogue with humanoid robots. As the first such attempt in the world, we held a dialogue robot competition in 2020 to compare the performances of interactive robots using an android that closely resembles a human. Dialogue Robot Competition 2022 (DRC2022) was the second competition, held in August 2022. The task and regulations followed those of the first competition, while the evaluation method was improved and the event was internationalized. The competition has two rounds, a preliminary round and the final round. In the preliminary round, twelve participating teams competed in performance of a dialogue robot in the manner of a field experiment, and then three of those teams were selected as finalists. The final round will be held on October 25, 2022, in the Robot Competition session of IROS2022. This paper provides an overview of the task settings and evaluation method of DRC2022 and the results of the preliminary round.

Robotics,Human-Computer Interaction
Overview of Dialogue Robot Competition 2023

Takashi Minato,Ryuichiro Higashinaka,Kurima Sakai,Tomo Funayama,Hiromitsu Nishizaki,Takayuki Naga

2024-01-08

Abstract:We have held dialogue robot competitions in 2020 and 2022 to compare the performances of interactive robots using an android that closely resembles a human. In 2023, the third competition DRC2023 was held. The task of DRC2023 was designed to be more challenging than the previous travel agent dialogue tasks. Since anyone can now develop a dialogue system using LLMs, the participating teams are required to develop a system that effectively uses information about the situation on the spot (real-time information), which is not handled by ChatGPT and other systems. DRC2023 has two rounds, a preliminary round and the final round as well as the previous competitions. The preliminary round has held on Oct.27 -- Nov.20, 2023 at real travel agency stores. The final round will be held on December 23, 2023. This paper provides an overview of the task settings and evaluation method of DRC2023 and the preliminary round results.

Robotics,Human-Computer Interaction
ditlab system for Dialogue Robot Competition 2022

Yuuki Tachioka

DOI: https://doi.org/10.48550/arXiv.2210.06646

2022-10-13

Abstract:We developed a dialogue system for Dialogue Robot Competition 2022. Our system is composed of three parts. First part investigates participants' demographic information by rule-based interview. Second part recommends a point of interest (POI) based on the collected demographic information. Third part answers participants' question based on the combination of rule-based answering and deep-learning-based answering with nearby POI search.

Robotics,Human-Computer Interaction
RoboCup 2013: Robot World Cup XVII

Sven Behnke,Manuela M. Veloso,Arnoud Visser,Rong Xiong

2014-01-01

Abstract:This book includes the thoroughly refereed post-conference proceedings of the 17th Annual RoboCup International Symposium, held in Eindhoven, The Netherlands, in June 2013. The 20 revised papers presented together with 11 champion team papers, 3 best paper awards, 11 oral presentations, and 19 special track on open-source hard- and software papers were carefully reviewed and selected from 78 submissions. The papers present current research and educational activities within the fields of robotics and artificial intelligence with a special focus to robot hardware and software, perception and action, robotic cognition and learning, multi-robot systems, human-robot interaction, education and edutainment, and applications.
Team OS's System for Dialogue Robot Competition 2022

Yuki Kubo,Ryo Yanagimoto,Hayato Futase,Mikio Nakano,Zhaojie Luo,Kazunori Komatani

DOI: https://doi.org/10.48550/arXiv.2210.09928

IF: 6.4588

2022-10-18

Human-Computer Interaction

Abstract:This paper describes our dialogue robot system, OSbot, developed for Dialogue Robot Competition 2022. The dialogue flow is based on state transitions described manually and the transition conditions use the results of keyword extraction and sentiment analysis. The transitions can be easily viewed and edited by managing them on a spreadsheet. The keyword extraction is based on named entity extraction and our predefined keyword set. The sentiment analysis is text-based and uses SVM, which was trained with the multimodal dialogue corpus Hazumi. We quickly checked and edited a dialogue flow by using a logging function. In the competition's preliminary round, our system ended up in third place.
Special issue on multimodal processing and robotics for dialogue systems (Part II)

David Traum,Gabriel Skantze,Hiromitsu Nishizaki,Ryuichiro Higashinaka,Takashi Minato,Takayuki Nagai

DOI: https://doi.org/10.1080/01691864.2024.2319945

IF: 2.057

2024-03-20

Advanced Robotics

Abstract:The proliferation of devices like Google Home and Amazon Alexa is ongoing, yet the realization of human-like interactions remains unachieved. In particular, dialogue robots and multimodal dialogue systems, which must consider multimodal information and the surrounding environment, require further technological advancements. Towards such advancements, dialogue robot competitions and dialogue system live competitions have been conducted in recent years. Unlike previous dialogue systems that rely solely on verbal language, systems that express through facial expressions and gestures, grounded in the real world, hold the potential to significantly transform society in the future. This special issue is devoted to the progress of such dialogue robots and multimodal dialogue systems.

robotics
Team Irisapu Project Description for DRC2023

Reon Ohashi,Shinjitsu Agatsuma,Kazuya Tsubokura,Yurie Iribe

2023-12-21

Abstract:This paper describes the dialog robot system designed by Team Irisapu for the preliminary round of the Dialogue Robot Competition 2023 (DRC2023). In order to generate dialogue responses flexibly while adhering to predetermined scenarios, we attempted to generate dialogue response sentences using OpenAI's GPT-3. We aimed to create a system that can appropriately respond to users by dividing the dialogue scenario into five sub-scenarios, and creating prompts for each sub-scenario. Also, we incorporated a recovery strategy that can handle dialogue breakdowns flexibly. Our research group has been working on research related to dialogue breakdown detection, and we incorporated our findings to date in this competition. As a result of the preliminary round, a bug in our system affected the outcome and we were not able to achieve a satisfactory result. However, in the evaluation category of "reliability of provided information", we ranked third among all teams.

Robotics,Artificial Intelligence
Hospitable Travel Agent Dialogue Robot: Team Irisapu Project Description for DRC2022

Kazuya Tsubokura,Fumiya Kishi,Kotomi Narita,Takuya Takeda,Yurie Iribe

DOI: https://doi.org/10.48550/arXiv.2210.09790

2022-10-18

Abstract:This paper describes the dialog robot system designed by Team Irisapu for the preliminary round of the Dialogue Robot Competition 2022 (DRC2022). Our objective was to design a hospitable travel agent robot. The system we developed was ranked 8th out of 13 systems in the preliminary round of the competition, but our robot received high marks for its naturalness and <a class="link-external link-http" href="http://likeability.Our" rel="external noopener nofollow">this http URL</a> next challenge is to create a system that can provide more useful information to users.

Robotics,Human-Computer Interaction
Dialogue System of Team NTT-EASE for DRC2023

Yuki Kubo,Tomoya Yamashita,Masanori Yamada

2023-12-21

Abstract:We developed a dialogue system as a team NTT-EASE in the Dialogue Robot Competition 2023 (DRC2023). We introduce a dialogue system (EASE-DRCBot) constructed for DRC2023. EASE-DRCBot incorporates a manually defined dialogue flow. The conditions for system utterances are based on keyword extraction, example-based method, and sentiment analysis. For answering a user's question, EASE-DRCBot utilizes GPT-3.5 to generate responses. We analyze the results of the preliminary round and explain future works.

Human-Computer Interaction
User-adaptive Tourist Information Dialogue System with Yes/No Classifier and Sentiment Estimator

Ryo Yanagimoto,Yunosuke Kubo,Miki Oshio,Mikio Nakano,Kenta Yamamoto,Kazunori Komatani

DOI: https://doi.org/10.48550/arXiv.2312.13787

2023-12-21

Abstract:We introduce our system developed for Dialogue Robot Competition 2023 (DRC2023). First, rule-based utterance selection and utterance generation using a large language model (LLM) are combined. We ensure the quality of system utterances while also being able to respond to unexpected user utterances. Second, dialogue flow is controlled by considering the results of the BERT-based yes/no classifier and sentiment estimator. These allow the system to adapt state transitions and sightseeing plans to the user.

Human-Computer Interaction
Enhancing Consistency in Multimodal Dialogue System Using LLM with Dialogue Scenario

Hiroki Onozeki,Zhiyang Qi,Kazuma Akiyama,Ryutaro Asahara,Takumasa Kaneko,Michimasa Inaba

2023-12-20

Abstract:This paper describes our dialogue system submitted to Dialogue Robot Competition 2023. The system's task is to help a user at a travel agency decide on a plan for visiting two sightseeing spots in Kyoto City that satisfy the user. Our dialogue system is flexible and stable and responds to user requirements by controlling dialogue flow according to dialogue scenarios. We also improved user satisfaction by introducing motion and speech control based on system utterances and user situations. In the preliminary round, our system was ranked fifth in the impression evaluation and sixth in the plan evaluation among all 12 teams.

Computation and Language
Team Flow at DRC2022: Pipeline System for Travel Destination Recommendation Task in Spoken Dialogue

Ryu Hirai,Atsumoto Ohashi,Ao Guo,Hideki Shiroma,Xulin Zhou,Yukihiko Tone,Shinya Iizuka,Ryuichiro Higashinaka

DOI: https://doi.org/10.48550/arXiv.2210.09518

2022-10-18

Computation and Language

Abstract:To improve the interactive capabilities of a dialogue system, e.g., to adapt to different customers, the Dialogue Robot Competition (DRC2022) was held. As one of the teams, we built a dialogue system with a pipeline structure containing four modules. The natural language understanding (NLU) and natural language generation (NLG) modules were GPT-2 based models, and the dialogue state tracking (DST) and policy modules were designed on the basis of hand-crafted rules. After the preliminary round of the competition, we found that the low variation in training examples for the NLU and failed recommendation due to the policy used were probably the main reasons for the limited performance of the system.
Coordination and Machine Learning in Multi-Robot Systems: Applications in Robotic Soccer

Luis Paulo Reis

DOI: https://doi.org/10.48550/arXiv.2312.16273

2023-12-26

Abstract:This paper presents the concepts of Artificial Intelligence, Multi-Agent-Systems, Coordination, Intelligent Robotics and Deep Reinforcement Learning. Emphasis is given on and how AI and DRL, may be efficiently used to create efficient robot skills and coordinated robotic teams, capable of performing very complex actions and tasks, such as playing a game of soccer. The paper also presents the concept of robotic soccer and the vision and structure of the RoboCup initiative with emphasis on the Humanoid Simulation 3D league and the new challenges this competition, poses. The final topics presented at the paper are based on the research developed/coordinated by the author throughout the last 22 years in the context of the FCPortugal project. The paper presents a short description of the coordination methodologies developed, such as: Strategy, Tactics, Formations, Setplays, and Coaching Languages and the use of Machine Learning to optimize the use of this concepts. The topics presented also include novel stochastic search algorithms for black box optimization and their use in the optimization of omnidirectional walking skills, robotic multi-agent learning and the creation of a humanoid kick with controlled distance. Finally, new applications using variations of the Proximal Policy Optimization algorithm and advanced modelling for robot and multi-robot learning are briefly explained with emphasis for our new humanoid sprinting and running skills and an amazing humanoid robot soccer dribbling skill. FCPortugal project enabled us to publish more than 100 papers and win several competitions in different leagues and many scientific awards at RoboCup. In total, our team won more than 40 awards in international competitions including a clear victory at the Simulation 3D League at RoboCup 2022 competition, scoring 84 goals and conceding only 2.

Robotics
Dialogue with Robots: Proposals for Broadening Participation and Research in the SLIVAR Community

Casey Kennington,Malihe Alikhani,Heather Pon-Barry,Katherine Atwell,Yonatan Bisk,Daniel Fried,Felix Gervits,Zhao Han,Mert Inan,Michael Johnston,Raj Korpan,Diane Litman,Matthew Marge,Cynthia Matuszek,Ross Mead,Shiwali Mohan,Raymond Mooney,Natalie Parde,Jivko Sinapov,Angela Stewart,Matthew Stone,Stefanie Tellex,Tom Williams

2024-04-01

Abstract:The ability to interact with machines using natural human language is becoming not just commonplace, but expected. The next step is not just text interfaces, but speech interfaces and not just with computers, but with all machines including robots. In this paper, we chronicle the recent history of this growing field of spoken dialogue with robots and offer the community three proposals, the first focused on education, the second on benchmarks, and the third on the modeling of language when it comes to spoken interaction with robots. The three proposals should act as white papers for any researcher to take and build upon.

Computation and Language,Robotics
Message from the Program Chair: ICoSR 2022

Tao Liu

DOI: https://doi.org/10.1109/icosr57188.2022.00006

2022-01-01

Abstract:We are excited to welcome you to the 2022 International Conference on Service Robotics (ICoSR 2022)! Once again, the ICoSR research community cannot meet in person, because of the COVID-19 pandemic; originally, we planned and hoped for at least a hybrid conference to be hosted in Xishuangbanna, China. In order to create safe, meaningful, and wanted human-robot interactions for people and society, to create new ways of thinking about our future lives with robotic technology, virtual conference is essential. The ICoSR Conference is presenting topquality research and the virtual format might even allow us to attract and include more people who would not have the opportunity to travel to China.
Developing Interactive Tourism Planning: A Dialogue Robot System Powered by a Large Language Model

Katsumasa Yoshikawa,Takato Yamazaki,Masaya Ohagi,Tomoya Mizumoto,Keiya Sato

2023-12-22

Abstract:In recent years, large language models (LLMs) have rapidly proliferated and have been utilized in various tasks, including research in dialogue systems. We aimed to construct a system that not only leverages the flexible conversational abilities of LLMs but also their advanced planning capabilities to reduce the speaking load on human interlocutors and efficiently plan trips. Furthermore, we propose a method that divides the complex task of a travel agency into multiple subtasks, managing each as a separate phase to effectively accomplish the task. Our proposed system confirmed a certain level of success by achieving fourth place in the Dialogue Robot Competition 2023 preliminaries rounds. We report on the challenges identified through the competition.

Computation and Language
Overview of the Tenth Dialog System Technology Challenge: DSTC10

Koichiro Yoshino,Yun-Nung Chen,Paul Crook,Satwik Kottur,Jinchao Li,Behnam Hedayatnia,Seungwhan Moon,Zhengcong Fei,Zekang Li,Jinchao Zhang,Yang Feng,Jie Zhou,Seokhwan Kim,Yang Liu,Di Jin,Alexandros Papangelis,Karthik Gopalakrishnan,Dilek Hakkani-Tur,Babak Damavandi,Alborz Geramifard,Chiori Hori,Ankit Shah,Chen Zhang,Haizhou Li,Joao Sedoc,Luis F. D'Haro,Rafael Banchs,Alexander Rudnicky

DOI: https://doi.org/10.1109/taslp.2023.3293030

2024-01-01

Abstract:This article introduces the Tenth Dialog System Technology Challenge (DSTC-10). This edition of the DSTC focuses on applying end-to-end dialog technologies for five distinct tasks in dialog systems, namely 1. Incorporation of Meme images into open domain dialogs, 2. Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations, 3. Situated Interactive Multimodal dialogs, 4. Reasoning for Audio Visual Scene-Aware Dialog, and 5. Automatic Evaluation and Moderation of Open-domainDialogue Systems. This article describes the task definition, provided datasets, baselines, and evaluation setup for each track. We also summarize the results of the submitted systems to highlight the general trends of the state-of-the-art technologies for the tasks.
Building a hospitable and reliable dialogue system for android robots: a scenario-based approach with large language models

Takato Yamazaki,Katsumasa Yoshikawa,Toshiki Kawamoto,Tomoya Mizumoto,Masaya Ohagi,Toshinori Sato

DOI: https://doi.org/10.1080/01691864.2023.2244554

IF: 2.057

2023-08-24

Advanced Robotics

Abstract:Dialogue systems implemented with android robots are expected to provide not only advanced conversational ability but also reliability and hospitality due to their human-like appearance. In this study, we aim to develop a hospitable dialogue system by encouraging open-ended utterances and responding adaptively to give users the feeling of being heard. To achieve this, utilizing large language models (LLMs) is a promising option, but task-oriented dialogue systems implemented with only LLMs often generate irrelevant, inconsistent, or contradictory utterances. Therefore, we propose a scenario-based dialogue system that subdivides the task into smaller sub-tasks, such as summarization, information extraction, and response generation, and uses LLMs in a fine-grained manner to overcome such shortcomings of the LLM-based dialogue system. Our system was evaluated in the tourist-spot recommendation task of the Dialogue Robot Competition 2022 and achieved second place in the preliminary round and first place in the final round, outperforming other rule-based dialogue systems. However, we also identified several challenges when using LLMs for android dialogue systems, including response delays due to computational complexity, hallucinations, and coordination issues between generated utterances and robot control. GRAPHICAL

robotics
Preserving HRI Capabilities: Physical, Remote and Simulated Modalities in the SciRoc 2021 Competition

Vincenzo Suriani,Daniele Nardi

2023-03-22

Abstract:In the last years, robots are moving out of research laboratories to enter everyday life. Competitions aiming at benchmarking the capabilities of a robot in everyday scenarios are useful to make a step forward in this path. In fact, they foster the development of robust architectures capable of solving issues that might occur during human-robot coexistence in human-shaped scenarios. One of those competitions is SciRoc that, in its second edition, proposed new benchmarking environments. In particular, Episode 1 of SciRoc 2 proposed three different modalities of participation while preserving the Human-Robot Interaction (HRI), being a fundamental benchmarking functionality. The Coffee Shop environment, used to challenge the participating teams, represented an excellent testbed enabling for the benchmarking of different robotics functionalities, but also an exceptional opportunity for proposing novel solutions to guarantee real human-robot interaction procedures despite the Covid-19 pandemic restrictions. The developed software is publicly released.

Robotics,Human-Computer Interaction

Proceedings of the Dialogue Robot Competition 2022

Proceedings of the Dialogue Robot Competition 2023

Overview of Dialogue Robot Competition 2022

Overview of Dialogue Robot Competition 2023

ditlab system for Dialogue Robot Competition 2022

RoboCup 2013: Robot World Cup XVII

Team OS's System for Dialogue Robot Competition 2022

Special issue on multimodal processing and robotics for dialogue systems (Part II)

Team Irisapu Project Description for DRC2023

Hospitable Travel Agent Dialogue Robot: Team Irisapu Project Description for DRC2022

Dialogue System of Team NTT-EASE for DRC2023

User-adaptive Tourist Information Dialogue System with Yes/No Classifier and Sentiment Estimator

Enhancing Consistency in Multimodal Dialogue System Using LLM with Dialogue Scenario

Team Flow at DRC2022: Pipeline System for Travel Destination Recommendation Task in Spoken Dialogue

Coordination and Machine Learning in Multi-Robot Systems: Applications in Robotic Soccer

Dialogue with Robots: Proposals for Broadening Participation and Research in the SLIVAR Community

Message from the Program Chair: ICoSR 2022

Developing Interactive Tourism Planning: A Dialogue Robot System Powered by a Large Language Model

Overview of the Tenth Dialog System Technology Challenge: DSTC10

Building a hospitable and reliable dialogue system for android robots: a scenario-based approach with large language models

Preserving HRI Capabilities: Physical, Remote and Simulated Modalities in the SciRoc 2021 Competition