Reflective Dialogues with a Humanoid Robot Integrated with an LLM and a Curated NLU System for Positive Behavioral Change in Older Adults
Ryan Browne,Mirza Mohtashim Alam,Qasid Saleem,Abrar Hyder,Tatsuya Kudo,Francesca D'Agresti,Martino Maggio,Keiko Homma,Eerik-Juhanna Siitonen,Naoko Kounosu,Kristiina Jokinen,Michael McTear,Giulio Napolitano,Kyoungsook Kim,Junichi Tsujii,Rainer Wieching,Toshimi Ogawa,Yasuyuki Taki
DOI: https://doi.org/10.3390/electronics13224364
IF: 2.9
2024-11-08
Electronics
Abstract:We developed an innovative system that combines Natural Language Understanding (NLU), a curated knowledge base, and the efficient management of a Large Language Model (LLM) to support motivational health coaching. Using Rasa as the core framework, we enhanced it by integrating the GPT-3.5-turbo model. Users opt into reflective dialogues during conversations. When they respond to open-ended questions, their input goes directly to the GPT-3.5-turbo model, allowing for more flexible responses. To provide curated trustworthy content, we integrated a knowledge provision component that searches a PDF-based knowledge base and generates user-friendly responses using Retrieval-Augmented Generation. We tested the system in a real-world scenario by deploying it on a Nao robot in seven older adults' homes for 1–2 weeks, encouraging positive behavioral changes in some users. Our system serves as a valuable foundation for building an even more integrated, personalized system that can connect with other Application Programing Interfaces (APIs) and integrate with home sensors and edge devices.
engineering, electrical & electronic,computer science, information systems,physics, applied