Abstract:Humanoid robots have a substantial potential to serve as teaching and social assistants. However, the expectations of the children from robots to interact like humans are huge. This study presents a general model for understanding the natural language in human-robot interaction by applying Generative Pre-trained Transformer (GPT) language models as a service in the Internet of Things. Thus, the physical presence of the robot can help in fine-tuning the GPT model by prompts derived from the environmental context and subsequent robot actions for embodiment understanding of the GPT outputs. The model uses web or cloud services for Natural Language Processing (NLP) to produce and play human-like text, question answering or text generation. Verbal questions are processed either via a local speech recognition software or via a Speech-to-Text (STT) cloud service. The converted question into machine-readable code is sent to one of the GPT language models with zero- or few-shot learning prompts. GPT-J model has been tested and deployed either in the web or cloud with options for varying the parameters for controlling the haphazardness of the generated text. The robot produces human-like text by using Text-to-Speech (TTS) cloud services that convert the response into audio format rendered on the robot to be played. Useful requirements how the model to be used in order to be feasible were determined based on the evaluation of the outputs given from the different NLP and GPT-J web or cloud-services. We designed and implemented the model in order to be used by a humanoid NAO-type robot in the speech language therapy practice, however it can be used for other open-source and programmable robots and in different contexts.

Development of Indonesian Language Speech Recognition Algorithm Model in Knowledge Database

Preliminary Study on Indonesian Word Recognition for Elder Companion Robot

Deep learning-based question answering system for intelligent humanoid robot

A New Speech Recognition Model in a Human-Robot Interaction Scenario Using NAO Robot: Proposal and Preliminary Model

Developing high-level cognitive functions for service robots

Voice Command Recognition for Movement Control of a 4-DoF Robot Arm

Interactive Robot for Automated Question and Answer System

Design and deployment of a voice activated for intelligent robot

Cross-Lingual Machine Speech Chain for Javanese, Sundanese, Balinese, and Bataks Speech Recognition and Synthesis

Intelligent Head-bot, towards the Development of an AI Based Cognitive Platform

Enhanced Speech Recognition for Indonesian Geographic Dictionary Using Deep Learning

Making humanoid robots teaching assistants by using natural language processing (NLP) cloud-based services

Augmented Reality with Speech Recognition for Animal Recognition Applications

Researching and designing an intelligent humanoid robot for teaching English language

Toward Open Knowledge Enabling for Human-Robot Interaction

Intelligent Facial Emotion Recognition and Semantic-Based Topic Detection for A Humanoid Robot

Building a hospitable and reliable dialogue system for android robots: a scenario-based approach with large language models

You just do not understand me! Speech Recognition in Human Robot Interaction

One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia

Developing FB Chatbot Based on Deep Learning Using RASA Framework for University Enquiries