Abstract:The currently observed developments in Artificial Intelligence (AI) and its influence on different types of industries mean that human-robot cooperation is of special importance. Various types of robots have been applied to the so-called field of Edutainment, i.e., the field that combines education with entertainment. This paper introduces a novel fuzzy-based system for a human-robot cooperative Edutainment. This co-learning system includes a brain-computer interface (BCI) ontology model and a Fuzzy Markup Language (FML)-based Reinforcement Learning Agent (FRL-Agent). The proposed FRL-Agent is composed of (1) a human learning agent, (2) a robotic teaching agent, (3) a Bayesian estimation agent, (4) a robotic BCI agent, (5) a fuzzy machine learning agent, and (6) a fuzzy BCI ontology. In order to verify the effectiveness of the proposed system, the FRL-Agent is used as a robot teacher in a number of elementary schools, junior high schools, and at a university to allow robot teachers and students to learn together in the classroom. The participated students use handheld devices to indirectly or directly interact with the robot teachers to learn English. Additionally, a number of university students wear a commercial EEG device with eight electrode channels to learn English and listen to music. In the experiments, the robotic BCI agent analyzes the collected signals from the EEG device and transforms them into five physiological indices when the students are learning or listening. The Bayesian estimation agent and fuzzy machine learning agent optimize the parameters of the FRL agent and store them in the fuzzy BCI ontology. The experimental results show that the robot teachers motivate students to learn and stimulate their progress. The fuzzy machine learning agent is able to predict the five physiological indices based on the eight-channel EEG data and the trained model. In addition, we also train the model to predict the other students’ feelings based on the analyzed physiological indices and labeled feelings. The FRL agent is able to provide personalized learning content based on the developed human and robot cooperative edutainment approaches. To our knowledge, the FRL agent has not applied to the teaching fields such as elementary schools before and it opens up a promising new line of research in human and robot co-learning. In the future, we hope the FRL agent will solve such an existing problem in the classroom that the high-performing students feel the learning contents are too simple to motivate their learning or the low-performing students are unable to keep up with the learning progress to choose to give up learning.

Reinforcement Learning of an Interpretable Fuzzy System through a Neural Fuzzy Actor-Critic Framework for Mobile Robot Control

Autonomous navigation of mobile robots in unknown environments using off-policy reinforcement learning with curriculum learning

Neural Internal Model Control: Learning a Robust Control Policy via Predictive Error Feedback

An improved fuzzy inference strategy using reinforcement learning for trajectory-tracking of a mobile robot under a varying slip ratio

Navigation for Mobile Robots Using Reinforcement Learning and Fuzzy Logic

Reinforcement structure/parameter learning for neural-network-based fuzzy logic control systems

Learning Fuzzy Controllers in Mobile Robotics with Embedded Preprocessing

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

Incorporating Perception-Based Information in Reinforcement Learning Using Computing with Words

A Path-Integral-Based Reinforcement Learning Algorithm for Path Following of an Autoassembly Mobile Robot

How to Train Your Quadrotor: A Framework for Consistently Smooth and Responsive Flight Control via Reinforcement Learning

Interpretable Reinforcement Learning for Robotics and Continuous Control

FML-Based Reinforcement Learning Agent with Fuzzy Ontology for Human-Robot Cooperative Edutainment

A Fuzzy-Inference-based Reinforcement Learning Method of Overtaking Decision Making for Automated Vehicles

RLIF: Interactive Imitation Learning as Reinforcement Learning

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

A Deep Reinforcement Learning Solution for the Low Level Motion Control of a Robot Manipulator System

Intelligent mobile robot navigation in unknown and complex environment using reinforcement learning technique

Safe Inverse Reinforcement Learning via Control Barrier Function

Distilling Deep RL Models Into Interpretable Neuro-Fuzzy Systems