Abstract:Artificial intelligence (AI) is progressively changing techniques of teaching and learning. In the past, the objective was to provide an intelligent tutoring system without intervention from a human teacher to enhance skills, control, knowledge construction, and intellectual engagement. This paper proposes a definition of AI focusing on enhancing the humanoid agent Nao’s learning capabilities and interactions. The aim is to increase Nao intelligence using big data by activating multisensory perceptions such as visual and auditory stimuli modules and speech-related stimuli, as well as being in various movements. The method is to develop a toolkit by enabling Arabic speech recognition and implementing the Haar algorithm for robust image recognition to improve the capabilities of Nao during interactions with a child in a mixed reality system using big data. The experiment design and testing processes were conducted by implementing an AI principle design, namely, the three-constituent principle. Four experiments were conducted to boost Nao’s intelligence level using 100 children, different environments (class, lab, home, and mixed reality Leap Motion Controller (LMC). An objective function and an operational time cost function are developed to improve Nao’s learning experience in different environments accomplishing the best results in 4.2 seconds for each number recognition. The experiments’ results showed an increase in Nao’s intelligence from 3 to 7 years old compared with a child’s intelligence in learning simple mathematics with the best communication using a kappa ratio value of 90.8%, having a corpus that exceeded 390,000 segments, and scoring 93% of success rate when activating both auditory and vision modules for the agent Nao. The developed toolkit uses Arabic speech recognition and the Haar algorithm in a mixed reality system using big data enabling Nao to achieve a 94% success learning rate at a distance of 0.09 m; when using LMC in mixed reality, the hand sign gestures recorded the highest accuracy of 98.50% using Haar algorithm. The work shows that the current work enabled Nao to gradually achieve a higher learning success rate as the environment changes and multisensory perception increases. This paper also proposes a cutting-edge research work direction for fostering child-robots education in real time.

Influence of the NAO robot as a teaching assistant on university students’ vocabulary learning and attitudes

The Effect of Applying Humanoid Robots as Teacher Assistants to Help Iranian Autistic Pupils Learn English as a Foreign Language

When Even a Robot Tutor Zooms: A Study of Embodiment, Attitudes, and Impressions

Robot’s adaptive emotional feedback sustains children’s social engagement and promotes their vocabulary learning: a long-term child–robot interaction study

The effect of a physical robot on vocabulary learning

An Intelligent Big Data Management System Using Haar Algorithm-Based Nao Agent Multisensory Communication

Surprising Performances of Students with Autism in Classroom with NAO Robot

Effect of Robot Tutor’s Feedback Valence and Attributional Style on Learners

Artificial intelligence in language instruction: impact on English learning achievement, L2 motivation, and self-regulated learning

A Study on the Role of Affective Feedback in Robot-Assisted Learning

Mobile-assisted academic vocabulary learning with digital flashcards: Exploring the impacts on university students' self-regulatory capacity

Effects of Quillbot-assisted paraphrasing practice on EFL college students’ English vocabulary acquisition and perception

Using an AI-Based Object Detection Translation Application for English Vocabulary Learning

An Empirical Study on the Implementation of AI Assisted Language Teaching for Improving Learner's Learning Ability

Examining the Impact of Chatbot-based Language Learning Support, Adaptive Learning Algorithms, and Virtual Reality Language Immersion on EFL Learners' Language Learning Proficiency and Self-Regulated Learning Skills

Application of Humanoid Robot in Intervention for Autistic Children

A Case Study of a Robot-Assisted Speech Therapy for Children with Language Disorders

The Effects of Feedback on Children's Engagement and Learning Outcomes in Robot-Assisted Second Language Learning

A Systematic Literature Review on the Applications of Robots and Natural Language Processing in Education

The Attitude of Elderly and Young Adults Towards a Humanoid Robot as a Facilitator for Social Interaction

NAO Robot Learns to Interact with Humans through Imitation Learning from Video Observation