Abstract:This paper adopts the multimodal approach of human-computer collaboration to conduct an in-depth study and analysis of the practical teaching model of preschool education, and applies the designed model to the actual teaching process. The application of multimodal theory to preschool teaching is chosen to theoretically help expand the research scope of multimodal theory and enrich the research of preschool teaching, and practically help break through the previous single-modal teaching model, further enrich the theoretical guidance of preschool teaching, and improve the quality of preschool classroom teaching. Then, from the perspective of human-machine synergy, this paper analyzes the advantages of artificial intelligence technology and teachers in the English classroom, puts forward the new roles of teachers and learners in the human-computer cooperation teaching environment, and discusses the significance and value of applying the four main modules of human-computer cooperation teaching, human-computer gesture mapping and human-computer cooperation manipulator control in the preschool classroom. According to the physical structure of hand joints, the human hand joint angles are obtained through the inverse kinematic solution, and the human hand joint angles correspond to the dexterous manipulator one by one so that the dexterous manipulator can be controlled to imitate the human hand to complete flexible gesture movements and realize the vision-based collaborative human-machine control of the dexterous manipulator. Combined with Gagne's nine teaching events, a model of the English teaching process based on human-computer collaboration was constructed. Based on this model, the "EasyDotWise English Teaching System" was designed to combine the basic lesson types of preschool classroom teaching and the secondary objectives of the English curriculum standards, including "reading text-reading aloud evaluation," "playing speech-sound recognition," and "presenting text-selection." We designed and implemented three types of teaching activities: "reading text-reading aloud assessment," "playing phonetic sounds-sound identification," and "presenting text-comprehension selection."

Collaboration of Digital Human Gestures and Teaching Materials for Enhanced Integration in MOOC Teaching Scenarios

Exploitation Of Novel Multiplayer Gesture-Based Interaction And Virtual Puppetry For Digital Storytelling To Develop Children'S Narrative Skills

Exploitation of Multiplayer Interaction and Development of Virtual Puppetry Storytelling Using Gesture Control and Stereoscopic Devices.

GestureTeach: A Gesture Guided Online Teaching Interactive Model

Interactive Design With Gesture and Voice Recognition in Virtual Teaching Environments

Implementation of the Interactive Gestures of Virtual Avatar Based on a Multi-user Virtual Learning Environment

Biomimetic learning of hand gestures in a humanoid robot

Application of AI-based real-time gesture recognition and embedded system in the design of english major teaching

Construction and Application of a Human-Computer Collaborative Multimodal Practice Teaching Model for Preschool Education

A novel animation authoring framework for the virtual teacher performing experiment in mixed reality

Multimedia teaching system based on art interaction technology

An Implementation of Multimodal Fusion System for Intelligent Digital Human Generation

Real-Time Multi-modal Human-Robot Collaboration Using Gestures and Speech

An Interactive Teaching System for Ethnic Minority Dance Based on Deep Learning

Simulation and analysis of dance teaching action based on multimedia technology

Learning Speech-driven 3D Conversational Gestures from Video

TeachingBot: Robot Teacher for Human Handwriting

Exploring the Path of Innovative College Dance Teaching Models with Motion Capture Technology

Gesture-driven interaction service system for complex operations in digital twin manufacturing cells

Dynamic Hand Gesture-Featured Human Motor Adaptation in Tool Delivery using Voice Recognition

Collaborative Kinesthetic English Learning With Recognition Technology