Abstract:Efforts to make online media accessible to a regional audience have picked up pace in recent years with multilingual captioning and keyboards. However, techniques to extend this access to people with hearing loss are limited. Further, owing to a lack of structure in the education of hearing impaired and regional differences, the issue of standardization of Indian Sign Language (ISL) has been left unaddressed, forcing educators to rely on the local language to support the ISL structure, thereby creating an array of correlations for each object, hindering the language building skills of a student. This paper aims to present a useful technology that can be used to leverage online resources and make them accessible to the hearing-impaired community in their primary mode of communication. Our tool presents an avenue for the early development of language learning and communication skills essential for the education of children with a profound hearing loss. With the proposed technology, we aim to provide a standardized teaching and learning medium to a classroom setting that can utilize and promote ISL. The goals of our proposed system involve reducing the burden of teachers to act as a valuable teaching aid. The system allows for easy translation of any online video and correlation with ISL captioning using a 3D cartoonish avatar aimed to reinforce classroom concepts during the critical period. First, the video gets converted to text via subtitles and speech processing methods. The generated text is understood through NLP algorithms and then mapped to avatar captions which are then rendered to form a cohesive video alongside the original content. We validated our results through a 6-month period and a consequent 2-month study, where we recorded a 37% and 70% increase in performance of students taught using Sign captioned videos against student taught with English captioned videos. We also recorded a 73.08% increase in vocabulary acquisition through signed aided videos.

[A solitary, defined radiolucency on a panoramic radiograph; cyst or no cyst?]

Hearing loss, mobile applications and inclusive social environments: Approach to learning sign language for children without disabilities

Inclusive Digital Content for the Teaching-Learning of Deaf University Students in Computer Networks

Comunicación accesible

SiLearn: an intelligent sign vocabulary learning tool

A real-time Artificial Intelligence system for learning Sign Language

E-Learning, Fuzzy Methods, and Sign Language Video to Enhance Teaching for Hearing Impaired

Development of The AR School App for Children with Hearing Impairment Who Begin Learning Ecuadorian Sign Language using Augmented Reality

Educational Methodologies for Hearing Impaired Children Supported by Mobile Technology and Extended Reality: Systematic Analysis of Literature

Inclusive Education: Mobile App for Students with Hearing Impairment

SignFind: A Synchronized Sign Language and Chinese Character Teaching Game for Chinese Deaf Children Using Gesture Recognition

Localtiy and False Sharing in Coherent-Cache Parallel Graph Reduction

Training program on sign language: social inclusion through Virtual Reality in ISENSE project

Automated 3D sign language caption generation for video

Translation System for Sign Language Learning

Design and Implementation of a Virtual 3D Educational Environment to improve Deaf Education

Sign Language Recognition and Translation: A Multidisciplined Approach From the Field of Artificial Intelligence

The Association between Children’s Behavior and Parenting of Caregivers: A Longitudinal Study in Japan

Design of Sign Language Learning Media Based on Virtual Reality

AR Computer-Assisted Learning for Children with ASD based on Hand Gesture and Voice Interaction

Smart Glove for Sign Language Translation