A Deep Learning Approach for ASL Recognition and Text-to-Speech Synthesis using CNN

Debasish Phukon
DOI: https://doi.org/10.22214/ijraset.2023.55528
2023-08-31
International Journal for Research in Applied Science and Engineering Technology
Abstract:Abstract: Sign language is a visual language that is used by the deaf and hard-of-hearing community to communicate. However, sign language is not universally understood by non-signers, which can create communication barriers for the deaf and hard-ofhearing individuals. In this paper, we present a novel application for American Sign Language (ASL) to text to speech conversion using deep learning techniques. Our app aims to bridge the communication gap between hearing-impaired individuals who use ASL as their primary mode of communication and individuals who do not understand ASL. The app comprises three main components: a hand gesture recognition module that detects and recognizes ASL signs, a text-tospeech synthesis module that converts recognized ASL signs to text, and a speech synthesis module that converts the text to speech
What problem does this paper attempt to address?