Morse Code-Enabled Speech Recognition for Individuals with Visual and Hearing Impairments

Ritabrata Roy Choudhury

2024-07-07

Abstract:The proposed model aims to develop a speech recognition technology for hearing, speech, or cognitively disabled people. All the available technology in the field of speech recognition doesn't come with an interface for communication for people with hearing, speech, or cognitive disabilities. The proposed model proposes the speech from the user, is transmitted to the speech recognition layer where it is converted into text and then that text is then transmitted to the morse code conversion layer where the morse code of the corresponding speech is given as the output. The accuracy of the model is completely dependent on speech recognition, as the morse code conversion is a process. The model is tested with recorded audio files with different parameters. The proposed model's WER and accuracy are both determined to be 10.18% and 89.82%, respectively.

Sound,Artificial Intelligence,Computation and Language,Human-Computer Interaction,Machine Learning

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the insufficient accessibility and accuracy of existing speech recognition technologies for people with hearing, language or cognitive impairments. Specifically:

1. **Limitations of existing speech recognition models**:
- Existing speech recognition models perform poorly when processing the speech of people with accents or language impairments, which may lead to inaccurate recognition.
- For the hearing - impaired, it can be very difficult to understand speech in noisy environments.
- The speech of those with cognitive impairments may be slow, unclear or have different intonation patterns, making it difficult for existing algorithms to recognize correctly.

2. **Goals and contributions**:
- This paper proposes a new speech recognition model, aiming to enhance the accessibility and accuracy of the speech recognition system by introducing a Morse Code conversion layer.
- The working process of the model includes two main steps:
1. **Speech - to - text**: The user's voice is collected through the microphone and transmitted to the speech recognition layer to convert the voice into text.
2. **Text - to - Morse Code**: The generated text is passed to the Morse Code conversion layer to convert the text into the corresponding Morse Code.

3. **Innovative points**:
- **Improving accessibility**: By using Morse Code, this model can help people with hearing, language or cognitive impairments communicate more conveniently. Morse Code can be conveyed to users through vibration or other tactile means, especially suitable for emergency situations.
- **Easy to learn**: Morse Code is a relatively simple system, easy to learn and use, suitable for those who have difficulty using complex communication tools.

4. **Experimental results**:
- The word error rate (WER) of this model is 10.18%, that is, the accuracy rate is 89.82%. This indicates that the model can effectively convert speech into text and further into Morse Code in most cases.
- The experiment also considered the influence of different recording files and system speakers, and the results showed that the model has good stability and adaptability under different conditions.

In summary, by introducing the Morse Code conversion layer, this paper solves the applicability problem of existing speech recognition technologies for people with hearing, language or cognitive impairments, and improves the communication efficiency and accuracy of these people.