Communication for the handicapped: the hands say it all.

C. Kiernan

1980-09-25

Abstract:

What problem does this paper attempt to address?

Smart Hand Gloves for Deaf and Dumb People

Shravani Jadhav,Siddhi Mhatre,Riddhi Patil,Prachi Sorte

DOI: https://doi.org/10.22214/ijraset.2024.59171

2024-03-31

International Journal for Research in Applied Science and Engineering Technology

Abstract:Abstract: Approximately 2.78% of the population in our nation is nonverbal. They communicate with people by using their hands and facial gestures. As is well known, those who are silent are mute and those who are not are unaware of sign language, which is a way for silent individuals to communicate. Thus, we have put forth a brand-new method known as “The SPEAKING SYSTEM TO THE MUTE PEOPLE”. Thus, this system will be helpful in solving the issue. The accelerometer sensors form the foundation of the system. Mute people believe that every deed has a purpose. The accelerometer sensors accelerate with each action and provide a signal to the Arduino. The speech signal is created by the Arduino by synchronizing its motion with that of the database. The Guide Me app is being used as the system's output. Since gestures are consistent with people's communication habits, a lot of study has been done on gesture detection using a vision-based method.
Intersign Glove: A Communication Interface for the Aid of Deaf and Mute Community

Gaddala Finny Theophorus,Balwant Singh

DOI: https://doi.org/10.38124/ijisrt/ijisrt24may2510

2024-06-15

Abstract:Intersign Glove " is a groundbreaking innovation designed to address the communication barriers faced by the deaf and mute community. With the aim of revolutionizing traditional methods of communication, this paper introduces an innovative approach that utilizes gesture recognition technology to interpret Indian Sign Language (ISL) in real-time. The paper endeavors to eliminate the dependency on sign language interpreters by creating an embedded system comprising both hardware and software components. By leveraging advanced sensors strategically placed on a glove, the system captures intricate gesture parameters and translates them into code for computation. This code is then processed by a microcontroller board integrated into the glove, which generates corresponding speech output through an attached speaker, facilitating seamless communication between the user and non-sign language speakers. The wearable nature of the device ensures portability and ease of use, empowering individuals with hearing and speech impairments to communicate effectively in various social settings. Furthermore, by bridging the communication gap between the deaf and mute community and the wider population, this paper opens up new opportunities for inclusion and collaboration. "Intersign Glove" represents a significant advancement in assistive technology, promising to enhance the quality of life for individuals with hearing and speech disabilities while fostering greater understanding and integration within society.
Bridging Communication Gaps: A Comprehensive Survey on Sign Language Hand Gesture Smart Recognition Technology

Badal Pokharel,Shweta Bandhekar

DOI: https://doi.org/10.22214/ijraset.2023.57412

2023-12-31

International Journal for Research in Applied Science and Engineering Technology

Abstract:Abstract: Efficient communication is crucial in human interaction, yet individuals with language and hearing challenges encounter obstacles. This article centers on Nepali Sign Language (NSL) and introduces the Hand Gesture Smart Recognition initiative, with the goal of translating NSL into English. The research explores hand gesture recognition technology, emphasizing the cultural subtleties inherent in both vision-based and glove-based approaches. Recent advancements, such as the integration of compact models and CNNs, signify advancements in gesture recognition. The article offers valuable insights into the development and application of this technology, fostering optimism regarding the future potential of culturally suitable human-computer interaction technologies.
A Discourse Study on Handover Communication Among Care Providers in a Residential Care Home for Persons with Intellectual Disabilities

Jesse W. C. Yip

DOI: https://doi.org/10.1080/10410236.2022.2163105

IF: 3.501

2023-01-04

Health Communication

Abstract:Abundant research has focused on handovers among nurses and/or doctors in hospitals; far less is known about handovers among care providers in non-clinical contexts, such as care homes for the elderly or the disabled. Focusing on handovers in a residential care home for persons with intellectual disabilities (RCHID), this study argues that handover communication in non-clinical settings is equally important. Ineffective handovers can lead to the deterioration of the residents' health conditions, chaotic situations and even injuries to both care providers and care recipients. Staff in RCHIDs rely heavily on handover communication to obtain information about the residents' needs and to offer appropriate care services. Combining discourse analysis with interactional sociolinguistics, this study analyzes written and spoken discourses involved in handover communication among care providers in a typical RCHID in Hong Kong to investigate what and how communicative functions were achieved through the participants' language use. The data were collected by convenience sampling, including handwritten notes and handover recordings of twelve sessions. Then a group interview of seven care providers was conducted to obtain supplementary data. Findings suggest that handover communication includes informational and interpersonal functions. While information delivery is the main purpose, care providers also establish relationships with one another through small talk about care home residents. The results suggest potential drawbacks of the handovers, including illegible notes, inconsistent information collection, and low interactivity. This study proposes a model that elucidates the correlation between discourse, handover communication and healthcare services, and suggests strategies to enhance such communication.

health policy & services,communication
A novel approach as an AID for blind, deaf and dumb people

V. Sangeetha,V. Harini,D. Raksha,B. Rajapandian

DOI: https://doi.org/10.1109/SSPS.2017.8071628

2017-05-01

Abstract:Communication is the only medium by which we can share our thoughts or convey the message but for a person with disability (deaf and dumb) faces difficulty in communication with normal person. Generally, there will likely be at least some level of social isolation for those with disabilities With deafness/muteness, employing the same methods of communication as the other person (e.g. sign language or text-to-speech) is definitely going to be a main factor under consideration. It is fundamental to disabled people's lives that disability is recognized as an equality issue. In this project, we are going to propose a new system-prototype in an effort to make the process of interaction between the Blind, Deaf and Dumb people much easier. This will make use of the Portable Technology and Arduino Circuit Boards to provide a means of communication to differently-abled people having one or all of the above mention disabilities.

Medicine,Education,Engineering
Examining Gesture Production in the Presence of Communication Challenges

Laura M Morett,Laura M. Morett

DOI: https://doi.org/10.3791/66256

2024-01-26

Journal of Visualized Experiments

Abstract:Understanding why speakers modify their co-speech hand gestures when speaking to interlocutors provides valuable insight into how these gestures contribute to interpersonal communication in face-to-face and virtual contexts. The current protocols manipulate the visibility of speakers and their interlocutors in tandem in a face-to-face context to examine the impact of visibility on gesture production when communication is challenging. In these protocols, speakers complete tasks such as teaching words from an unfamiliar second language or recounting the events of cartoon vignettes to an interlocutor who is either another participant or a confederate. When performing these tasks, speakers are visible or non-visible to their interlocutor, and the speaker is visible or non-visible to the participant. In the word learning task, speakers and interlocutors visible to one another produce more representational gestures, which convey meaning via handshape and motion, and deictic (pointing) gestures than speakers and interlocutors who are not visible to one another. In the narrative retelling protocol, adolescents with autism spectrum disorder (ASD) produced more gestures when speaking to visible interlocutors than non-visible interlocutors. A major strength of the current protocol is its flexibility in terms of the tasks, populations, and gestures examined, and the current protocol can be implemented in videoconferencing as well as face-to-face contexts. Thus, the current protocol has the potential to advance the understanding of gesture production by elucidating its role in interpersonal communication in populations with communication challenges.

multidisciplinary sciences
Intelligent gloves: An IT intervention for deaf-mute people

Amal Babour,Hind Bitar,Ohoud Alzamzami,Dimah Alahmadi,Amal Barsheed,Amal Alghamdi,Hanadi Almshjary

DOI: https://doi.org/10.1515/jisys-2022-0076

2023-01-01

Journal of Intelligent Systems

Abstract:Abstract Deaf-mute people have much potential to contribute to society. However, communication between deaf-mutes and non-deaf-mutes is a problem that isolates deaf-mutes from society and prevents them from interacting with others. In this study, an information technology intervention, intelligent gloves (IG), a prototype of a two-way communication glove, was developed to facilitate communication between deaf-mutes and non-deaf-mutes. IG consists of a pair of gloves, flex sensors, an Arduino nano, a screen with a built-in microphone, a speaker, and an SD card module. To facilitate communication from the deaf-mutes to the non-deaf-mutes, the flex sensors sense the hand gestures and connected wires, and then transmit the hand movement signals to the Arduino nano where they are translated into words and sentences. The output is displayed on a small screen attached to the gloves, and it is also issued as voice from the speakers attached to the gloves. For communication from the non-deaf-mutes to the deaf-mute, the built-in microphone in the screen senses the voice, which is then transmitted to the Arduino nano to translate it to sentences and sign language, which are displayed on the screen using a 3D avatar. A unit testing of IG has shown that it performed as expected without errors. In addition, IG was tested on ten participants, and it has been shown to be both usable and accepted by the target users.
Design of Intelligent Human-Computer Interaction System for Hard of Hearing and Non-Disabled People

Qiang Fu,Jiajun Fu,Songyuan Zhang,Xun Li,Jian Guo,Shuxiang Guo

DOI: https://doi.org/10.1109/jsen.2021.3107949

IF: 4.3

2021-10-15

IEEE Sensors Journal

Abstract:Since the hard of hearing cannot communicate effectively with the non-disabled, which may cause various inconveniences. As an essential member of a harmonious society, it is particularly urgent to solve their communication problems with non-disabled people. Effective communication between the hard of hearing and the non-disabled has become possible with the continuous development of artificial intelligence. In this paper, an intelligent human-computer interaction system is designed to solve communication inconvenience between the hard of hearing and the non-disabled. This system combines artificial intelligence with wearable devices and classifies gestures with BP neural network, effectively solving the communication problem between the hard of hearing and the non-disabled.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Handtalker: A Multimodal Dialog System Using Sign Language and 3-D Virtual Human

Wen Gao,Jiyong Ma,Shiguan Shan,Xilin Chen,Wei Zeng,Hongming Zhang,Jie Yan,Jiangqin Wang

DOI: https://doi.org/10.1007/3-540-40063-x_74

2000-01-01

Abstract:In this paper, we describe HandTalker: a system we designed for making friendly communication reality between deaf people and normal hearing society. The system consists of GTS (Gesture/Sign language To Spoken language) part and STG (Spoken language To Gesture/Sign language) part. GTS is based on the technology of sign language recognition, and STG is based on 3D virtual human synthesis Integration of the sign language recognition and 3D virtual human techniques greatly improves the system performance. The computer interface for deaf people is data-glove, camera and computer display, and the interface for hearing-abled is microphone, keyboard, and display. HandTalker now can support no domain limited and continuously communication between deaf and hearing-abled Chinese people.
The Role of Gesture in Communication and Cognition: Implications for Understanding and Treating Neurogenic Communication Disorders

Sharice Clough,Melissa C. Duff

DOI: https://doi.org/10.3389/fnhum.2020.00323

IF: 3.473

2020-08-11

Frontiers in Human Neuroscience

Abstract:When people talk, they gesture. Gesture is a fundamental component of language that contributes meaningful and unique information to a spoken message and reflects the speaker's underlying knowledge and experiences. Theoretical perspectives of speech and gesture propose that they share a common conceptual origin and have a tightly integrated relationship, overlapping in time, meaning, and function to enrich the communicative context. We review a robust literature from the field of psychology documenting the benefits of gesture for communication for both speakers and listeners, as well as its important cognitive functions for organizing spoken language, and facilitating problem-solving, learning, and memory. Despite this evidence, gesture has been relatively understudied in populations with neurogenic communication disorders. While few studies have examined the rehabilitative potential of gesture in these populations, others have ignored gesture entirely or even discouraged its use. We review the literature characterizing gesture production and its role in intervention for people with aphasia, as well as describe the much sparser literature on gesture in cognitive communication disorders including right hemisphere damage, traumatic brain injury, and Alzheimer's disease. The neuroanatomical and behavioral profiles of these patient populations provide a unique opportunity to test theories of the relationship of speech and gesture and advance our understanding of their neural correlates. This review highlights several gaps in the field of communication disorders which may serve as a bridge for applying the psychological literature of gesture to the study of language disorders. Such future work would benefit from considering theoretical perspectives of gesture and using more rigorous and quantitative empirical methods in its approaches. We discuss implications for leveraging gesture to explore its untapped potential in understanding and rehabilitating neurogenic communication disorders.

psychology,neurosciences
State of art of possible communication support systems for users with athetoid cerebral palsy

Yohan Guerrier,Christophe Kolski,Franck Poirier

DOI: https://doi.org/10.46298/jips.2662

2018-08-02

Abstract:This article proposes a state-of-the-art on communication support systems that can be used by users with Athetoid Cerebral Palsy. Today, many communication support systems are available on the market and/or presented in the literature.They include (1) virtual keyboards, (2) software using pictograms, (3) speech recognition, and (4) other types of input systems dedicated to physically disabled users (brain-computer interface and physical aids). After the description of these four categories of communication support systems, this article ends with a synthesis in which our view of each category of system in relation to the considered user profile is provided. Cet article propose un état de l'art des systèmes d'aide à la communication utilisables par des utilisateurs de profil Infirme Moteur Cérébral (IMC) athétosique.De nos jours, de nombreuses aides à la communication sont proposées sur le marché et/ou présentées dans la littérature. Ces aides rassemblent (1) les claviers virtuels, (2) les logiciels exploitant des pictogrammes, (3) la reconnaissance vocale et (4) les autres types de systèmes de saisie dédiées aux personnes handicapées physiques (interface cerveau-ordinateur et aides physiques). Après la description successive de ces quatre catégories d’aide, cet article se termine par une synthèse dans laquelle notre point de vue sur chaque catégorie de système relativement au profil visé, est fourni.
Talking Hands: Speech to Sign Language Converter

,Bhavna Chaudhari,Shrinivas S. Kulkarni,Pankaj R. Waykar,Tejas V. Mishra,Krishna N. Dubile

DOI: https://doi.org/10.59256/indjcst.20240302024

2024-05-25

Abstract:Deaf people face communication challenges in many aspects of their lives. This project proposes a speech-to-sign language converter that can help to bridge the communication gap between deaf and hearing people. The converter would use speech recognition technology to transcribe spoken language into text. This text would then be translated into sign language images or GIFs. The images or GIFs would be displayed on a screen, allowing deaf people to easily understand the message. The converter would be designed to be as accurate and user-friendly as possible. It would also be customizable to support different sign languages. This project has the potential to make a significant impact on the lives of deaf people. It could help them to communicate more effectively in school, at work, and in social settings. It could also help to break down communication barriers and foster greater understanding between deaf and hearing people. The converter would be developed using a variety of technologies, including speech recognition, machine translation, and image processing. The objective of our project is to reduce the communication gap between normal people and disabled people by providing a virtual animation translator for sign language.
Comunicación accesible

John Fredy Montes Mora,Diego Fernando Castiblanco Franco

DOI: https://doi.org/10.22490/28057597.6785

2024-02-27

Abstract:Accessible communication is essential for the inclusion of deaf people in scientific and cultural society. The language barrier that deaf people face when trying to access written Spanish can limit their self-efficacy and their ability to participate fully in society. However, Optical Character Recognition (OCR) technology and Artificial Intelligence offer an innovative solution: the application of a Spanish signifier translator to Colombian Sign Language (CSL). This tool allows deaf people to understand their environment in Spanish in an autonomous way, which promotes inclusion and active participation in the scientific and cultural society. The application of OCR technology in the detection, reading, and conversion of Colombian Sign Language is essential to provide better living conditions for people with hearing disabilities and to bring together two cultures that have traditionally been distanced by the language barrier. This article describes the stages of development of the mobile application, the technology used, and the role of the sign language translator in promoting accessible communication and the participation of deaf people in a scientific and cultural society.
Communicating about Health Care: Observations from Persons Who Are Deaf or Hard of Hearing

Lisa I. Iezzoni,Bonnie L. O'Day,Mary Killeen,Heather Harker

DOI: https://doi.org/10.7326/0003-4819-140-5-200403020-00011

IF: 39.2

2004-03-02

Annals of Internal Medicine

Abstract:BACKGROUND: Achieving patient-centered care requires effective communication between physicians and patients. Persons who are deaf or hard of hearing face considerable barriers to communicating with physicians.OBJECTIVE: To understand perceptions of health care experiences and suggestions for improving care among deaf or hard-of-hearing individuals.DESIGN: 4 semistructured group interviews, 2 conducted in American Sign Language (for deaf individuals) and 2 using Communication Access Realtime Translation (for hard-of-hearing individuals). Men and women were interviewed separately. Tapes of interviews were transcribed verbatim for analysis.SETTING: Greater Boston, Massachusetts, and Washington, DC, in 2001.PARTICIPANTS: 14 deaf adults (23 to 51 years of age) and 12 hard-of-hearing adults (30 to 74 years of age).MEASUREMENTS: Commonly expressed themes or views organized around dimensions of communication.RESULTS: Concerns coalesced around 6 broad themes: conflicting views between physicians and patients about being deaf or hard of hearing; different perceptions about what constitutes effective communication (such as lip reading, writing notes, and sign language interpreter); medication safety and other risks posed by inadequate communication; communication problems during physical examinations and procedures; difficulties interacting with office staff, including in waiting rooms; and problems with telephone communication, such as lengthy message menus. Participants offered extensive suggestions for improvements, starting with clinicians' asking patients about their preferred communication approach. Having patients repeat critical health information (such as medication instructions) can identify potentially dangerous miscommunication.CONCLUSIONS: As the population ages, physicians will encounter many more persons with hearing limitations. Physicians are not reimbursed for making some accommodations, such as hiring sign language interpreters. However, ensuring effective communication is essential to safe, timely, efficient, and patient-centered care.

medicine, general & internal
Communication as a human right for children with profound intellectual disabilities

Juliet Goldbart

DOI: https://doi.org/10.1111/dmcn.15564

2023-05-10

Abstract:Developmental Medicine &Child Neurology, Volume 65, Issue 6, Page 725-726, June 2023.

pediatrics,clinical neurology
Communication, Language, and Modality in the Education of Deaf Students

Connie C. Mayer,Beverly J. Trezek

DOI: https://doi.org/10.3390/educsci13101033

2023-10-16

Education Sciences

Abstract:In the history of deaf education, questions attending communication, language, and modality have generated much discussion, and even heated debate. This should not be surprising as these questions touch on a fundamental issue that is central to policy and practice in the field—how to provide early, ready, and meaningful linguistic access. While one point of agreement is that such access is vital for age-appropriate language and literacy development, there is less consensus on how this access should be realized. This focus has heightened consequences and significance in the current context in which auditory access to spoken language is possible for the majority of deaf children. With a goal of reframing the conversation, the focus of this article will be on making the critical distinctions between language and modality that can inform understandings as to how access can be best achieved for an increasingly diverse population of deaf children and their families.
Recognition of Documents in Braille

Jomy John

DOI: https://doi.org/10.48550/arXiv.1709.09875

2017-09-28

Abstract:Visually impaired people are integral part of the society and it has been a must to provide them with means and system through which they may communicate with the world. In this work, I would like to address how computers can be made useful to read the scripts in Braille. The importance of this work is to reduce communication gap between visually impaired people and the society. Braille remains the most popular tactile reading code even in this century. There are numerous amount of literature locked up in Braille. Braille recognition not only reduces time in reading or extracting information from Braille document but also helps people engaged in special education for correcting papers and other school related works. The availability of such a system will enhance communication and collaboration possibilities with visually impaired people. Existing works supports only documents in white either bright or dull in colour. Hardly any work could be traced on hand printed ordinary documents in Braille.

Computer Vision and Pattern Recognition
Building Language Communication between Deaf People and Hearing Society through Multimodal Human-Computer Interface

Wen GAO,Xi-Lin CHEN,Ji-Yong MA,Zhao-Qi WANG

DOI: https://doi.org/10.3321/j.issn:0254-4164.2000.12.003

2000-01-01

Jisuanji Xuebao/Chinese Journal of Computers

Abstract:The issue of building language communication between deaf people and hearing society using multimodal human computer interface was discussed. To bridge the deaf people with normal hearing society, the auto-translation agents which consisted of sign language recognition, hand gesture synthesis, lip reading, feature detection and face animation were investigated. In this paper, some aspects of sign language recognition and synthesis were proposed. Data-glove was used for sign language recognition. Lip reading was used to enhance the sign language recognition for those words with the same gesture having different means. To make better sign language synthesis, gesture motion information was captured to improve the 3D model of virtual human animation. This paper dominates that the multimodal human-computer interface is workable to implement the heterochronous language communication.
How Health Care Organizations Are Implementing Disability Accommodations for Effective Communication: A Qualitative Study

Jennifer Y Oshita,Charles D MacLean,Ashley E Couture,Megan A Morris

DOI: https://doi.org/10.1016/j.jcjq.2024.05.003

Abstract:Background: Prior studies have documented that, despite federal mandates, clinicians infrequently provide accommodations that enable equitable health care engagement for patients with communication disabilities. To date, there has been a paucity of empirical research describing the organizational approach to implementing these accommodations. The authors asked US health care organizations how they were delivering these accommodations in the context of clinical care, what communication accommodations they provided, and what disability populations they addressed. Methods: In this study, 19 qualitative interviews were conducted with disability coordinators representing 15 US health care organizations actively implementing communication accommodations. A conventional qualitative content analysis approach was used to code the data and derive themes. Results: The authors identified three major themes related to how US health care organizations are implementing the provision of this service: (1) Operationalizing the delivery of communication accommodations in health care required executive leadership support and preparatory work at clinic and organization levels; (2) The primary focus of communication accommodations was sign language interpreter services for Deaf patients and, secondarily, other hearing- and visual-related accommodations; and (3) Providing communication accommodations for patients with speech and language and cognitive disabilities was less frequent, but when done involved more than providing a single aid or service. Conclusion: These findings suggest that, in addition to individual clinician efforts, there are organization-level factors that affect consistent provision of communication accommodations across the full range of communication disabilities. Future research should investigate these factors and test targeted implementation strategies to promote equitable access to health care for all patients with communication disabilities.
THE FEELING UNDERSTANDING AND VALUES OF THE DEAF CHILDREN

Qurrata 'Ain,Margana Margana

DOI: https://doi.org/10.33019/lire.v3i1.40

2019-03-31

Lire Journal (Journal of Linguistics and Literature)

Abstract:Deaf children have a language to communicate with each other. It is known as sign language. The sign language has grammatical, morpheme, syntactical and semantically rules. It can be helped the deaf children to understand the signs. The disability people or gift children have an equal with normal people. So, they deserve to get what they want and communicate with each other. Generally, the grammar of sign language for deaf people has used hand shape or movement even facial expression or body movement. This article has aimed to expose the ability of deaf children to understand the feelings and values of others. It refers to social and cognitive development. Deaf children have access to communicate how peoples’ interaction and explanation for behaviors to get better social dynamics as an advantage in cognitive development. The deaf children often show the behavior problem and inconsistent social and sometimes they could not understand social rules.

English Else

Communication for the handicapped: the hands say it all.

Smart Hand Gloves for Deaf and Dumb People

Intersign Glove: A Communication Interface for the Aid of Deaf and Mute Community

Bridging Communication Gaps: A Comprehensive Survey on Sign Language Hand Gesture Smart Recognition Technology

A Discourse Study on Handover Communication Among Care Providers in a Residential Care Home for Persons with Intellectual Disabilities

A novel approach as an AID for blind, deaf and dumb people

Examining Gesture Production in the Presence of Communication Challenges

Intelligent gloves: An IT intervention for deaf-mute people

Design of Intelligent Human-Computer Interaction System for Hard of Hearing and Non-Disabled People

Handtalker: A Multimodal Dialog System Using Sign Language and 3-D Virtual Human

The Role of Gesture in Communication and Cognition: Implications for Understanding and Treating Neurogenic Communication Disorders

State of art of possible communication support systems for users with athetoid cerebral palsy

Talking Hands: Speech to Sign Language Converter

Comunicación accesible

Communicating about Health Care: Observations from Persons Who Are Deaf or Hard of Hearing

Communication as a human right for children with profound intellectual disabilities

Communication, Language, and Modality in the Education of Deaf Students

Recognition of Documents in Braille

Building Language Communication between Deaf People and Hearing Society through Multimodal Human-Computer Interface

How Health Care Organizations Are Implementing Disability Accommodations for Effective Communication: A Qualitative Study

THE FEELING UNDERSTANDING AND VALUES OF THE DEAF CHILDREN