How do AR and AI address communication barriers for the hearing impaired?

Question

Accepted Answer

AR and AI Technologies Enhance Communication for the Hearing Impaired Through Real-time Transcription and Speech Synthesis

Team Hearable, comprising students from Nanyang Technological University, has developed a two-part solution utilising augmented reality (AR) glasses and artificial intelligence (AI) to assist individuals with hearing impairments. This innovative approach directly addresses communication barriers by transcribing spoken words into visible text in real-time via the AR glasses, and conversely, converting typed input into audible speech through an accompanying mobile application. While the specific technical intricacies of the AI's speech processing and the AR display mechanisms are not detailed, the core functionality aims to bridge communication gaps in everyday interactions.
Real-time Speech Transcription via AR Glasses

The AR glasses developed by Team Hearable are designed to provide immediate visual feedback for spoken conversations. Equipped with AI capabilities, these glasses are programmed to transcribe speech as it occurs. This transcription is then displayed directly within the wearer's field of vision through the AR interface, allowing individuals with hearing impairments to read what is being said without needing to rely on lip-reading or other external aids. This technology offers a discreet and integrated method for accessing auditory information in real-time.
Mobile Application for Text-to-Speech Conversion

Complementing the AR glasses, a mobile application has been developed to facilitate two-way communication. This application allows users to type their responses or messages, which are then converted into spoken words by the system. This feature enables individuals who may have difficulty speaking or who prefer to communicate via text to participate more fully in conversations, ensuring their voice can be heard by others. The integration of this text-to-speech functionality with the real-time transcription offers a comprehensive communication aid.
Leveraging AI and AR for Inclusivity

The combination of AI and AR technologies represents a significant step towards creating more inclusive environments for individuals with hearing impairments. By transcribing speech and synthesising typed input, Team Hearable's solution aims to reduce the challenges faced in daily communication, from casual conversations to more formal settings. This project, recognised at the Samsung Solve for Tomorrow competition, highlights the potential of advanced technologies to foster greater social participation and understanding.

Reading history

Hide →

This history is cleared when the page is closed.

How do AR and AI address communication barriers for the hearing impaired?

Loading

Was this article helpful?

Helpful

Not helpful

Report an issue

1

0

0

Share with friends