Signtalk: Improve online meeting software accessbility for DHH group

 

Problem —

There are certain barriers for deaf and hard of hearing (DHH) people communicate with hearing peers in collaborative settings. Conventionally, those conversations are built upon experienced sign language translators. However, restricted by time and budget, such a solution might not be an optimal option in online meeting. Current assistive technology (AT) in online meeting software, for instance automatic speech recognition (ASR), act as a passive channel which emphasis the deficient of DHH group and failed to construct a communication atmosphere.

money.png

Employ sign language interpreter requires in advance planning and often are costly

 
mindset.png

ASR only enales DHH group to ‘read’ the conversation but not ‘participate’

 
 

Solution —

We argue a design shift that sorely enables deaf people to ‘read the conversation’ is not sufficient, together with initiate an intuitive channel to ‘verbalize their thoughts’ could fundamentally reduce the conversation barriers between DHH and hearing folks. We present SignTalk, an online meeting interface visions to bring equal access to DHH group and promote successful communication in remote meetings. Sign language is captured, analysed and verbalized to hearing individuals, similarly, spoken language is transcribed to sign language by the avatar to DHH group. Meeting attendants can also refer to live transcribed caption for clarification.

345-300235.png.jpg