Top of page
Technology

Tencent makes audio and video calls more accessible for people with hearing disabilities

Zhihui Chen
Zhihui Chen, a soccer player with hearing disability, is on a video chat with her coach through the app.

Tencent and China Unicom have jointly developed speech-to-text converter that is changing the life of approximately 28 million people who are hard of hearing in China.

The mobile app is powered by Tencent’s AI speech-enhanced algorithm to assist listening. This technology is developed by Tencent Meeting’s Ethereal Audio Lab, which shares its AI audio technology for free to improve life quality for people who are hard of hearing. Since 2020, the Ethereal Audio Lab and Tencent Charity Foundation worked with partners including the China Association of the Deaf to offer hearing aid solutions.

Incoming calls are switched into a speech-to-text interface, starting with a customized message. It informs the caller about the feature’s activation and understanding for the delay in response.

When the call is connected, every word coming from is automatically converted into text and appears on the screen on the recipient’s end.

Vice versa, the receiver of the call can select pre-programmed messages or type them manually to convert them into audio.

The same logic is used for video calls. On top of the usual video call interface, the caller’s speech is converted into texts in real-time on top of their screen.

The single-byte speech recognition rate and the real-time caption recognition accuracy rate increased by 66 percent and 6 percent to 10 percent, respectively.

The feature’s announcement comes shortly after Tencent’s barrier-free emergency feature launched in December, a function to help users call the ambulance or police without having to communicate using voice.

Through the “Barrier-Free First Aid” or “Penguin Emergency” Mini Programs, the hearing-impaired person can call the emergency medical center by text. The function translates the text into voice and sends it to the nearest local emergency center. The dispatcher receives a special alert and the caller’s location information is transmitted to the emergency center simultaneously.

Tencent said this feature is backed by Tencent Cloud’s voice recognition technology, which recognizes 24 dialects and received 98 percent accuracy.

Tencent is cooperating with the first aid centers across China, starting with 24 cities including Beijing, Nanjing, Wuhan, and Jiujiang.

Tencent said it will continue to build a more inclusive platform by adding cloud computing capability for the emergency service, AED equipment, first aid volunteers, and others.

You might also like

female teacher sitting at desk with a Down syndrome schoolboy female teacher sitting at desk with a Down syndrome schoolboy

NSW expands disability support classes in mainstream schools

An extra 243 support classes have been approved to open…

Coworker on wheelchair with photo editors in meeting room Coworker on wheelchair with photo editors in meeting room

Workplace-led disability initiatives benefit both individuals and companies

Successful employer-driven disability initiatives share certain characteristics, even when the…

Wheelchair disabled person works as a barista in an inclusive coffee shop. Wheelchair disabled person works as a barista in an inclusive coffee shop.

Hamlet Cafe receives $250K grant from govt for promoting inclusive success

The Rockliff Liberal Government is ensuring Hamlet Café can continue…

Disabled woman in wheelchair with assistant walking in garden Disabled woman in wheelchair with assistant walking in garden

Ensuring better deal for Queenslanders with disabilities

The Queensland Government has pledged to negotiate a fair deal…