Top of page

Researchers develop AI-based Apps to help people with hearing disabilities 

Dr. Issa Panahi with smartphone
Dr. Issa Panahi, professor of electrical and computer engineering in the Erik Jonsson School of Engineering and Computer Science. Photo: The University of Texas at Dallas

University of Texas at Dallas researchers have developed smartphone apps that solve the biggest problems for people with hearing disabilities: filtering out background noise and improving speech perception.

One of the most recent apps, detailed in a study published online July 27 in The Journal of the Acoustical Society of America, uses artificial intelligence to remove extraneous babble, street background noise, and other sounds via smartphones earbuds as well as devices using wired or wireless connection. The article is one of 67 studies that researchers have presented about their work for people with hearing loss in academic journals and at conferences since 2014.

The latest work, funded by a five-year, $1.86 million grant from the National Institute on Deafness and other Communication Disorders of the National Institutes of Health (NIH), is part of an effort to develop an open-source research platform for speech processing and hearing improvement. The NIH also provided a two-year, $522,000 grant in 2015 to use smartphone technology to improve hearing devices.

Dr. Issa Panahi, professor of electrical and computer engineering in the Erik Jonsson School of Engineering and Computer Science and principal investigator of the projects, said the apps run in real-time. Hence, the signal is in sync with the speaker’s lip movements. The technology can locate and display speech source direction, suppress the background noise, and improve speech quality and perception.

“If you talk to me in a noisy environment, I can still recognize your words well, and the speech is not distorted when our smartphone-based apps are used,” Panahi said. “That is what a person with hearing loss needs.”

According to the World Health Organization, about 466 million people, including 34 million children, experience disabling hearing loss. About 15% of American adults report some trouble hearing, according to the NIH.

“In our research, we strive to develop affordable platforms and assistive tools that would help people with hearing disorders and improve their quality of life,” said Panahi.

Preliminary tests of the apps conducted at the UT Dallas Callier Center for Communication Disorders have shown hearing improvement with 22% benefit in people with impaired hearing and 29% benefit in people without hearing loss, said Dr. Linda Thibodeau, co-principal investigator on the project and professor of speech, language, and hearing in the School of Behavioral and Brain Sciences.

The researchers developed noise-filtering and speech-enhancement apps that use only the built-in microphones of a smartphone. The apps, which have been tested on Android and iOS-based smartphones, can also be used with a hearing-assist device.

The technology indicates where the noise is coming from, so users can change their orientation to get better sound quality.

You might also like

Apple Accessibility OS features Apple Accessibility OS features

Apple announces new accessibility features for its devices

Apple released new accessibility features that will give iPhone, Apple…

Ray Campbell using the app Ray Campbell using the app

Gov. Lamont announces expansion of Virtual Mobility Assistance Pilot Program

Governor Ned Lamont announced that the State of Connecticut’s 18-month…

Machine Deep learning algorithms, Artificial intelligence AI , Automation and modern technology in business as concept Machine Deep learning algorithms, Artificial intelligence AI , Automation and modern technology in business as concept

Using AI to improve the health and wellbeing of people with learning disabilities

A new study led by Loughborough University and the Leicestershire…

Closeup of gavel in court room Closeup of gavel in court room

Texas Coffee Company settles EEOC disability bias lawsuit

North Richland Hills, Texas-based 151 Coffee will pay $70,000 and…