Top of page
Accessibility

New Voice Assistant Makes Web Browsing Easier for Blind People

blind woman using computer

Researchers have developed a new voice assistant that allows people with vision disabilities to get web content as quickly and as effortlessly as possible from smart speakers and similar devices.

The tool is called Voice Exploration, Retrieval, and Search (VERSE). The study was led by Alexandra Vtyurina, a University of Waterloo Faculty of Mathematics student, and Leah Findlater, an assistant professor from the University of Washington.

“People with vision disabilities often rely on screen readers, and increasingly voice-based virtual assistants, when interacting with computer systems,” said Vtyurina, a PhD candidate in Waterloo’s David R. Cheriton School of Computer Science, who undertook the study during her internship at Microsoft Research. “Virtual assistants are convenient and accessible but lack the ability to deeply engage with content, such as read beyond the first few sentences of an article, list alternative search results and suggestions. In contrast, screen readers allow for deep engagement with accessible content, and provide fine-grained navigation and control, but at the cost of reduced walk-up-and-use convenience.

The primary input method for VERSE is voice; so, users can say “next”, “previous”, “go back” or “go forward”. VERSE can also be paired with an app, which runs on a smartphone or a smartwatch. These devices can serve as input accelerators, similar to keyboard shortcuts. For example, rotating the crown on a smartwatch advances VERSE to the next search result, section, or paragraph, depending on the navigation mode.

You might also like

Assoc Prof Suranga Nanayakkara (left) with NUS student Mark Myres (right), who tested AiSee as a blind user. Assoc Prof Suranga Nanayakkara (left) with NUS student Mark Myres (right), who tested AiSee as a blind user.

Researchers create AI-Powered ‘AiSee’ enabling blind people to identify objects

Shopping for groceries is a common activity for many of…

woman using smartphone woman using smartphone

Govt launches India’s first cloud based IVRS toll free helpline for PwDs

The Government has launched India’s first cloud based IVRS toll-free…

Deep Brain's AI website screenshot Deep Brain's AI website screenshot

Empowering the Future: Deep Brain’s AI in Virtual Reality for Youth Development

In the ever-expanding landscape of technology, the convergence of artificial…

Three children standing with their arms around each other's shoulders. The child in the middle has a prosthetic leg. Three children standing with their arms around each other's shoulders. The child in the middle has a prosthetic leg.

Global initiative launched to enhance access to assistive technology

A new global campaign, backed by the Honourable First Lady…