Top of page
Technology

Augmented Reality Improves Cinema Experience for Deaf People

watching movies
Marco Schneider (left) and Tony Tse wearing the Vivify headset, which allows people with hearing disabilities to watch a movie, wherever and whenever they like. Photo: University of Auckland

Auckland, NZ – Researchers from the Auckland Bioengineering Institute, at the University of Auckland, have developed a new technology that allows people who are deaf or hard of hearing to watch a movie at whatever cinema they like, and never miss a line of dialogue.

The device, called the Vivify headset, uses augmented reality to project subtitles below the cinema screen. A commercial trial of the headset is currently being run through Event cinemas in Newmarket, Auckland.

The system was developed by Marco Schneider and Tony Tse when they were both studying their PhD at the Institute.

Tony was investigating an underwater hearing aid for divers inspired by the mechanism of fish hearing, and Marco was developing a computational framework for analysing joint health from medical imaging data. (Marco is now a research fellow at the Institute, and Tony is completing his PhD.)

The idea for the device came out of a late-night conversation, when they were planning to watch a movie and Tony, who is hearing disability, expressed his wish that more movies came with subtitles.

If you would like to use the device when you next visit, you can book a pair of headsets through the Vivify website. The pair also plan to run free trials over the next few months which, for interested participants, will include a free movie admission and the free use of the headsets.

Find out more about Vivify Free Trials.

You might also like

A womn in a wheelchair using a computer A womn in a wheelchair using a computer

How technology advances accessibility for people with disabilities

In today’s fast-evolving technological setting, the impact of technological progress…

Sign Language Sign Language

How AI can help map sign languages

Like spoken languages, sign languages evolve organically and do not…

kid infront of computer screen kid infront of computer screen

UNMC’s Munroe-Meyer Institute introduces autism diagnostic tool

The UNMC Munroe-Meyer Institute is piloting a new diagnostic tool…

Hussein Alawieh, a graduate student in Dr. José del R. Millán's lab, wears a cap packed with electrodes that is hooked up to a computer. The electrodes gather data by measuring electrical signals from the brain, and the decoder interprets that information and translates it into game action. Hussein Alawieh, a graduate student in Dr. José del R. Millán's lab, wears a cap packed with electrodes that is hooked up to a computer. The electrodes gather data by measuring electrical signals from the brain, and the decoder interprets that information and translates it into game action.

Universal brain-computer interface enables thought-controlled gaming

Imagine playing a racing game like Mario Kart, using only…