Top of page
Technology

Team programs a humanoid robot to communicate in sign language

For a robot to be able to “learn” sign language, it is necessary to combine different areas of engineering such as artificial intelligence, neural networks and artificial vision, as well as underactuated robotic hands.

“One of the main new developments of this research is that we united two major areas of Robotics: complex systems (such as robotic hands) and social interaction and communication,” explains Juan Víctores, one of the researchers from the Robotics Lab in the Department of Systems Engineering and Automation of the UC3M.

The first thing the scientists did as part of their research was to indicate, through a simulation, the specific position of each phalanx in order to depict particular signs from the Spanish Sign Language. They then attempted to reproduce this position with the robotic hand, trying to make the movements similar to those a human hand could make. “The objective is for them to be similar and, above all, natural. Various types of neural networks were tested to model this adaptation, and this allowed us to choose the one that could perform the gestures in a way that is comprehensible to people who communicate with sign language,” the researchers explain.

You might also like

woman using smartphone woman using smartphone

App-monitoring of thinking difficulties could help treatment of depression

New research with over 500 participants diagnosed with depression has…

blind person teating the cane blind person teating the cane

‘Smart’ walking stick could help blind people with groceries, finding a seat

Engineers at CU Boulder are tapping into advances in artificial…

Hippo Camera app Hippo Camera app

New smartphone app can significantly improve memory recall

Researchers at the University of Toronto have demonstrated that a…

Kaylah Vogt Kaylah Vogt

Woman with hearing disability denied a job at NM agrees to $180K settlement

North Memorial Health has agreed to pay $180,000 to settle…