Top of page
Technology

Team programs a humanoid robot to communicate in sign language

For a robot to be able to “learn” sign language, it is necessary to combine different areas of engineering such as artificial intelligence, neural networks and artificial vision, as well as underactuated robotic hands.

“One of the main new developments of this research is that we united two major areas of Robotics: complex systems (such as robotic hands) and social interaction and communication,” explains Juan Víctores, one of the researchers from the Robotics Lab in the Department of Systems Engineering and Automation of the UC3M.

The first thing the scientists did as part of their research was to indicate, through a simulation, the specific position of each phalanx in order to depict particular signs from the Spanish Sign Language. They then attempted to reproduce this position with the robotic hand, trying to make the movements similar to those a human hand could make. “The objective is for them to be similar and, above all, natural. Various types of neural networks were tested to model this adaptation, and this allowed us to choose the one that could perform the gestures in a way that is comprehensible to people who communicate with sign language,” the researchers explain.

You might also like

Assoc Prof Suranga Nanayakkara (left) with NUS student Mark Myres (right), who tested AiSee as a blind user. Assoc Prof Suranga Nanayakkara (left) with NUS student Mark Myres (right), who tested AiSee as a blind user.

Researchers create AI-Powered ‘AiSee’ enabling blind people to identify objects

Shopping for groceries is a common activity for many of…

woman using smartphone woman using smartphone

Govt launches India’s first cloud based IVRS toll free helpline for PwDs

The Government has launched India’s first cloud based IVRS toll-free…

Deep Brain's AI website screenshot Deep Brain's AI website screenshot

Empowering the Future: Deep Brain’s AI in Virtual Reality for Youth Development

In the ever-expanding landscape of technology, the convergence of artificial…

Three children standing with their arms around each other's shoulders. The child in the middle has a prosthetic leg. Three children standing with their arms around each other's shoulders. The child in the middle has a prosthetic leg.

Global initiative launched to enhance access to assistive technology

A new global campaign, backed by the Honourable First Lady…