Top of page
Technology

Team programs a humanoid robot to communicate in sign language

For a robot to be able to “learn” sign language, it is necessary to combine different areas of engineering such as artificial intelligence, neural networks and artificial vision, as well as underactuated robotic hands.

“One of the main new developments of this research is that we united two major areas of Robotics: complex systems (such as robotic hands) and social interaction and communication,” explains Juan Víctores, one of the researchers from the Robotics Lab in the Department of Systems Engineering and Automation of the UC3M.

The first thing the scientists did as part of their research was to indicate, through a simulation, the specific position of each phalanx in order to depict particular signs from the Spanish Sign Language. They then attempted to reproduce this position with the robotic hand, trying to make the movements similar to those a human hand could make. “The objective is for them to be similar and, above all, natural. Various types of neural networks were tested to model this adaptation, and this allowed us to choose the one that could perform the gestures in a way that is comprehensible to people who communicate with sign language,” the researchers explain.

You might also like

Man with prosthetic running Man with prosthetic running

Danish startup launches Levitate Gravel Sole for running prosthetics

Levitate Technology has announced the launch of The Levitate Gravel…

Man opening door of his car outdoors Man opening door of his car outdoors

Accessible parking in real time with Park’nPay app

Minister for Customer Service and Digital Government Victor Dominello said…

Reserchers testing the wearable device Reserchers testing the wearable device

Researchers develop wearable to track mental states through the skin

Researchers at NYU Tandon have reached a key milestone in…

Cute baby ginger hair close up crawling on bed Cute baby ginger hair close up crawling on bed

Scanning a baby’s eyes with this app could save their life

According to a study co-authored by scientists at UCL (University…