Top of page
Technology

Team programs a humanoid robot to communicate in sign language

For a robot to be able to “learn” sign language, it is necessary to combine different areas of engineering such as artificial intelligence, neural networks and artificial vision, as well as underactuated robotic hands.

“One of the main new developments of this research is that we united two major areas of Robotics: complex systems (such as robotic hands) and social interaction and communication,” explains Juan Víctores, one of the researchers from the Robotics Lab in the Department of Systems Engineering and Automation of the UC3M.

The first thing the scientists did as part of their research was to indicate, through a simulation, the specific position of each phalanx in order to depict particular signs from the Spanish Sign Language. They then attempted to reproduce this position with the robotic hand, trying to make the movements similar to those a human hand could make. “The objective is for them to be similar and, above all, natural. Various types of neural networks were tested to model this adaptation, and this allowed us to choose the one that could perform the gestures in a way that is comprehensible to people who communicate with sign language,” the researchers explain.

You might also like

BiomacVR, a VR-based rehabilitation system allows post-stroke patients to exercise at home BiomacVR, a VR-based rehabilitation system allows post-stroke patients to exercise at home

Lithuanian scientists invent virtual post-stroke assistant to aid rehabilitation

Some years ago, virtual reality (VR) systems were associated only…

Girl using computer at GITC 2022 Girl using computer at GITC 2022

GITC 2023: Embarking on a journey to empower youth with disabilities

The recruitment for countries to participate in the Global IT…

Close up hands typing laptop Close up hands typing laptop

Study reveals support needed for kids with disabilities using the web

Children with disabilities need better support to manage their online…

young blind woman with headphone using computer with refreshable braille display young blind woman with headphone using computer with refreshable braille display

Consultation to begin in Australia for Banking Accessibility Standards review

The Australian Banking Association (ABA) has engaged the Australian Network…