Real-Time Machine Learning for Accurate Mexican Sign Language Identification: A Distal Phalanges Approach

Effective communication is crucial in daily life, and for people with hearing disabilities, sign language is no exception, serving as their primary means of interaction. Various technologies, such as cochlear implants and mobile sign language translation applications, have been explored to enhance c...

Full description

Saved in:
Bibliographic Details
Published in:Technologies (Basel) 2024-09, Vol.12 (9), p.152
Main Authors: García-Gil, Gerardo, López-Armas, Gabriela del Carmen, Sánchez-Escobar, Juan Jaime, Salazar-Torres, Bryan Armando, Rodríguez-Vázquez, Alma Nayeli
Format: Article
Language:English
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Effective communication is crucial in daily life, and for people with hearing disabilities, sign language is no exception, serving as their primary means of interaction. Various technologies, such as cochlear implants and mobile sign language translation applications, have been explored to enhance communication and improve the quality of life of the deaf community. This article presents a new, innovative method that uses real-time machine learning (ML) to accurately identify Mexican sign language (MSL) and is adaptable to any sign language. Our method is based on analyzing six features that represent the angles between the distal phalanges and the palm, thus eliminating the need for complex image processing. Our ML approach achieves accurate sign language identification in real-time, with an accuracy and F1 score of 99%. These results demonstrate that a simple approach can effectively identify sign language. This advance is significant, as it offers an effective and accessible solution to improve communication for people with hearing impairments. Furthermore, the proposed method has the potential to be implemented in mobile applications and other devices to provide practical support to the deaf community.
ISSN:2227-7080
2227-7080
DOI:10.3390/technologies12090152