Eye-Rubbing Detection Using a Smartwatch: A Feasibility Study Demonstrated High Accuracy With Machine Learning

In this work, we present a new machine learning method based on the transformer neural network to detect eye rubbing using a smartwatch in a real-life setting. In ophthalmology, the accurate detection and prevention of eye rubbing could reduce incidence and progression of ectasic disorders, such as...

Full description

Saved in:
Bibliographic Details
Published in:Translational vision science & technology 2024-09, Vol.13 (9), p.1
Main Authors: Elahi, Sina, Mery, Tom, Panthier, Christophe, Saad, Alain, Gatinel, Damien, Alahi, Alexandre
Format: Article
Language:English
Subjects:
Artificial Intelligence
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this work, we present a new machine learning method based on the transformer neural network to detect eye rubbing using a smartwatch in a real-life setting. In ophthalmology, the accurate detection and prevention of eye rubbing could reduce incidence and progression of ectasic disorders, such as keratoconus, and to prevent blindness.PurposeIn this work, we present a new machine learning method based on the transformer neural network to detect eye rubbing using a smartwatch in a real-life setting. In ophthalmology, the accurate detection and prevention of eye rubbing could reduce incidence and progression of ectasic disorders, such as keratoconus, and to prevent blindness.Our approach leverages the state-of-the-art capabilities of the transformer network, widely recognized for its success in the field of natural language processing (NLP). We evaluate our method against several baselines using a newly collected dataset, which consist of data from smartwatch sensors associated with various hand-face interactions.MethodsOur approach leverages the state-of-the-art capabilities of the transformer network, widely recognized for its success in the field of natural language processing (NLP). We evaluate our method against several baselines using a newly collected dataset, which consist of data from smartwatch sensors associated with various hand-face interactions.The current algorithm achieves an eye-rubbing detection accuracy greater than 80% with minimal (20 minutes) and up to 97% with moderate (3 hours) user-specific fine-tuning.ResultsThe current algorithm achieves an eye-rubbing detection accuracy greater than 80% with minimal (20 minutes) and up to 97% with moderate (3 hours) user-specific fine-tuning.This research contributes to advancing eye-rubbing detection and establishes the groundwork for further studies in hand-face interactions monitoring using smartwatches.ConclusionsThis research contributes to advancing eye-rubbing detection and establishes the groundwork for further studies in hand-face interactions monitoring using smartwatches.This experiment is a proof-of-concept that eye-rubbing detection is effectively detectable and distinguishable from other similar hand gestures, solely through a wrist-worn device and could lead to further studies and patient education in keratoconus management.Translational RelevanceThis experiment is a proof-of-concept that eye-rubbing detection is effectively detectable and distinguishable from other similar hand ge
ISSN:2164-2591
2164-2591
DOI:10.1167/tvst.13.9.1