Eye-gesture control of computer systems via artificial intelligence [version 3; peer review: 1 approved, 2 approved with reservations]

Background Artificial Intelligence (AI) offers transformative potential for human-computer interaction, particularly through eye-gesture recognition, enabling intuitive control for users and accessibility for individuals with physical impairments. Methods We developed an AI-driven eye-gesture recogn...

Full description

Saved in:
Bibliographic Details
Main Author: Nachaat Mohamed
Format: Article
Language:English
Published: F1000 Research Ltd 2025-02-01
Series:F1000Research
Subjects:
Online Access:https://f1000research.com/articles/13-109/v3
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Background Artificial Intelligence (AI) offers transformative potential for human-computer interaction, particularly through eye-gesture recognition, enabling intuitive control for users and accessibility for individuals with physical impairments. Methods We developed an AI-driven eye-gesture recognition system using tools like OpenCV, MediaPipe, and PyAutoGUI to translate eye movements into commands. The system was trained on a dataset of 20,000 gestures from 100 diverse volunteers, representing various demographics, and tested under different conditions, including varying lighting and eyewear. Results The system achieved 99.63% accuracy in recognizing gestures, with slight reductions to 98.9% under reflective glasses. These results demonstrate its robustness and adaptability across scenarios, confirming its generalizability. Conclusions This system advances AI-driven interaction by enhancing accessibility and unlocking applications in critical fields like military and rescue operations. Future work will validate the system using publicly available datasets to further strengthen its impact and usability.
ISSN:2046-1402