Low-Cost Eye-Gesture Control System for Mobile Devices Using Reinforcement Learning for Paralyzed Patients
Overview
Millions of people with paralysis struggle to use everyday technology due to limited motor function. In the U.S. alone, over 5.3 million individuals—about 1.7% of the population—live with paralysis from strokes (33.7%), spinal cord injuries (27.3%), or multiple sclerosis (18.6%). Severity ranges from monoplegia (one limb) to quadriplegia or the rare locked-in syndrome, where only eye movements remain voluntary. Beyond mobility, paralysis often disrupts circulation, breathing, swallowing, and communication. Existing assistive systems—like dedicated eye-tracking rigs—can help, but they are expensive, bulky, and hard to configure. We propose a smartphone-based solution using the built-in camera and reinforcement learning to recognize subtle eye motions, blinks, and micro-gestures as control commands. By continuously adapting to each user’s unique patterns, our system offers a cost-effective, personalized interface that boosts independence and quality of life. This innovation expands human-machine interaction in healthcare, making assistive technology more accessible to millions.
Competition history
- ISEF 2025
Resources
Related projects
ISEF · 2026
Intelligent Face-Controlled Assistive System for Precise Object Manipulation: Assisting Individuals With Upper Limb Motor Impairments
ISEF · 2022
Using Computer Vision and Augmented Reality To Utilize Pupil Movement as an Alternative to Traditional Tactile Input Systems
ISEF · 2016
Eye Connect: Using Computer Vision to Create Low-Cost Assistive Technology
ISEF · 2024
Gaze Link: A Multi-language Low-Cost Mobile Eye-Gesture Communication System With Large Language Models for People With Amyotrophic Lateral Sclerosis
ISEF · 2021
EyesDrive: A Novel, Non-invasive, Brain-Computer Interface for Paralysis Sufferers
ISEF · 2023
Low-Cost Real-Time Silent Communicator for Complete Quadriplegia (Paralyzed) Patients
CWSF · 2026
i-Cognia: Brain-Controlled System Empowering Independent Living for People with Motor Impairments
ISEF · 2024
A Comprehensive Assistive System for Enhancing Independence in Individuals with Quadriplegia
Closest projects by meaning, across every fair and year in the corpus.
Browse more like this
Source: Regeneron International Science and Engineering Fair