fairfolio
Saved Projects

A Novel Computational Tongue-Based Interaction System Expanding Digital Access for Individuals with Motor Disabilities

CSEF · 2026 Computational Science (Senior Division)

Hollie Tang

Overview

This project presents a novel computational tongue-based interaction system designed to expand digital access for individuals with motor disabilities. The framework defines tongue interaction across four computational dimensions,position, gesture, movement, and multi-modality, forming an extensible interaction model. A multi-stage computer vision pipeline, built on newly designed algorithmic and geometric models, performs adaptive tongue segmentation, contour-based orientation estimation, tongue-tip localization, mouth-state detection, and eye-blink confirmation.Stability mechanisms, including multi-face filtering and visual focus detection, improve robustness in real-world conditions. These algorithms translate continuous tongue motion into discrete, machine-interpretable commands. Built on this framework, a scalable interaction ecosystem was implemented across multiple domains, including a tongue-based typing interface, cursor control system, a hands-free powered wheelchair, and a robotic arm for physical object manipulation, as well as extensions to interactive and entertainment systems demonstrating broader applicability. All systems share a unified recognition and control-mapping architecture without requiring wearable or implanted sensors. Experimental results demonstrate stable recognition, responsive control, and immediate usability with minimal training. By formalizing tongue motion as a computational input language and providing a reusable recognition pipeline, this work establishes a scalable human–computer interaction framework for assistive technology, robotics, and adaptive control systems.

Competition history

  • CSEF 2026 Computational Science (Senior Division) · Entry S-07-28

Related projects

Closest projects by meaning, across every fair and year in the corpus.

Browse more like this

Source: California Science & Engineering Fair public projects

Save projects to your library

Sign in with Google to keep track of projects you find interesting, organized into folders. An account also raises your daily allowance for “Has this been done?”, and lets you create a key for the MCP server with a much higher limit than anonymous use. Browsing stays public.

Continue with Google