A Touchscreen-Based Framework for Accurate and Transferable Cognitive Prescreening Using Drawing Behavior Encoding
CSEF · 2026 Behavioral & Social Sciences (Senior Division)
Overview
Cognitive decline affects more than 55 million people worldwide, yet early screening still depends on clinical infrastructure that limits access. In the United States, an estimated 7.4 million cases of mild cognitive impairment in adults age 65 and older remain undiagnosed. This research presents a novel smartphone-based framework for cognitive prescreening that is accurate, accessible, and transferable across datasets and neurological conditions. Adults aged 60 and older (N=185) completed four touchscreen drawing tasks through a custom web application that recorded touch trajectories, timing, and pressure. After demographic filtering and data quality review, 134 subjects were retained for model development using 5-fold subject-level cross-validation. To capture both what was drawn and how it was produced, I designed a renderer that converts each drawing into an image where velocity is encoded as color and pressure as stroke width. Across 16 rendering strategies, this representation performed best. This study is the first in smartphone-based cognitive prescreening to use this combined rendering strategy and validate it through a systematic renderer comparison. Using a fixed image embedding with a low-dimensional linear readout produced the strongest model, achieving AUC 0.968 ± 0.008, 96.8% sensitivity, and 90.3% specificity. Robustness testing across validation splits, bootstrap resampling, and backbone variants showed that the result was stable and reproducible. The same learned representation also generalized beyond the original cohort without retraining, achieving AUC 0.836 on an independent clinician-verified mild cognitive impairment dataset of 918 subjects and AUC 0.911 on a Parkinson’s disease dataset of 204 spiral drawings in a zero-shot transfer test. These findings show that short touchscreen drawing tasks can capture robust and transferable biomarkers of neuro-motor and cognitive impairment.
Competition history
- CSEF 2026
Related projects
ISEF · 2026
NeuroTracer: Unraveling Prediagnostic Signals for Early Onset Parkinson’s Disease From Archimedean Spiral Drawings Using the 2D Wavelet Transform, Recurrence Quantification Analysis, and Convolutional Neural Networks
ISEF · 2022
PANDwriting: An Accessible, High-Sensitivity Parkinson's and Alzheimer's Screening System Using Vision-Based Handwriting Kinematic Analysis and Machine Learning
ISEF · 2025
SoundKraft: A Gamified, Sensory-Adaptive Screening System for Geriatric Cognitive Impairment
ISEF · 2021
Early Diagnosis of Parkinsonism via a Smartphone Application
ISEF · 2021
PANDwriting: An Accessible Parkinson's and Alzheimer's Novel Diagnostic Framework Using Vision-Based Handwriting Kinematic Analysis and Machine Learning
CSEF · 2026
NeuroGait: Identifying Cognitive-Motor Impairment Through Secondary Functions in Walking Behavior with AI Gait Analysis
ISEF · 2024
A Comparison of Machine Learning Models (CNN and SVM) in the Novel Supervised Image Classification Approach for the Accessible Diagnosis of Alzheimer's Disease via Clock Drawing Tests on Mobile Phone Applications
CSEF · 2026
Neuro-Behavioral Convergence: A Multimodal Approach to Stroke Risk Assessment
Closest projects by meaning, across every fair and year in the corpus.
Browse more like this
Source: California Science & Engineering Fair public projects