Autism Diagnostics Tool Using Gesture Recognition and Machine Learning
ISEF · 2019 Robotics and Intelligent Machines
Overview
Autism Spectrum Disorder is the fastest growing developmental disability in America with the CDC labeling 1 in 59 children as Autistic. Currently within the Autism Diagnostics field, due to long wait times, children don’t have freedom of choice when/where to participate in diagnosis. Children are unable to expose their full potential skills at unfamiliar medical facilities within the allotted time. After researching the market and patents, I found no available products to aid Autism-Diagnosis on motor skills. To combat the need, I developed a gesture recognition tool to capture/report autistic children’s gross motor skills in natural settings, for unlimited time, to reveal their maximum potential skills. My Tool consists of 4 parts: Machine Learning Model(Random Forest), Software Application, Cloud Database Reporting and Wearable Device. I trained my ML model on 52 gestures based on Autism ESDM Diagnosis Standards. I captured real-time gesture data with a depth camera, fed to ML Model, and stored the Model’s prediction data in a cloud database using software application APIs. I generated Reports from Cloud data using .php scripts, allowing for therapists from Boston to extend evaluation to children in countries like Peru(1 registered therapist). I added a wristband-device to my App-engine to enable alerts/notifications via Bluetooth (offline reporting option). I tested each element(Model, Application, Reporting, Wristband) individually/collectively in multiple phases. I retrained/retested the Model repetitively(1560 trials) to achieve a minimum accuracy of 80% and statistically analyzed the test results using confusion-matrices. My tool’s final Performance Metrics: [Accuracy-0.83032, Precision-0.839, F1-Measure-0.606078, Sensitivity-0.813208, and Specificity-0.815909].
Awards (2)
- American Statistical Association: Certificate of Honorable Mention
- International Council on Systems Engineering - INCOSE: Certificate of Honorable Mention
Competition history
- ISEF 2019
Resources
Related projects
CSEF · 2015
A Wireless, Wearable, and Customizable Electronic Solution to Predict and Prevent Autistic Meltdowns
AJAS · 2019
Developing a Machine Learning Program to Detect Speech Patterns of Autistic Children
CSEF · 2023
Development of an Innovative Eye-tracking and Audio Hybrid System for ASD Early Detection
CSEF · 2018
Autism Spectrum Disorder Screening Using Machine Learning
ISEF · 2017
Diagnosing the Puzzle of Autism: A Wearable Micro-Movement Sensing Cap for Early Pediatric Screening
CSEF · 2012
Innovation in Autism
CSEF · 2017
ASD Alert! A Novel Low Cost Device to Help Predict and Mitigate Oncoming Autistic Episodes
ISEF · 2019
Diagnosing Autism with Machine Learning: Binary Classification for Eye Movement in Virtual Reality Environment
Closest projects by meaning, across every fair and year in the corpus.
Browse more like this
Source: Regeneron International Science and Engineering Fair