fairfolio
Saved Projects

Development of an Innovative Eye-tracking and Audio Hybrid System for ASD Early Detection

CSEF · 2023 Behavioral & Social Sciences First Award

Liang Jingjing, Zhang Alec · 9

Overview

1 in 44 children in the USA are impacted by autism spectrum disorder (ASD), but only <50% of children received effective early intervention due to delayed diagnosis. This represents a huge missed opportunity during a critical window in the child’s neurodevelopment. Our project aims to develop an accessible and accurate system analyzing both eye-gaze and audio for ASD early detection. This hybrid system is implemented in a website called SEL-Pet to collect data through 4 categories of experiments/stimulus. 108 participants were recruited (ASD n=30; General Population (GP) n=78) and 912 experiment datasets were collected with embedded AI-driven web-gazers and microphones. For efficiency during model training, the eye-gaze data are converted into visual scanpath representations, and mel frequency cepstral coefficients (MFCC) are extracted from the audio data. A convolutional neural network (CNN) model was then trained to examine the scanpaths/velocity map, and a long short-term memory (LSTM) network model was coded to analyze the acoustic features. We achieved validation accuracies of 63% for only eye gaze, 69% for only audio, and 82% for hybrid, demonstrating the reduction of false positives in a 2-dimensional system. Our novel project may be implemented into at-home settings and into educational institutions to screen for ASD in a non-invasive and child-friendly way while encouraging children to develop their social-emotional learning (SEL) skills, minimizing financial and time commitment for families and the necessity of professional availability and providing peace-of-mind in parenting.

Source coverage

This record comes from a published award list, not a complete project archive. Its abstract comes from CSEF's public project showcase as archived by the Internet Archive before judging (https://web.archive.org/web/20230401224130/https://ca-csef.zfairs.com/showcase/ShowcaseInfo?f=838e60b7-ea75-46e8-865c-fde4864244b3); the version presented may differ.

Awards (3)

Competition history

  • CSEF 2023 Behavioral & Social Sciences · Entry S0422

Resources

Related projects

Closest projects by meaning, across every fair and year in the corpus.

Browse more like this

Source: California Science & Engineering Fair public projects

Save projects to your library

Sign in with Google to keep track of projects you find interesting, organized into folders. An account also raises your daily allowance for “Has this been done?”, and lets you create a key for the MCP server with a much higher limit than anonymous use. Browsing stays public.

Continue with Google