Examining the Effectiveness of Convolutional Neural Networks for Determining Visual Fixation Using fMRI
ISEF · 2019 Computational Biology and Bioinformatics
Overview
When conducting a study using fMRI, it is often beneficial to be able to track the eyes of participants, especially for experiments that require visual fixation. One method of achieving this is with the use of support vector regression (SVR) to analyze fMRI data of the eyes and predict where a participant is fixing their gaze. However, SVR suffers from several drawbacks, one of which is the requirement of two separate models to determine horizontal and vertical coordinates. The purpose of this project was to examine the effectiveness of convolutional neural networks (CNN) for eye tracking with fMRI images and compare its accuracy to SVR. The CNN was written in Python using TensorFlow and trained with the same data as the SVR model, and its accuracy was computed using mean squared error (MSE). Eight different configurations of CNNs were tested. It was found the most effective configuration of the CNN had an average MSE of 0.00439 on testing data. The MSE of the SVR models was larger at 0.00628. Therefore, on the dataset used for this project, the CNN appeared to be more effective than SVR. However, due to a small amount of samples, the CNN appeared to overfit the training data to a certain degree. As more data are collected, overfitting should be reduced.
Competition history
- ISEF 2019
Resources
Related projects
JSHS · 2020
Computational Eye-Tracking Biomarker for Improved Neuropsychological Evaluation via Deep Learning
CSEF · 2026
Improving Human Visual Attention Prediction Using Deep Learning and Webcam Eye Tracking
ISEF · 2022
Comparing Neural Network Strategies to Label Tricuspid Valve on MRI Images
CSEF · 2018
A State-of-the-Art Approach to Detect Diabetic Retinopathy Using Convolutional Neural Networks and Adversarial Networks
CSEF · 2017
A State-of-the-Art Approach to Detect Diabetic Retinopathy Using Convolutional Neural Networks
CSEF · 2026
Explainable Eye Tracking Analysis Using a Deep Learning Approach for Autism Detection
ISEF · 2020
Detecting Common Retinal Diseases Through Use of Convolutional Neural Networks
JSHS · 2023
Supervised Binary Convolutional Neural Networks with Model Stacking for Diagnosis of Fundus & Eyelid Diseases
Closest projects by meaning, across every fair and year in the corpus.
Browse more like this
Source: Regeneron International Science and Engineering Fair