Response-Based Scaling Models the Binding Problem in Top-Down Visual Search
ISEF · 2018 Robotics and Intelligent Machines
Overview
Mimicking the human mind is paramount in modern research fields such as autonomous vehicle development. The accepted computational model of vision by Miconi et al. (2016) mimics the way humans perform visual search, the process of looking for a specific object in an image, but it cannot recognize color. Here, I present a new computational model of visual search that integrates color features. A novel technique of response-based scaling was developed to solve the binding problem: combining multiple “feature channels” containing distinct feature information. This new model is based directly on biological evidence: information processing and representation within the model mirrors processing and representation in the brain. Specifically, the model focuses on the flow of information from the LGN through area V4 in the visual cortex. To collect data, a set of over 1000 images with well-defined human responses, throughout cognitive science literature, was created and fed through the new model. The model’s performance was measured by counting the resulting attentional fixations: how long it took the model to find the target object. Search speeds as a function of image clutter were calculated. Analyses showed that the new model matched search speeds of humans, with a confidence level of 99%, on a wide variety of search tasks. Additionally, response-based scaling was proven to be necessary due to slower search speeds (p < 0.01) in certain cases without response-based scaling. This new system permits for new directions in computer vision, with a variety of applications from security scans to autonomous vehicles.
Competition history
- ISEF 2018
Resources
Related projects
CSEF · 2003
The Fantasy of Visual Fusion
ISEF · 2024
A Lens Into Vision: Modeling the Stimuli-Driven Differential Responses of Lobula Columnar Cells in Drosophila
CSEF · 2026
Improving Human Visual Attention Prediction Using Deep Learning and Webcam Eye Tracking
CSEF · 2002
Do You Believe What You See? The Effect of Lateral Adaptation on the Human Visual System
CSEF · 2007
Modeling and Analysis of Human Binocular Perception of Position and Velocity in the Visual Cortex
JSHS · 2020
Computational Eye-Tracking Biomarker for Improved Neuropsychological Evaluation via Deep Learning
ISEF · 2015
Mathematical Modeling and Brain Activations Characterize Differences in Human Pattern Recognition under Conditions of Ambiguous Feedback
ISEF · 2019
Examining the Effectiveness of Convolutional Neural Networks for Determining Visual Fixation Using fMRI
Closest projects by meaning, across every fair and year in the corpus.
Browse more like this
Source: Regeneron International Science and Engineering Fair