fairfolio
Saved Projects

FlikcerAI: Resolution of Photosensitive Epileptic Visual Content With Spatio-Temporal Luminance Frequency Analysis

ISEF · 2022 Translational Medical Science Second Award

Kothari, Jaisal, Srivastava, Ashay · Amity International School - Saket

Overview

Photosensitive epilepsy (PSE) is a neurological disorder, where seizures are triggered by aberrant flashes or specific spatial configurations of light. After COVID-19, billions of new internet users encounter such epileptic videos on a daily basis, accelerating the need for a solution. We propose a web application that can filter videos to be safe to view by patients of not only PSE but dyslexia, autism, Irlen syndrome, and the general photosensitive population. Based on ITU’s proposed Ofcom guidelines, we developed FlikcerAI, a set of novel algorithms based on a vectorized machine learning model. Firstly, gamma-compressed RGB values are converted to luminance values as perceived by the human brain. Next, a CNN-RNN hybrid video classification model analyses the video spatially and temporally to detect possible triggers. We conducted a comprehensive analysis of five deep architectures on over 240,000 synthetic videos. We also developed four methods to filter possible triggers using algorithms like the fast Fourier transform (FFT). A critical element of our algorithm is its computational efficiency, allowing the world’s first real-time implementation capable of analyzing over 100,000 video frames in minutes. FlikcerAI has been used to successfully resolve over 3000 videos by 500 users with highly positive feedback during qualitative assessment. We completed Phase I of our proposed ITU guideline testing with over 97% detection and 100% resolution accuracy. FlikcerAI is the first open-source tool of its kind. Its scalability, compatibility, and simplicity make it ideal to expand to video games, web pages, or even Virtual Reality.

Awards (2)

Competition history

  • ISEF 2022 Translational Medical Science · Entry TMED004T · Atlanta, Georgia, United States Affiliated fair in DELHI, India

Resources

Related projects

Closest projects by meaning, across every fair and year in the corpus.

Browse more like this

Source: Regeneron International Science and Engineering Fair

Save projects to your library

Sign in with Google to keep track of projects you find interesting, organized into folders. An account also raises your daily allowance for “Has this been done?”, and lets you create a key for the MCP server with a much higher limit than anonymous use. Browsing stays public.

Continue with Google