SIMON Smart Deaf Speaker Device
ISEF · 2021 Biomedical Engineering
Overview
Communications between deaf and persons who can hear and speak have always been a challenging task. According to the report issued by WHO, April 2021, there's an estimate of 430 Million persons who are deaf or hard of hearing. And they represent nearly 5 % of world population, unless action is taken it's predicted that by 2050 it'll get worse and rise up till nearly 2.5 billion people projected to have some degree of hearing loss. Achieving high efficiency in speech recognition, saving new phrases or user inputs in form of text/speech without needing a code developer, giving the user the ability to input text and display it as speech not only text were a target. After several developing stages, using a Raspberry Pi and mainly including "Speech_recognition/pyttsx3" libraries, now 'SIMON' can recognize speech and displays it as text, if the reply could be found in the pre-recorded database, the user is allowed to quickly play an appropriate reply. But if no appropriate reply is found, the user is prompted for text input to be converted into speech, this new input is appended to the table for future use. The recognition accuracy is 87.7%, although the given was from a non-native English speaker, and audio quality has improved by 84.6% according to the RTA analysis.
Competition history
- ISEF 2021
Resources
Related projects
ISEF · 2023
Sign Language Interpreter With Built in Translator
ISEF · 2026
HearMe A Bidirectional Communication System for Hearing Impaired
ISEF · 2025
Wearable Translator for Bidirectional Communication Between ASL and Speech
ISEF · 2015
TALK - An AAC Device: Converting Breath into Speech for the Disabled
ISEF · 2021
Smart Phone Speaks Hand Movements
ISEF · 2026
Sensora: A Wearable AI-Powered Sound Detection and Alert System for Enhanced Environmental Awareness in Deaf and Deafblind Individuals
ISEF · 2018
Myelofon: The Way of Expressing Thoughts for People with Speech Disorders
ISEF · 2025
HandTalk: A Two-Way Translation System for American Sign Language
Closest projects by meaning, across every fair and year in the corpus.
Browse more like this
Source: Regeneron International Science and Engineering Fair