Sign Language Translator

Overview

This study aimed to facilitate the communication of people who use sign language and those who do not know sign language. As a solution, mobile application was developed that converts the defined hand signs in American Sign Language (ASL) to sound in real time by using artificial intelligence. Two different datasets were created through the scope of the project: “Sign Language Digits Dataset” was created with the collaboration of 218 high school students. Consists of just ASL digits with good light and white background samples. This digits dataset can be found in GitHub and Kaggle. “Sign Language Dataset” was created with the collaboration of 173 high school students. Consists of ASL digits, some nouns and verbs samples without any light or environment dependency. Using this dataset prepared; a Convolutional Neural Network (CNN) based deep learning model that creates new data samples, a unsupervised machine learning algorithm that pre-labeling the unlabeled data samples and CNN based deep learning models to detecting sign language in real time. These machine learning algorithms were trained with created sign language dataset and deployed to mobile as a real time sign language converter application without any light or environment dependency. The prepared project has a dynamic structure so this structure allows the project to ability to implementation different problem areas (e.g. communication solutions for customer-oriented companies and control of robots).

Awards (1)

• Fourth Award of $500 $500

Competition history

• ISEF 2019 Systems Software · Entry SOFT022T

Resources

• ISEF abstract page ↗

Related projects

Closest projects by meaning, across every fair and year in the corpus.