Creating a Clearer Voice Chat/Conference by Using Sound Localization
CSEF · 2013 Mathematics & Software
Overview
Objectives/Goals In a multi-speaker voice chat or online conference, it can be very difficult to differentiate between speakers; by using a sound localization engine, our project aims to create a clearer conference experience.The engine will increase the productivity and efficiency of voice chats, which many students, businessmen, and casual users utilize. Methods/Materials To create a clearer voice chat, we will allow users to assign a location to a person#s voice on the audio spatial scene. We implement Interaural Time Difference (ITD) and Interaural Level Difference (ILD) between the left and right ears, which are essential cues that allow humans to localize sounds, based on the location of a person. Our GUI displays the participants of the chat, represented as icons. When an icon is moved, its x and y coordinates are sent to the sound localization engine. The engine applies ITD and ILD to the monaural voice of each participant, and combines the resulting voices into a stereo audio that is sent to the user through headphones. Materials used during this project include a Mac, a PC, and Java integrated development environments like Eclipse and NetBeans. Results To test ILD, we positioned the speakers from left to right in ascending speaker number (0-4 with 2 in the middle of the screen) and printed the amplitudes received by each ear from each speaker#s voice. We received results that showed that the ILD engine works: speakers 0 and 1#s left ear amplitudes were greater than the right ear#s, speaker 2#s amplitudes were equal, and speaker 3 and 4#s left ear amplitudes were less than the right ear#s. We tested the ITD engine in a similar fashion and received similar results: when laid out from left to right in ascending speaker order, speaker 0 had the greatest right ear delay and speaker 4 had the greatest left ear delay. Overall we could hear the effects of the sound localization engine very clearly. We received a mono audio and outputted a stereo audio, with ILD and ITD applied. Conclusions/Discussion The results of our testing, combined with our knowledge of sound localization show that our program achieves its engineering goal. ITD and ILD, combined with the visual cues presented in the GUI, help the user to experience an interactive audio spatial scene.
Summary statement
We are creating a program that will help users to differentiate between speakers in a voice chat/online conference by implementing ILD/ITD/visual cues from the GUI.
Help received
Our dads helped the team in finding resources about sound localization and taught us needed Java programming skills. Josh's mom helped with posterboard.
Competition history
- CSEF 2013
Resources
Related projects
CSEF · 2003
Emulating 3D Spatial Audio
CSEF · 2014
A Sound Source Localizing System
CSEF · 2019
Sound Localization and Noise Cancellation to Assist the Hearing Impaired
CSEF · 2015
Creating Three-Dimensional Sound Using Mono Audio Recordings
ISEF · 2017
Real-Time Sound Localization Using a Microphone Array
CSEF · 2015
The Exchange Improving Unit: An Auditory Device for Directional Filtering
CSEF · 2016
The Exchange Improving Unit: An Auditory Device for Directional Filtering: A Second-Year Study
ISEF · 2015
The Exchange iMproving Unit: An Auditory Device for Directional Filtering
Closest projects by meaning, across every fair and year in the corpus.
Browse more like this
Source: California Science & Engineering Fair public projects