Sonification: A Novel Approach to Data Representation, Year Two
CSEF · 2012 Behavioral & Social Sciences Honorable_mention Award
Overview
Objectives/Goals As technology flourishes, the production of copious amounts of multidimensional data has revealed limitations in visual forms of data representation. Due to these limitations, novel forms of data representation, such as sonification, have emerged. Sonification conveys information through non-speech audio. Before it can be implemented, however, sonification must be further investigated in order to ensure that the methods used rest upon a solid scientific foundation. The purpose of this project is to investigate the parameter within parameter-mapping sonification that most improves understanding of sonified data as well as the effect of culture on one's ability to interpret multiple streams of data. Along with these two variables, the experiment seeks to determine the highest number of data channels a person can accurately track using the specific sonification methods and sound waves of the experiment. Methods/Materials Of the different methods of parameter-mapping sonification, rhythm and frequency (pitch), as well as a combination of the two, were compared. The effect of the familiarity of sounds was considered by comparing instrument sound with synthetic sounds. Finally, subjects were tested using 2, 4, 6, and 8 data streams. An online survey was launched to gather data. The survey asked subjects to listen to sound clips and answer multiple choice questions based on the sound clips. Results Data analysis showed that the "frequency" and "combination" method of sonification facilitated the differentiation and comprehension of multiple data streams more than the "tipping bucket" method (rhythm), that culture did not significantly impact one#s ability to understand sonified data, and that the trials with 6 streams produced the most accurate responses. Conclusions/Discussion The "tipping bucket" method of sonification most likely decreased performance in comparison to "frequency" and "combination" due to auditory masking, and the "synthetic" and "instrument" sounds probably performed equally well due to the presence of synthetic sounds in contemporary music.
Summary statement
The project focuses on the psychoacoustics branch of sonification, specifically, the differentiation of multiple data streams.
Help received
Mr. Joachim Gossmann and Ms. Wendy Slijk advised me; Dr. Tzyy-ping Jung gave me the numbers I sonified to create sound files for the experiment.
Awards (1)
- Honorable Mention
Competition history
- CSEF 2012
Resources
Related projects
CSEF · 2011
Sonification: A Novel Approach to Data Representation
CSEF · 2009
Discovering the Color Spectrum of Sound
CSEF · 2010
Musicians' Perceptions of a "Rhythmic" Variation on the McGurk Effect
CSEF · 2006
Do You Hear What I Hear?
CSEF · 2015
Effects of Inaudible Sounds on Memory Performance
ISEF · 2024
Celestial Symphony: MIDI Sonification of Multiparametric Supernova Data Into a Euphonious Composition
CSEF · 2013
The Correlation of Harmony and Dissonance in Color and Sound
CSEF · 2002
Music Tests Involving Digital Instruments
Closest projects by meaning, across every fair and year in the corpus.
Browse more like this
Source: California Science & Engineering Fair public projects