A View of Music
Ellen Gethner, Shannon Steinmetz, and Joseph Verbeke

Proceedings of Bridges 2015: Mathematics, Music, Art, Architecture, Culture
Pages 289–294
Regular Papers

Abstract

Inspired by the idea of synesthesia, or the intermingling of senses [10], we have developed an algorithm that transforms raw sound into a pictographic representation using the physics of a signal. We apply our method to music, the outcome of which is an animation that is not only synchronized with the music, but that mimics aspects of the music itself. We discuss the results of our concept and an implementation, which includes illustrations provided from a variety of music sources. As well, we provide our current parameterization technique and discuss the internal behaviors. We close with a discussion of perception, consonance, and dissonance, and a road-map for future work.

Files