A View of Music

Ellen Gethner, Shannon Steinmetz and Joseph Verbeke
Proceedings of Bridges 2015: Mathematics, Music, Art, Architecture, Culture (2015)
Pages 289–294 Regular Papers


Inspired by the idea of synesthesia, or the intermingling of senses [10], we have developed an algorithm that transforms raw sound into a pictographic representation using the physics of a signal. We apply our method to music, the outcome of which is an animation that is not only synchronized with the music, but that mimics aspects of the music itself. We discuss the results of our concept and an implementation, which includes illustrations provided from a variety of music sources. As well, we provide our current parameterization technique and discuss the internal behaviors. We close with a discussion of perception, consonance, and dissonance, and a road-map for future work.