Organizing a sonic space through vocal imitationsWeisberg Division of Computer Science Faculty Research
AbstractA two-dimensional space is proposed for exploration and interactive design in the sonic space of a sound model. A number of reference items, positioned as landmarks in the space, contain both a synthetic sound and its vocal imitation, and the space is geometrically arranged based on the acoustic features of these imitations. The designer may specify new points in the space either by geometric interpolation or by direct vocalization. In order to understand how the vast and complex space of the human voice could be organized in two dimensions, we collected a database of short excerpts of vocal imitations. By clustering the sound samples on a space whose dimensionality has been reduced to the two principal components, it has been experimentally checked how meaningful the resulting clusters are for humans. The procedure of dimensionality reduction and clustering is demonstrated in the case of imitations of engine sounds, giving access to the sonic space of a motor sound model.
Citation InformationD. Rocchesso, D., Mauro, D.A., Drioli C. “Organizing a sonic space through vocal imitations." Journal of the Audio Engineering Society vol. 64, no. 7/8, 2016, 474-483. doi: 10.17743/jaes.2016.0026