Sound meets image: Freedom of expression in texture description

Sound meets image: Freedom of expression in texture description

Jansen, R.J.
Van Egmond, R.
De Ridder, H.

Industrial Design Engineering

Industrial Design

2012-12-31

The use of sound was explored as means for expressing perceptual attributes of visual textures. Two sets of 17 visual textures were prepared: one set taken from the CUReT database1, and one set synthesized to replicate the former set. Participants were instructed to match a sound texture with a visual texture displayed onscreen. A modified version of a Product Sound Sketching Tool2 was provided, in which an interactive physical interface was coupled to a frequency modulation synthesizer. Rather than selecting from a pre-defined set of sound samples, continuous exploration of the auditory space allowed for an increased freedom of expression. While doing so, participants were asked to describe what auditory and visual qualities they were paying attention to. It was found that participants were able to create sounds that matched visual textures. Based on differences in diversity of descriptions, synthetic textures were found to have less salient perceptual attributes than their original counterparts. Finally, three interesting sound synthesis clusters were found, corresponding with mutually exclusive description vocabularies

textures
expressivity
free labeling
CUReT database
frequency-modulated sounds

http://resolver.tudelft.nl/uuid:0f27c9dc-ed37-4c14-9955-89e3affbb93c

https://doi.org/10.1117/12.914698

SPIE (International Society for Optical Engineering)

9780819489388

Proceedings of SPIE, 2012 vol. 8291

Institutional Repository

book chapter

(c) 2012 The Authors, SPIE