Comparative analysis of orchestral performance recordings: An image-based approach

Comparative analysis of orchestral performance recordings: An image-based approach

Liem, C.C.S.
Hanjalic, A.

Electrical Engineering, Mathematics and Computer Science

Intelligent Systems

2015-10-20

Traditionally, the computer-assisted comparison of multiple performances of the same piece focused on performances on single instruments. Due to data availability, there also has been a strong bias towards analyzing piano performances, in which local timing, dynamics and articulation are important expressive performance features. In this paper, we consider the problem of analyzing multiple performances of the same symphonic piece, performed by different orchestras and different conductors. While differences between interpretations in this genre may include commonly studied features on timing, dynamics and articulation, the timbre of the orchestra and choices of balance within the ensemble are other important aspects distinguishing different orchestral interpretations from one another. While it is hard to model these higher-level aspects as explicit audio features, they can usually be noted visually in spectrogram plots. We therefore propose a method to compare orchestra performances by examining visual spectrogram characteristics. Inspired by eigenfaces in human face recognition, we apply Principal Components Analysis on synchronized performance fragments to localize areas of cross-performance variation in time and frequency. We discuss how this information can be used to examine performer differences, and how beyond pairwise comparison, relative differences can be studied between multiple performances in a corpus at once.

http://resolver.tudelft.nl/uuid:5d3c9b08-4ad3-4cc7-bf00-463d02ce6a5d

IEEE

987-84-606-8853-2

Proceedings of the 16th International Society for Music Information Retrieval Conference, ISMIR 2015, Malaga, Spain, October 26-20, 2015. Eds. Muller, M., Wiering, F.

Institutional Repository

conference paper

(c) The Author(s)
CC BY 4.0