A Multimodal Way of Experiencing and Exploring Music
Source: Interdisciplinary Science Reviews, Volume 35, Number 2, June 2010 , pp. 138-153(16)
Publisher: Maney Publishing
Abstract:Significant digitization efforts have resulted in large multimodal music collections, which comprise music-related documents of various types and formats including text, symbolic data, audio, image, and video. The challenge is to organize, understand, and search musical content in a robust, efficient, and intelligent manner. Key issues concern the development of methods for analysing, correlating, and annotating the available multimodal material, thus identifying and establishing semantic relationships across various music representations and formats. Here, one important task is referred to as music synchronization, which aims at identifying and linking semantically corresponding events present in different versions of the same underlying musical work. In this paper, we give an introduction to music synchronization and show how synchronization techniques can be integrated into novel user interfaces that allow music lovers and researchers to access and explore music in all its different facets thus enhancing human involvement with music and deepening music understanding.
Document Type: Research Article
Affiliations: 1: Saarland University and MPI Informatik, Saarbrücken, Germany;, Email: email@example.com 2: Saarland University and MPI Informatik, Saarbrücken, Germany 3: Department of Computer Science, Bonn University, Germany
Publication date: 2010-06-01