Mapping Through Listening

Caramiaux, Baptiste; Françoise, Jules; Schnell, Norbert and Bevilacqua, Frédéric. 2014. Mapping Through Listening. Computer Music Journal, 38(3), pp. 34-48. ISSN 0148-9267 [Article]

[img]
Preview
Text
caramiaux2014mapping.pdf - Accepted Version

Download (816kB) | Preview

Abstract or Description

Gesture-to-sound mapping is generally defined as the association between gestural and sound parameters. This article describes an approach that brings forward the perception-action loop as a fundamental design principle for gesture–sound mapping in digital music instrument. Our approach considers the processes of listening as the foundation – and the first step – in the design of action-sound relationships. In this design process, the relationship between action and sound is derived from actions that can be perceived in the sound. Building on previous works on listening modes and gestural descriptions we proposed to distinguish between three mapping strategies: instantaneous, temporal, and metaphoric. Our approach makes use of machine learning techniques for building prototypes, from digital music instruments to interactive installations. Four different examples of scenarios and prototypes are described and discussed.

Item Type:

Article

Identification Number (DOI):

https://doi.org/10.1162/COMJ_a_00255

Departments, Centres and Research Units:

Computing > Embodied AudioVisual Interaction Group (EAVI)
Computing

Dates:

DateEvent
October 2014Published

Item ID:

11195

Date Deposited:

21 Jan 2015 21:12

Last Modified:

29 Apr 2020 16:05

Peer Reviewed:

Yes, this version has been peer-reviewed.

URI:

https://research.gold.ac.uk/id/eprint/11195

View statistics for this item...

Edit Record Edit Record (login required)