HandMonizer: a case study for personalized digital musical instrument design

Lionetti, Davide; Pappas, Antonios; Comanducci, Luca; Bernardini, Alberto; Zanoni, Massimiliano; Sarti, Augusto; Yee-King, Matthew and d'Inverno, Mark. 2023. 'HandMonizer: a case study for personalized digital musical instrument design'. In: 4th International Symposium on the Internet of Sounds. Pisa, Italy 26-27 October 2023. [Conference or Workshop Item]

IS2_2023_one_woman_band.pdf - Accepted Version

Download (490kB) | Preview

Abstract or Description

The rapid evolution in technology has found its way to introducing novelty in today’s live music performances. In this context, the development of Digital Musical Instruments (DMIs) has obtained increasing attention in recent years. In this paper, we present the development of a DMI called Handmonizer, an interactive artist-oriented harmonizer for musical performance adapted to the needs of a specific singer. A key component of our work is the combination of hand motion recognition and audio signal processing to obtain a smoother interaction. We describe the development methodology, but we also focus on our collaboration with the artist to conceptualize and then refine this tool until the development of the final product. At the end of this paper, we define an evaluation strategy, collecting feedback with a questionnaire addressed to the singer. Our aim in presenting this evaluation strategy is to help other engineers keen to develop cutting-edge technologies by working in partnership with artists. While results are not definitive, we believe that the chosen methodology could be of interest to other DMI researchers. Moreover, the modular nature of the Handmonizer makes it easily adaptable to further developments concerning the Internet of Sounds (IoS) and Networked Music Performances (NMP).

Item Type:

Conference or Workshop Item (Paper)

Identification Number (DOI):


Additional Information:

“© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.”


Music interaction design, human-centered design, hand gesture recognition, vocal harmonizer, live performance

Departments, Centres and Research Units:



4 December 2023Published

Event Location:

Pisa, Italy

Date range:

26-27 October 2023

Item ID:


Date Deposited:

10 Jan 2024 10:36

Last Modified:

10 Jan 2024 15:36



View statistics for this item...

Edit Record Edit Record (login required)