BeatBox: End-user Interactive Definition and Training of Recognizers for Percussive Vocalizations

Hipke, Kyle; Toomim, Michael; Fiebrink, Rebecca and Fogarty, James. 2014. 'BeatBox: End-user Interactive Definition and Training of Recognizers for Percussive Vocalizations'. In: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces. Como, Italy 27-29 May 2014. [Conference or Workshop Item]

HipkeToomimFiebrinkFogarty_AVI2014 (2).pdf

Download (240kB) | Preview

Abstract or Description

Interactive end-user training of machine learning systems has received significant attention as a tool for personalizing recognizers. However, most research limits end users to training a fixed set of application-defined concepts. This paper considers additional challenges that arise in end-user support for defining the number and nature of concepts that a system must learn to recognize. We develop BeatBox, a new system that enables end-user creation of custom beatbox recognizers and interactive adaptation of recognizers to an end user’s technique, environment, and musical goals. BeatBox proposes rapid end-user exploration of variations in the number and nature of learned concepts, and provides end users with feedback on the reliability of recognizers learned for different potential combinations of percussive vocalizations. In a preliminary evaluation, we observed that end users were able to quickly create usable classifiers, that they explored different combinations of concepts to test alternative vocalizations and to refine classifiers for new musical contexts, and that learnability feedback was often helpful in alerting them to potential difficulties with a desired learning concept.

Item Type:

Conference or Workshop Item (Paper)

Identification Number (DOI):


Interactive machine learning, intelligent user interfaces, music

Departments, Centres and Research Units:

Computing > Embodied AudioVisual Interaction Group (EAVI)


27 May 2014Published

Event Location:

Como, Italy

Date range:

27-29 May 2014


Funding bodyFunder IDGrant Number
National Science Foundation (USA)UNSPECIFIED

Item ID:


Date Deposited:

22 Mar 2016 09:26

Last Modified:

29 Apr 2020 16:16


View statistics for this item...

Edit Record Edit Record (login required)