Interactive Machine Learning for Embodied Interaction Design: A Tool and Methodology

Plant, Nicola; Hilton, Clarice; Gillies, Marco; Fiebrink, Rebecca; Perry, Phoenix; González Díaz, Carlos; Gibson, Ruth; Martelli, Bruno and Zbyszynski, Michael. 2021. 'Interactive Machine Learning for Embodied Interaction Design: A Tool and Methodology'. In: Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’21). Salzburg, Austria 14–17 February 2021. [Conference or Workshop Item]

tei21-68.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial.

Download (476kB) | Preview

Abstract or Description

As immersive technologies are increasingly being adopted by artists, dancers and developers in their creative work, there is a demand for tools and methods to design compelling ways of embodied interaction within virtual environments. Interactive Machine Learning allows creators to quickly and easily implement movement interaction in their applications by performing examples of movement to train a machine learning model. A key aspect of this training is providing appropriate movement data features for a machine learning model to accurately characterise the movement then recognise it from incoming data. We explore methodologies that aim to support creators’ understanding of movement feature data in relation to machine learning models and ask how these models hold the potential to inform creators’ understanding of their own movement. We propose a 5-day hackathon, bringing together artists, dancers and designers, to explore designing movement interaction and create prototypes using new interactive machine learning tool InteractML.

Item Type:

Conference or Workshop Item (Other)

Identification Number (DOI):


interactive machine learning, immersive media, performance, movement interaction

Departments, Centres and Research Units:



December 2020Accepted
14 February 2021Published

Event Location:

Salzburg, Austria

Date range:

14–17 February 2021

Item ID:


Date Deposited:

16 Nov 2021 13:56

Last Modified:

16 Nov 2021 14:08


View statistics for this item...

Edit Record Edit Record (login required)