Interactive Machine Learning for More Expressive Game Interactions

Diaz, Carlos Gonzales; Perry, Phoenix and Fiebrink, Rebecca. 2019. 'Interactive Machine Learning for More Expressive Game Interactions'. In: IEEE Conference on Games. London, United Kingdom 20-23 August 2019. [Conference or Workshop Item]

DiazPerryFiebrink_IEEE_COG.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial.

Download (183kB) | Preview

Abstract or Description

Videogame systems incorporate varied sensors to increase the range of player interactions and improve player experience. However, implementing robust recognisers for player actions with sensors presents significant challenges to developers. Further, sensor-based controls offer little player customisation compared to traditional input interfaces (gamepads, keyboards and joysticks). Past research on motion-driven music systems has successfully used interactive machine learning (IML) techniques to facilitate the development and customisation of sensor-based interfaces, both by developers and end users. However, existing standalone software tools for IML are not ideal for use in game development and distribution. In order to support more effective and flexible use of sensors by game developers and players, we developed an integrated IML solution for Unity3D in the form of a visual node system supporting classification, regression and time series analysis of sensor data.

Item Type:

Conference or Workshop Item (Poster)

Additional Information:

This research was supported by the Artist + Machine Intelligence
(AMI) Focused Research Awards, funded by Google
Arts and Culture.

“© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.”

Related URLs:

Departments, Centres and Research Units:

Computing > Embodied AudioVisual Interaction Group (EAVI)


5 June 2019Accepted

Event Location:

London, United Kingdom

Date range:

20-23 August 2019

Item ID:


Date Deposited:

29 Jul 2019 13:20

Last Modified:

10 Jun 2021 05:55


View statistics for this item...

Edit Record Edit Record (login required)