From GUI to AVUI: Situating Audiovisual User Interfaces Within Human-Computer Interaction and Related Fields

Correia, Nuno N. and Tanaka, Atau. 2021. From GUI to AVUI: Situating Audiovisual User Interfaces Within Human-Computer Interaction and Related Fields. EAI Endorsed Transactions on Creative Technologies, 8(27), e5. ISSN 2409-9708 [Article]

[img]
Preview
Text
Correia and Tanaka - 2021 - From GUI to AVUI Situating Audiovisual User Inter.pdf - Published Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview

Abstract or Description

INTRODUCTION: We propose AudioVisual User Interfaces (AVUI), a novel type of UI linking interaction, sound and image. It extends the concept of Graphical User Interface (GUI) by adding interconnected sound and image.
OBJECTIVES: We aim to situate AVUIs in relation to identified relevant fields: Human-Computer Interaction (HCI), sonic interaction design, cognitive psychology and audiovisual art, and to identify benefits of AVUIs in the context of those fields.
METHODS: In this research, we combine literature review of related concepts with a user-centered design methodology, involving a community of audiovisual artists and performers.
RESULTS: We contextualize AVUI within the identified fields and identify benefits for the implementation of AVUIs in relation to those fields.
CONCLUSION: These results can contribute to the further adoption of AVUIs by the HCI community, particularly those interested in multisensory experience involving sound and image.

Item Type:

Article

Identification Number (DOI):

https://doi.org/10.4108/eai.12-5-2021.169913

Keywords:

user interface, toolkit, interface builder, audiovisual, cross-modal interaction

Departments, Centres and Research Units:

Computing > Embodied AudioVisual Interaction Group (EAVI)

Dates:

DateEvent
12 May 2021Published
8 May 2021Accepted

Item ID:

30071

Date Deposited:

13 May 2021 09:46

Last Modified:

03 Aug 2021 15:03

Peer Reviewed:

Yes, this version has been peer-reviewed.

URI:

https://research.gold.ac.uk/id/eprint/30071

View statistics for this item...

Edit Record Edit Record (login required)