Silas, Sebastian; Müllensiefen, Daniel and Kopiez, Reinhard. 2024. Singing Ability Assessment: Development and validation of a singing test based on item response theory and a general open-source software environment for singing data. Behavior Research Methods, 56(5), pp. 4358-4384. ISSN 1554-351X [Article]

Preview

Text s13428-023-02188-0.pdf - Published Version Available under License Creative Commons Attribution. Download (1MB) | Preview

Abstract or Description

We describe the development of the Singing Ability Assessment (SAA) open-source test environment. The SAA captures and scores different aspects of human singing ability and melodic memory in the context of item response theory. Taking perspectives from both melodic recall and singing accuracy literature, we present results from two online experiments (N = 247; N = 910). On-the-fly audio transcription is produced via a probabilistic algorithm and scored via latent variable approaches. Measures of the ability to sing long notes indicate a three-dimensional principal components analysis solution representing pitch accuracy, pitch volatility and changes in pitch stability (proportion variance explained: 35%; 33%; 32%). For melody singing, a mixed-effects model uses features of melodic structure (e.g., tonality, melody length) to predict overall sung melodic recall performance via a composite score [R2c = .42; R2m = .16]. Additionally, two separate mixed-effects models were constructed to explain performance in singing back melodies in a rhythmic [R2c = .42; R2m = .13] and an arhythmic [R2c = .38; R2m = .11] condition. Results showed that the yielded SAA melodic scores are significantly associated with previously described measures of singing accuracy, the long note singing accuracy measures, demographic variables, and features of participants’ hardware setup. Consequently, we release five R packages which facilitate deploying melodic stimuli online and in laboratory contexts, constructing audio production tests, transcribing audio in the R environment, and deploying the test elements and their supporting models. These are published as open-source, easy to access, and flexible to adapt.

Item Type:	Article
Identification Number (DOI):	https://doi.org/10.3758/s13428-023-02188-0
Data Access Statement:	Data Availability The code and data associated with this paper can be found at the following Github repositories: https://github.com/sebsilas/ SAA_Paper_2022; https://github.com/sebsilas/SAA.
Keywords:	Singing test, Melodic memory, Similarity measurement, Music assessment, Melodic recall, Music psychology
Departments, Centres and Research Units:	Psychology
Dates:	Date Event 30 June 2023 Accepted 6 September 2023 Published Online August 2024 Published
Item ID:	34027
Date Deposited:	12 Sep 2023 09:15
Last Modified:	16 Sep 2024 09:53
Peer Reviewed:	Yes, this version has been peer-reviewed.
URI:	https://research.gold.ac.uk/id/eprint/34027

View statistics for this item...

Edit Record (login required)