Music of the 7Ts: Predicting and Decoding Multivoxel fMRI Responses with Acoustic, Schematic, and Categorical Music Features

Casey, Michael A.. 2017. Music of the 7Ts: Predicting and Decoding Multivoxel fMRI Responses with Acoustic, Schematic, and Categorical Music Features. Frontiers in Psychology, 8, 1179. ISSN 1664-1078 [Article]

[img]
Preview
Text
fpsyg-08-01179.pdf - Published Version
Available under License Creative Commons Attribution.

Download (2MB) | Preview

Abstract or Description

Underlying the experience of listening to music are parallel streams of auditory, categorical, and schematic qualia, whose representations and cortical organization remain largely unresolved. We collected high-field (7T) fMRI data in a music listening task, and analyzed the data using multivariate decoding and stimulus-encoding models. Twenty subjects participated in the experiment, which measured BOLD responses evoked by naturalistic listening to twenty-five music clips from five genres. Our first analysis applied machine classification to the multivoxel patterns that were evoked in temporal cortex. Results yielded above-chance levels for both stimulus identification and genre classification–cross-validated by holding out data from multiple of the stimuli during model training and then testing decoding performance on the held-out data. Genre model misclassifications were significantly correlated with those in a corresponding behavioral music categorization task, supporting the hypothesis that geometric properties of multivoxel pattern spaces underlie observed musical behavior. A second analysis employed a spherical searchlight regression analysis which predicted multivoxel pattern responses to music features representing melody and harmony across a large area of cortex. The resulting prediction-accuracy maps yielded significant clusters in the temporal, frontal, parietal, and occipital lobes, as well as in the parahippocampal gyrus and the cerebellum. These maps provide evidence in support of our hypothesis that geometric properties of music cognition are neurally encoded as multivoxel representational spaces. The maps also reveal a cortical topography that differentially encodes categorical and absolute-pitch information in distributed and overlapping networks, with smaller specialized regions that encode tonal music information in relative-pitch representations.

Item Type:

Article

Identification Number (DOI):

https://doi.org/10.3389/fpsyg.2017.01179

Keywords:

multivariate, fMRI, naturalistic, music-informatics, stimulus-encoding, genre, melody, harmony

Departments, Centres and Research Units:

Computing

Dates:

DateEvent
14 July 2017Published Online
28 June 2017Accepted

Item ID:

24664

Date Deposited:

23 Oct 2018 16:17

Last Modified:

03 Aug 2021 15:05

Peer Reviewed:

Yes, this version has been peer-reviewed.

URI:

https://research.gold.ac.uk/id/eprint/24664

View statistics for this item...

Edit Record Edit Record (login required)