Hierarchically nested networks optimize the analysis of audiovisual speech

Chalas, Nikos; Omigie, Diana; Poeppel, David and van Wassenhove, Virginie. 2023. Hierarchically nested networks optimize the analysis of audiovisual speech. iScience, 26(3), 106257. ISSN 2589-0042 [Article]

1-s2.0-S2589004223003346-main.pdf - Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (4MB) | Preview

Abstract or Description

In conversational settings, seeing the speaker’s face elicits internal predictions about the upcoming acoustic utterance. Understanding how the listener’s cortical dynamics tune to the temporal statistics of audiovisual (AV) speech is thus essential. Using magnetoencephalography, we explored how large-scale frequency-specific dynamics of human brain activity adapt to AV speech delays. First, we show that the amplitude of phase-locked responses parametrically decreases with natural AV speech synchrony, a pattern that is consistent with predictive coding. Second, we show that the temporal statistics of AV speech affect large-scale oscillatory networks at multiple spatial and temporal resolutions. We demonstrate a spatial nestedness of oscillatory networks during the processing of AV speech: these oscillatory hierarchies are such that high-frequency activity (beta, gamma) is contingent on the phase response of low-frequency (delta, theta) networks. Our findings suggest that the endogenous temporal multiplexing of speech processing confers adaptability within the temporal regimes that are essential for speech comprehension.

Item Type:


Identification Number (DOI):


Departments, Centres and Research Units:



17 February 2023Accepted
6 March 2023Published Online
March 2023Published

Item ID:


Date Deposited:

21 Mar 2023 10:01

Last Modified:

21 Mar 2023 10:07

Peer Reviewed:

Yes, this version has been peer-reviewed.



View statistics for this item...

Edit Record Edit Record (login required)