Hierarchically nested networks optimize the analysis of audiovisual speech

Tools

Chalas, Nikos; Omigie, Diana; Poeppel, David and van Wassenhove, Virginie. 2023. Hierarchically nested networks optimize the analysis of audiovisual speech. iScience, 26(3), 106257. ISSN 2589-0042 [Article]

Preview

Text
1-s2.0-S2589004223003346-main.pdf - Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.
Download (4MB) | Preview

Official URL: https://doi.org/10.1016/j.isci.2023.106257

Abstract or Description

In conversational settings, seeing the speaker’s face elicits internal predictions about the upcoming acoustic utterance. Understanding how the listener’s cortical dynamics tune to the temporal statistics of audiovisual (AV) speech is thus essential. Using magnetoencephalography, we explored how large-scale frequency-specific dynamics of human brain activity adapt to AV speech delays. First, we show that the amplitude of phase-locked responses parametrically decreases with natural AV speech synchrony, a pattern that is consistent with predictive coding. Second, we show that the temporal statistics of AV speech affect large-scale oscillatory networks at multiple spatial and temporal resolutions. We demonstrate a spatial nestedness of oscillatory networks during the processing of AV speech: these oscillatory hierarchies are such that high-frequency activity (beta, gamma) is contingent on the phase response of low-frequency (delta, theta) networks. Our findings suggest that the endogenous temporal multiplexing of speech processing confers adaptability within the temporal regimes that are essential for speech comprehension.

Item Type:

Article

Identification Number (DOI):

https://doi.org/10.1016/j.isci.2023.106257