Influence of language on perception and concept formation in a brain-constrained deep neural network model

Henningsen-Schomers, Malte R.; Garagnani, Max and Pulvermüller, Friedemann. 2022. Influence of language on perception and concept formation in a brain-constrained deep neural network model. Philosophical Transactions of the Royal Society B: Biological Sciences, ISSN 0962-8436 [Article] (In Press)

No full text available
[img] Text
RSTB-2021-0373.R2_Proof_hi[2].pdf - Accepted Version
Permissions: Administrator Access Only until 26 December 2022.
Available under License Creative Commons Attribution.

Download (2MB)

Abstract or Description

A neurobiologically constrained model of semantic learning in the human brain was used to simulate the acquisition of concrete and abstract concepts, either with or without verbal labels. Concept acquisition and semantic learning were simulated using Hebbian learning mechanisms. We measured the network’s category learning performance, defined as the extent to which it successfully (i) grouped partly overlapping perceptual instances into a single (abstract or concrete) conceptual representation, while (ii) still distinguishing representations for distinct concepts. Co-presence of linguistic labels with perceptual instances of a given concept generally improved the network’s learning of categories, with a significantly larger beneficial effect for abstract than concrete concepts. These results offer a neurobiological explanation for causal effects of language structure on concept formation and on perceptuo-motor processing of instances of these concepts: supplying a verbal label during concept acquisition improves the cortical mechanisms by which experiences with objects and actions along with the learning of words lead to the formation of neuronal ensembles for specific concepts and meanings. Furthermore, the present results make a novel prediction, namely, that such “Whorfian” effects should be modulated by the concreteness/abstractness of the semantic categories being acquired, with language labels supporting the learning of abstract concepts more than that of concrete ones.

Item Type:

Article

Identification Number (DOI):

https://doi.org/10.1098/rstb.2021.0373

Additional Information:

The datasets supporting this article are available at: https://osf.io/eqhx3/

This work was supported by Freie Universität Berlin, Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) through the grant ‘The Sound of Meaning, SOM’ (DFG Pu 97/22-1) and under Germany´s Excellence Strategy through the Cluster of Excellence “Matters of Activity. Image Space Material” (DFG EXC 2025/1 – 390648296), and by the European Research Council (ERC) through the Advanced Grant ‘Material constraints enabling human cognition, MatCo’ (ERC-2019-ADG 883811).

Keywords:

concepts, linguistic relativity, cognition, Hebbian learning, neurocomputational modelling, deep neural networks

Departments, Centres and Research Units:

Computing

Dates:

DateEvent
8 September 2022Accepted
26 December 2022Published Online

Item ID:

32227

Date Deposited:

27 Sep 2022 08:56

Last Modified:

05 Oct 2022 16:02

Peer Reviewed:

Yes, this version has been peer-reviewed.

URI:

https://research.gold.ac.uk/id/eprint/32227

View statistics for this item...

Edit Record Edit Record (login required)