figshare
Browse
1/2
35 files

Modality switch effects emerge early and increase throughout conceptual processing: Evidence from ERPs

Version 201 2019-03-03, 19:10
Version 200 2019-02-05, 18:42
Version 199 2018-10-13, 15:03
Version 198 2018-01-18, 18:25
Version 197 2017-11-09, 19:47
Version 196 2017-11-02, 21:05
Version 195 2017-11-02, 20:52
Version 194 2017-10-22, 13:40
Version 193 2017-10-21, 15:10
Version 192 2017-10-20, 08:13
Version 191 2017-10-19, 16:58
Version 190 2017-10-19, 06:36
Version 189 2017-10-19, 06:14
Version 188 2017-10-17, 23:40
Version 187 2017-10-16, 06:31
Version 186 2017-10-16, 06:21
Version 185 2017-10-16, 06:20
Version 184 2017-09-03, 20:58
Version 183 2017-09-02, 23:07
Version 182 2017-09-02, 23:04
dataset
posted on 2019-03-03, 19:10 authored by Pablo BernabeuPablo Bernabeu, Roel M Willems, Max M Louwerse

Files: poster, paper, design overview, stimuli, EEG montage used, waveforms, window 1 close-ups, mean differences with 95% CIs, subtraction topographies, detailed waveforms, statistical results, fixed effects of final models, entire modelling, raw data. For best resolution, download file(s).

Abstract

We tested whether conceptual processing is modality-specific by tracking the time course of the Conceptual Modality Switch effect. Forty-six participants verified the relation between property words and concept words. The conceptual modality of consecutive trials was manipulated in order to produce an Auditory-to-visual switch condition, a Haptic-to-visual switch condition, and a Visual-to-visual, no-switch condition. Event-Related Potentials (ERPs) were time-locked to the onset of the first word (property) in the target trials so as to measure the effect online and to avoid a within-trial confound. A switch effect was found, characterised by more negative ERP amplitudes for modality switches than no-switches. It proved significant in three typical time windows from 270 to 750 milliseconds post word onset, with greater strength in the Slow group, in posterior brain regions, and in the N400 window. These results suggest that conceptual processing may be modality-specific in certain tasks, but also that the early stage of processing is relatively amodal.

References

Collins, J., Pecher, D., Zeelenberg, R., & Coulson, S. (2011). Modality switching in a property verification task: an ERP study of what happens when candles flicker after high heels click. Frontiers in Psychology, 2.

Hald, L. A., Marshall, J.-A., Janssen, D. P., & Garnham, A. (2011). Switching modalities in a sentence verification task: ERP evidence for embodied language processing. Frontiers in Psychology, 2.

Hauk, O. (2016). Only time will tell—Why temporal information is essential for our neuroscientific understanding of semantics. Psychonomic Bulletin & Review, 23.

Louwerse, M., & Connell, L. (2011). A taste of words: Linguistic context and perceptual simulation predict the modality of words. Cognitive Science, 35, 2, 381-98.

Mahon, B.Z., & Hickok, G. (2016). Arguments about the nature of concepts: Symbols, embodiment, and beyond. Psychonomic Bulletin & Review, 23, 941-958.

Find more information on these links:

- Interactive visualisation of waveforms in each data section (Shiny app).

- OSF archive with all data and code

- Paper in Proceedings of the 39th Annual Conference of the Cognitive Science Society

- Dashboard for using Dutch modality norms (336 properties, 411 concepts) and exploring various analyses with them

Bernabeu, P., Willems, R. M., & Louwerse, M. M. (2017). Modality switch effects emerge early and increase throughout conceptual processing: Evidence from ERPs. In G. Gunzelmann, A. Howes, T. Tenbrink, & E. J. Davelaar (Eds.), Proceedings of the 39th Annual Conference of the Cognitive Science Society (pp. 1629-1634). Austin, TX: Cognitive Science Society. https://doi.org/10.31234/osf.io/a5pcz

Funding

Neurobiology of Language dept at Max Planck Institute for Psycholinguistics; Psychonomic Society; Experimental Psychology Society; Cognitive Science Society; Tilburg University.

History