Behavioural and neurophysiological evidence of semantic interaction between iconic gestures and words

Authors: Bernardis, Paolo¹; Salillas, Elena²; Caramelli, Nicoletta³

Source: Cognitive Neuropsychology, Volume 25, Numbers 7-8, February 2008 , pp. 1114-1128(15)

Publisher: Psychology Press, part of the Taylor & Francis Group

Buy & download fulltext article:

Price: $50.43 plus tax (Refund Policy)

Abstract:

We report two experiments that provide converging behavioural and neurophysiological evidence on the relationship between the meaning of iconic gestures and words. Experiment 1 exploited a semantic priming paradigm and revealed interference between gestures and words when they were not related in meaning, but no facilitation when they were. This result was confirmed in Experiment 2, where ERPs were recorded during silent word reading with the same paradigm. The analysis showed a negative deflection peaking near 400 ms (N400) and, in the left hemisphere, greater negative values for verbs than for nouns. Differently from the classical distribution obtained with verbal stimuli, we found an N400 that spread more over central-anterior areas of the scalp, suggesting that the meaning systems of gesture and language do not overlap completely. These results are consistent with the view that the meaning systems for gesture and speech are tightly integrated.

Keywords: Gestures; Pantomimes; Nouns; Verbs; Semantic priming; Event-related potentials

Document Type: Research article

DOI: http://dx.doi.org/10.1080/02643290801921707

Affiliations: 1: Scuola Superiore di Studi Umanistici, Universita di Bologna, Bologna, Italy,Universita di Trieste, Trieste, Italy 2: Universita di Trieste, Trieste, Italy 3: Dipartimento di Psicologia, Universita di Bologna, Bologna, Italy

Publication date: 2008-02-01

More about this publication?