TY  - JOUR
AB  - Extant accounts of visually situated language processing do make general predictions about visual context effects on incremental sentence comprehension; these, however, are not sufficiently detailed to accommodate potentially different visual context effects (such as a scene-sentence mismatch based on actions versus thematic role relations, e.g., (Altmann & Kamide, 2007; Knoeferle & Crocker, 2007; Taylor & Zwaan, 2008; Zwaan & Radvansky, 1998)). To provide additional data for theory testing and development, we collected event-related brain potentials (ERPs) as participants read a subject-verb-object sentence (500 ms SOA in Experiment 1 and 300 ms SOA in Experiment 2), and post-sentence verification times indicating whether or not the verb and/or the thematic role relations matched a preceding picture (depicting two participants engaged in an action). Though incrementally processed, these two types of mismatch yielded different ERP effects. Role-relation mismatch effects emerged at the subject noun as anterior negativities to the mismatching noun, preceding action mismatch effects manifest as centro-parietal N400s greater to the mismatching verb, regardless of SOAs. These two types of mismatch manipulations also yielded different effects post-verbally, correlated differently with a participant's mean accuracy, verbal working memory and visual-spatial scores, and differed in their interactions with SOA. Taken together these results clearly implicate more than a single mismatch mechanism for extant accounts of picture-sentence processing to accommodate. (C) 2014 Elsevier B.V. All rights reserved.
DA  - 2014
DO  - 10.1016/j.actpsy.2014.08.004
KW  - Situated language processing accounts
KW  - Sentence-picture verification
KW  - Visual context effects
KW  - Event-related brain potentials
LA  - eng
M2  - 133
PY  - 2014
SN  - 0001-6918
SP  - 133-148
T2  - Acta Psychologica
TI  - Different mechanisms for role relations versus verb-action congruence effects: Evidence from ERPs in picture-sentence verification
UR  - https://nbn-resolving.org/urn:nbn:de:0070-pub-26893953
Y2  - 2024-11-21T21:41:14
ER  -