TY - BOOK AB - When verbs of motion are accompanied by gestures, this comes along with a relatively complex relation between the two modalities. In this paper, we investigate the semantic coordination of speech and event-related gestures in an interdisciplinary way. First, we explain how to efficiently construct a speech-gesture-interface for a gesture which accompanies a verb phrase from a theoretical viewpoint. Resting upon this analysis, we also provide a computational simulation model which further explicates the relation between the two modalities based on activation-spreading within dynamically shaped multi-modal memories. DA - 2013 KW - Interdisciplinary methodology KW - Computational simulation KW - Speech-gesture interface KW - Iconic gestures KW - Event-related gestures KW - Gesture semantics KW - Theoretical reconstruction LA - eng PY - 2013 TI - Integrating Gesture Meaning and Verbal Meaning for German Verbs of Motion: Theory and Simulation UR - https://nbn-resolving.org/urn:nbn:de:0070-pub-25791089 Y2 - 2024-11-22T00:30:26 ER -