Go to page

Bibliographic Metadata

Synchronization of (dis)fluent speech and gesture: a multimodal approach to (dis)fluency / Loulou Kosmala, Maria Candea, and Aliyah Morgenstern
AuthorKosmala, Loulou ; Candea, Maria ; Morgenstern, Aliyah
Published in
Proceedings of the 6th Gesture and Speech in Interaction Conference, page 56-61
PublishedPaderborn : Universitätsbibliothek, 2019
Elektronische Ressource
Description1 Online-Ressource (7 Seiten) : Illustrationen
Document TypesScientific Article (Published Electronically)
Synchronization of (dis)fluent speech and gesture: a multimodal approach to (dis)fluency [0.42 mb]
Abstract (English)

Disfluency is verbally expressed by several markers (filled, unfilled pauses, repetitions, selfrepairs,etc). This study is grounded in the functionally ambivalent view of (Dis)fluencyfollowing Crible, (2017) and Götz (2013), but with a multimodal and interactional approach.Previous research has shown a coordination between speech and gesture suspension (Gullberg,2013, 2018; Seyfedinnipur 2006). The aim of our paper is thus to examine how (dis)fluentspeech and gestures can be synchronized, and how visual-gestural features can provide a finerunderstanding of (dis)fluency. Our analyses are conducted on 3 pairs of French and Americanspeakers interacting both in their L1 and their L2. (Dis)fluency markers were annotatedaccording to their multimodal features. Qualitative analyses revealed how the notions of timesuspension and planning associated with (dis)fluency were also found in gesture. This stronglysupports the idea that (dis)fluency is to be considered a multimodal phenomenon, and its visualcues are essential for a closer examination of its pragmatic functions.

CC-BY-License (4.0)Creative Commons Attribution 4.0 International License