Go to page
 

Bibliographic Metadata

Title
Quantifying gesture-speech synchrony / Wim Pouw and James A. Dixon
AuthorPouw, Wim ; Dixon, James A.
Published in
Proceedings of the 6th Gesture and Speech in Interaction Conference, page 75-80
PublishedPaderborn : Universitätsbibliothek, 2019
Edition
Elektronische Ressource
Description1 Online-Ressource (7 Seiten) : Diagramme
LanguageEnglish
Document TypesScientific Article (Published Electronically)
URNurn:nbn:de:hbz:466:2-35733 
DOI10.17619/UNIPB/1-815 
Files
Quantifying gesture-speech synchrony [0.72 mb]
Links
Reference
Classification
Abstract (English)

Spontaneously occurring speech is often seamlessly accompanied by hand gestures. Detailedobservations of video data suggest that speech and gesture are tightly synchronized in time,consistent with a dynamic interplay between body and mind. However, spontaneous gesturespeechsynchrony has rarely been objectively quantified beyond analyses of video data, whichdo not allow for identification of kinematic properties of gestures. Consequently, the point ingesture which is held to couple with speech, the so-called moment of “maximum effort”, hasbeen variably equated with the peak velocity, peak acceleration, peak deceleration, or the onsetof the gesture. In the current exploratory report, we provide novel evidence from motiontrackingand acoustic data that peak velocity is closely aligned, and shortly leads, the peak pitch(F0) of speech.

License
CC-BY-License (4.0)Creative Commons Attribution 4.0 International License