TY  - JOUR
AB  - A number of studies have highlighted the coordination of gesture and intonation (Bolinger,1983; Darwin, 1872; Cruttenden, 1997; Balog & Brentari, 2008; Roustan & Dohen, 2010) butthe technological set-ups have been insufficient to couple the acoustic and gestural data withsufficient detail. In this paper, we present the MODALISA platform which enables languagespecialists to integrate gesture, intonation, speech production and content. The methods of dataacquisition, annotation and analysis are detailed. The preliminary results of our pilot studyillustrate strong correlations between gestures and intonation when they are simultaneouslyperformed by the speaker. The correlations are particularly strong for proximal segments. Ouraim is to expand those results and analyse typical and atypical populations across the lifespan.
AU  - Dodane, Christelle
AU  - Boutet, Dominique
AU  - Didirkova, Ivana
AU  - Hirsch, Fabrice
AU  - Ouni, Slim
AU  - Morgenstern, Aliyah
DA  - 2019
DO  - 10.17619/UNIPB/1-804
PB  - Universitätsbibliothek
DP  - Universität Paderborn
LA  - eng
M2  - 27
PY  - 2019
SP  - 27-33
T2  - Proceedings of the 6th Gesture and Speech in Interaction Conference
TI  - An integrative platform to capture the orchestration of gesture and speech
UR  - https://nbn-resolving.org/urn:nbn:de:hbz:466:2-35623
Y2  - 2026-01-13T01:15:53
ER  -