Do Hand Gestures Increase Prominence in Naturally Produced Utterances?
Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Standard
Do Hand Gestures Increase Prominence in Naturally Produced Utterances? / Paggio, Patrizia; Vella, Alexandra; Mitterer, Holger; Attard, Greta.
I: Language and Cognition, 2023.Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - JOUR
T1 - Do Hand Gestures Increase Prominence in Naturally Produced Utterances?
AU - Paggio, Patrizia
AU - Vella, Alexandra
AU - Mitterer, Holger
AU - Attard, Greta
PY - 2023
Y1 - 2023
N2 - This study investigates the contribution of hand gestures to the perception of prominence in naturally occurring stimuli extracted from a multimodal corpus of Maltese conversations. Experiment participants had to rate the prominence of target words in sentences that were presented to them as audiovisual and audio-only stimuli. In half of the stimuli, the target word was accompanied by a co-speech hand gesture. The results of the experiment show that the presence of a co-speech gesture increases the perceived prominence of a target word. How- ever, although seeing the speaker produce the gesture increases the perceived prominence of the co-occurring word, it does not so in a statistically significant way. A post-hoc acoustic analysis of the data showed that on average, prominent words tend to have higher intensity when they are accompanied by gestures than when they are not. The study concludes that gestures may provide an additional but not necessary cue to prominence for the listener.
AB - This study investigates the contribution of hand gestures to the perception of prominence in naturally occurring stimuli extracted from a multimodal corpus of Maltese conversations. Experiment participants had to rate the prominence of target words in sentences that were presented to them as audiovisual and audio-only stimuli. In half of the stimuli, the target word was accompanied by a co-speech hand gesture. The results of the experiment show that the presence of a co-speech gesture increases the perceived prominence of a target word. How- ever, although seeing the speaker produce the gesture increases the perceived prominence of the co-occurring word, it does not so in a statistically significant way. A post-hoc acoustic analysis of the data showed that on average, prominent words tend to have higher intensity when they are accompanied by gestures than when they are not. The study concludes that gestures may provide an additional but not necessary cue to prominence for the listener.
M3 - Journal article
JO - Language and Cognition
JF - Language and Cognition
SN - 1866-9808
ER -
ID: 334399859