PROSODIC CHARACTERISTICS OF ACOUSTIC SIGNAL IN SERBIAN AND EMOTION RECOGNITION

Nikolina Kuruzović, Valentina Đorić, Ivana Novakov

DOI Number
https://doi.org/10.22190/FULL221206002K
First page
011
Last page
024

Abstract


The study focuses on the process of emotional recognition based on prosodic characteristics of acoustic signal in Serbian. Its main objective is to answer the question of the success of prosodic recognition of several emotions in Serbian. Furthermore, it explores whether the success in recognizing emotions in Serbian varies with regards to the following variables: the type of emotion, gender and the type of sentence. A total of 25 participants of average age around 23 participated in the study.  The data was created by using Praat software for speech analysis. The results show general success in recognizing emotions on the level of M=12.43 (SD= 6.11). The participants were the most successful in recognizing the emotion of happiness, and the least successful in recognizing sadness. Post hoc analysis found a statistically significant difference in recognizing happiness and emotions of the negative spectrum (sadness, boredom, anger and fear). The results are discussed from the point of social functions of emotions, as well as the characteristics of the affective prosody in Serbian, with recognition of inevitable methodological limitations.


Keywords

prosody, intonation, pitch, emotion recognition, Serbian, Praat program

Full Text:

PDF

References


Abdel-Hamid, Lamiaa. 2020. “Egyptian Arabic speech emotion recognition using prosodic, spectral and wavelet features.” Speech Communication 122: 19-30. https://doi.org/10.1016/j.specom.2020.04-005

Bąk, Halszka. 2016. Emotional prosody processing for non-native English speakers. Cham: Springer. https://doi.org/10.1007/978-3-319-44042-2_8

Bryant, Gregory A. 2020. “The evolution of human vocal emotion.” Emotion Review 13(1): 25-33. https://doi.org/10.1177%2F1754073920930791

Douglas-Cowie, Ellen, Nick Campbell, Roddy Cowie & Peter Roach. 2003. Emotional speech: Towards a new generation of database. Speech Communication, 40, 33-60.

Ekman, Paul. 1992. “An argument for basic emotions.” Cognition and Emotion 6(3/4): 69-200. https://doi.org/10.1080/02699939208411068.

Ekman, Paul. 2003. “Sixteen enjoyable emotions.” Emotion Researcher 18: 6-7. https://1ammce38pkj41n8xkp1iocwe-wpengine.netdna-ssl.com/wp-content/uploads/2013/07/Sixteen-Enjoyable-Emotions-Paul-Ekman.pdf database.” Speech Communication 40: 33-60.

Elfenbein, Hillary A. and Nalini Ambady. 2002. “On the universality and cultural specificity of emotion recognition: A meta-analysis.” Psychological Bulletin 128: 203-235. https://doi.apa.org/doi/10.1037/0033-2909.128.2.203

Gendron, Maria, Debi Roberson, Jacoba Marieta van der Vyver and Lisa Feldman Barrett. 2014. “Cultural relativity in perceiving emotion from vocalizations.” Psychological Science 25(4): 911-920. https://doi.org/10.1177%2F0956797613517239

Goerlich, Katharina S., Jurriaana Witteman, Andre Aleman and Sander Martens. 2011. “Hearing feelings: Affective categorization of music and speech in alexithymia, an ERP study.” PLoS ONE 6(5): 1-11. https://doi.org/10.1371/journal.pone.0019501

Halberstadt, Amy.G., Susanne A. Denham and Julie C. Dunsmore. 2001. “Affective social competence.” Social Development 10(1): 79-119. https://doi.org/10.1111/1467-9507.00150

Huang Yu-Lien, Sue-Huei Chen and Huai-HsuanTseng. 2019. “Attachment avoidance and fearful prosodic emotion recognition predict depression maintenance.” Psychiatry Research 272: 649-654. https://psycnet.apa.org/doi/10.1016/j.psychres.2018.12.119

Jawant, Abhishek and Marc D. Pell. 2010. “Listener impressions of speakers with Parkinson`s disease.” Journal of the International Neuropsychological Society 16(1): 49-57. https://doi.org/10.1017/S1355617709990919

Jovičić, Slobodan, Zorka Kašić i Miodrag Đorđević. 2006. Paralingvističke i ekstralingvističke informacije u govornim tehnologijama. Zbornik radova 50. Konferencije za ETRAN, Beograd, 2, 443-449.

Laukka, Petri & Hillary A. Elfenbein. 2021. Cross-cultural emotion recognition and in-group advantage in vocal expression: A Meta-Analysis. Emotion Review, 13(1), 3-11. https://doi.org/10.1177%2F1754073919897295

Leena, Mary. 2012. Extraction of prosody for automatic speaker, language, emotion and speech recognition. Cham: Springer. Retrieved from https://www.scribd.com/document/468619789/Mary-l-Extraction-of-Prosody-for-Automatic-Speaker-Language

Mayer, John. D., Richard D. Roberts and Sigal G. Barsade. 2008. “Human Abilities: Emotional Intelligence.” The Annual Review of Psychology 59: 507-536. https://www.researchgate.net/publication/5907081_Human_Abilities_Emotional_Intelligence

Meftah, Ali, Sid-Ahmed Selouani and Yousef A. Alotaibi. 2015. Preliminary Arabic speech emotion classification. In: Proceedings of the IEEE International Symposium on Signal Processing and Information Technology ISSPIT. https://doi.org/10.1109/ISSPIT.2014.7300584

Morningstar, Michele, Eric E. Nelson and Melanie A. Dirks. 2018. “Maturation of vocal emotion recognition: Insights from the developmental and neuroimaging literature.” Neuroscience Biobehavioral Review 90: 221-230. https://doi.org/10.1016/j.neubiorev.2018.04.019

Ocić, Gordana. 2012. Klinička neuropsihologija. Beograd: Zavod za udžbenike i nastavna sredstva.

Öhman, Arne. 2002. “Automaticity and the amygdala: Nonconscious responses to emotional faces.” Current Directions in Psychological Science 11: 62-66. https://doi.org/10.1111%2F1467-8721.00169

Paulmann, Silke and Ayse K. Uskul. 2014. “Cross-cultural emotional prosody recognition: Evidence from Chinese and British listeners.” Cognition and Emotion 2: 230-244. https://doi.org/10.1080/02699931.2013.812033

Pell, Marc D., Paulmann, Silke, Chinar Dara, Areej Alasseri & Sonja A. Kotz. 2009. “Factors in recognition of vocally expressed emotions. A comparison of four languages.” Journal of Phonetics 37: 417-435. https://doi.org/10.1016/j.wocn.2009.07.005

Sauter Disa A., Frank Eisner, Paul Ekman and Sophie K. 2010. Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations. Proceedings of the National Academy of Sciences of the United States of America, 107(6): (pp. 2408-2412). https://doi.org/10.1073/pnas.0908239106

Scherer, Klaus R., Rainer Banse and Wallbott Harald Wallbott. 2001. “Emotion inferences from vocal expression correlate across languages and cultures.” Journal of Cross-Cultural Psychology 32(1): 76-92. https://doi.org/10.1177%2F0022022101032001009

Schirmer, Annett and Sonja A. Kotz. 2003. “ERP Evidence for a sex-specific Stroop effect in emotional speech.” Journal of Cognitive Neuroscience 15(8): 1135-1148. https://psycnet.apa.org/doi/10.1162/089892903322598102




DOI: https://doi.org/10.22190/FULL221206002K

Refbacks

  • There are currently no refbacks.


ISSN 0354-4702 (Print)

ISSN 2406-0518 (Online)