Recieved: 02/27/2023
Accepted: 06/06/2023
Published: 08/21/2023
Keywords: multimodal dynamic expressions; human face; GERT; forms of emotional expressions; emotion recognition; experience of affective states; gender differences
p.: 106-127
DOI: 10.11621/npj.2023.0311
Available online: 21.08.2023
Barabanschikov Vladimir A., Suvorova Ekaterina V.. Expression and perception of multimodal emotional states. // National Psychological Journal 2023. 3. p.106-127. doi: 10.11621/npj.2023.0311
Copied to Clipboard
CopyObjective. The objective is to reveal the patterns of expression and identification of multimodal dynamic emotional states, based on the stimuli, created by professional actors.
Sample. The experiments involved 96 (48 women and 48 men) specialists in various fields of practice as well as undergraduate and graduate students of Russian universities, average age M = 34, SD = 9.4.
Methods. The Russian-language version of the Geneva Emotion Recognition test (GERT) (Barabanschikov, Suvorova, 2020). Participants were randomly presented with 83 audio-video clips of affective states played by specially trained professional actors (5 men and 5 women, average age — 37 years). It was required to attribute the perceived emotion to one of the 14 target categories. The frequency of relevant and irrelevant choices was analyzed depending on the exposure conditions. The study was approved by the Ethics Commission of the Institute of Experimental Psychology of MSPPU (decision No. 3, 22.02.2023), with which the authors of the article are affiliated.
Results. The forms of expression and identification of multimodal emotional states, their determinants and conditions of realization are described.
Conclusion. A new paradigm of experimental psychological research of human emotional states linking their experience, expression, and identification is outlined. The productivity of applying theatrical art practices to solve problems of academic science is demonstrated.
Adams, R., Ambady, N., Nakayama, K., Shimojo, S. (2011). Oxford: Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195333176.001.0001
Bänziger, T., Mortillaro, M., Scherer, K.R. (2012). Introducing the Geneva Multimodal Expression Corpus for experimental research on emotion perception. Emotion, 12, 1161–1179. https://doi.org/10.1037/a0025827
Barabanschikov, V.A. (2019). Perception of facial expression modes: invariance and variability. In G.V. Shukov, V.I. Panov (Eds), Psychology of perception today: paradigms, theory, empiricism (pp. 94–102). M.: Akropol’. (In Russ.).
Barabanschikov, V.A. (2020). Сonstancy of perception of ecologically valid structures. World of Psychology, 2, 164–173. (In Russ.).
Barabanschikov, V.A., Korol’kova, O.A. (2020). Perception of “live” facial expressions. Experimental Psychology, 13 (3), 55–73. https://doi.org/10.17759/exppsy.2020130305 (In Russ.).
Barabanschikov, V.A., Korol’kova, O.A., Lobodinskaya, E.A. (2021). Perception of facial microexpressions in conditions of apparent movement and disguise. M.: Kogito-Centr. (In Russ.).
Barabanschikov, V.A., Marinova, M.M. (2021). Deepfake in face perception research. Experimental Psychology, 14 (1), 4–19. https://doi.org/10.17759/exppsy.2021000001 (In Russ.).
Barabanschikov, V.A., Suvorova, E.V. (2020). Human emotional state assessment based on a video portrayal. Experimental Psychology, 13 (4), 4–24. https://doi.org/10.17759/exppsy.2020130401 (In Russ.).
Barabanschikov, V.A., Suvorova, E.V. (2021). Gender Differences in the Recognition of Emotional States. Psychological Science and Education, 26 (6), 107–116. https://doi.org/10.17759/pse.2021260608 (In Russ.).
Barabanschikov, V.A., Suvorova, E.V. (2020). Multimodal expressions’ assessment in laboratory and online. In K.I. Anan’ev, V.A.
Barabanschikov, A.A. Demidov (Eds.), (pp. 310–322). M.: Kogito-Centr. (In Russ.).
Barabanschikov, V.A., Suvorova, E.V. (2022). Gender factor in the recognition of a person’s emotional state. Russian Psychological Journal, 19 (2), 6–20. https://doi.org/10.21702/rpj.2022.2.1(In Russ.).
Barabanschikov, V.A., Zhegallo, A.V., Smolny, Ya.N., Marinova, M.M. (2021). The Impact of a Stranger’s Emotional Facial Expression on the Perception of his Personality. Experimental Psychology, 14 (4), 23–42. https://doi.org/10.17759/exppsy.2021140402 (In Russ.).
Barrett, L.F., Russell, J.A. (1999). The structure of current affect: Controversies and emerging consensus. Current Directions in Psychological Science, 8 (1), 10–14. https://doi.org/10.1111/1467-8721.00003
Brody, L.R., Hall, J.A. (2010). Gender and emotion in context. In M. Lewis, J.M. Haviland-Jones, L. Feldman Barrett (Eds.), Handbook of emotions (3rd ed.), (pp. 395–408). NY: The Guilford Press.
Calder, A., Rhodes, G., Johnson, M., Haxby, J. (2011). Oxford Handbook of Face Perception. Oxford: Oxford University Press.
Ekman, P. (1999). Basic emotions. In T. Dalgleis, M. Power (Eds.), Handbook of Cognition and Emotion (pp. 301–320). NY.: Wiley.
Ekman, P. (2005). What the face reveals: Basic and applied studies of spontaneous expression using the facial action coding system (FACS). In Ekman, P., Rosenberg, E.L. (Eds.), (2nd ed.). Oxford: Oxford University Press. https://doi.org/10.1093/acpro:oso/9780195179644.001.0001
Ekman, P., Friesen, W. (1976). Pictures of facial affect. Palo Alto: Consulting Psychologists Press.Fischer, A.H., Manstead, A.S.R. (2000). The relation between gender and emotion in different cultures. In A.H. Fischer (Eds.), Gender and emotion: Social psychological perspectives (pp. 71–98). NY.: Cambridge University Press. https://doi.org/10.1017/CBO9780511628191.005
Hall, J.A. (1978). Gender effects in decoding nonverbal cues. Psychological Bulletin, 8, 845–857. https://doi.org/10.1037/0033-2909.85.4.845
Hyde, J.S. (2005). The gender similarities hypothesis. American Psychologist, 60 (6), 581–592. https://doi.org/10.1037/0003-066X.60.6.581
Izard, C.E. (1991). Emotions, personality, and psychotherapy. The psychology of emotions. NY: Plenum Press.
Rubinstein, S.L. (2020). Fundamentals of General Psychology. In K.A. Albukhanova (Eds.). M.: AST. (In Russ.).
Russell, J.A. (1983). Pancultural aspects of the human conceptual organization of emotions. Journal of Personality and Social Psychology, 45 (6), 1281–1288. https://doi.org/10.1037/0022-3514.45.6.1281
Scherer, K.R. (2005). What are emotions? And how can they be measured. Social Science Information, 44, 695–729. https://doi.org/10.1177/0539018405058216
Schlegel, K., Grandjean, D., Scherer, K.R. (2012). Emotion recognition: Unidimensional ability or a set of modality- and emotion-specific skills?Personality and Individual Differences, 53 (1), 16–21. https://doi.org/10.1016/j.paid.2012.01.026
Schlegel, K., Grandjean, D., Scherer, K.R. (2014). Introducing the Geneva Emotion Recognition Test: An example of Rasch-based test development. Psychological Assessment, 26 (2), 666–672. https://doi.org/10.1037/a0025827
Schlegel, K., Scherer, K.R. (2017). The nomological network of emotion knowledge and emotion understanding in adults: evidence from two new performance-based tests. Cognition and Emotion, 32, 1514–1530. https://doi.org/10.1080/02699931.2017.1414687
Schlegel, K., Scherer, K.R. (2016). Introducing a short version of the Geneva Emotion Recognition Test (GERT-S): Psychometric properties and construct validation. Behavior Research Methods, 48, 1383–1392. https://doi.org/10.3758/s13428-015-0646-4
Stanislavskiy, K.S. (2018). The actor’s work on himself. M: AST. (In Russ.).
Barabanschikov Vladimir A., Suvorova Ekaterina V.. Expression and perception of multimodal emotional states. // National Psychological Journal 2023. 3. p.106-127. doi: 10.11621/npj.2023.0311
Copied to Clipboard
Copy