Recieved: 09/08/2023
Accepted: 01/30/2024
Published: 03/13/2024
Keywords: aerospace psychology; hypogravity; “dry” immersion; emotional states; facial expressions; FACS action units; basic emotions
p.: 158-174
DOI: 10.11621/npj.2024.0111
Available online: 13.03.2024
Gusev, A.N. , Baev, M.S., Lebedeva, S. A. , Savinkina, A.O.. Change in Subjects’ Emotional States as Observed through Facial Expressions during a Seven-Day Dry Immersion Experiment. // National Psychological Journal 2024. 1. p.158-174. doi: 10.11621/npj.2024.0111
Copied to Clipboard
CopyBackground. The problem of precise and reliable evaluation of the emotional state of operators in spaceflight conditions still remains unresolved, and therefore relevant. This evaluation is especially important for predicting operators` professional activity effectiveness considering the current emotional state which significantly determines the accuracy and rapidity of professional tasks performance.
Objectives. Our study is carried out to empirically test the new method and technology for evaluating changes in the emotional state of the 7-day experiment participants measuring facial expression changes in their DPC-video interview recordings.
Study Participants. The study involved 10 men aged 25 to 35 years. Volunteers were selected by the Institute of Biomedical Problems of the Russian Academy of Sciences as participants in the research.
Methods. DPC video interviews were conducted daily in the morning and in the evening. Facial expression changes evaluation was conducted with the EmoRadar software which detects FACS action units (AUs), seven basic emotions and other patterns of facial activity.
Results. The description of facial expression changes in the experiment are given based on the data from two participants. These changes were compared with the emotional experience of the participants and experimental conditions. The necessity of differentiated evaluation of the positive emotion of happiness is shown since its assessments may include not only happiness as a basic emotion, but also two expressions of smiles (social smile or coy smile) similar to it. The effectiveness of the software used and the author’s approach to computer analysis of facial activity is clearly shown.
Conclusions. With the help of the developed technology based on the implementation of a comprehensive approach to measurement and interpretation of facial expressions, it is possible to provide objective information about characteristic changes in facial expressions as reliable behavioral indicators of a person’s emotional state. The data are independent of respondents’ self-assessments or expert’s experience. This opens up new methodological possibilities for aerospace psychology to solve the problem of automatic monitoring of the emotional state of operators.
Baev, M., Gusev, A., Kremlev, A. (2023). Non-biased cFACS measurement tool: Fr om idea to software application. In: Clara Pracana and Michael Wang (Eds.), Psychological Applications and Trends (pp. 666–670). Lisboa, Portugal.
Banse, R., Scherer, K.R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3),614–636.
Bänziger, T., Patel, S., Scherer, K.R. (2014). The role of perceived voice and speech characteristics in vocal emotion communication. Journal of Nonverbal Behavior, 38(1), 31–52.
Barrett, L.F., Adolphs, R., Marsella, S., Martinez, A.M., and Pollak, S.D. (2019). Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological Science in the Public Interest, 20(1), 1–68. https://doi.org/10.1177/1529100619832930
Baykaner, K.R., Huckvale, M., Whiteley, I., Andreeva, S., Ryumin, O. (2015). Predicting fatigue and psychophysiological test performance from speech for safety-critical environments. Frontiers in Bioengineering and Biotechnology, (3), 124.
Bell, M. (2013). Hard Feelings: The Moral Psychology of Contempt. New York: Oxford Univ. Press.
Bersenev, E.Y., Ukraintseva, Y.V., Kovrov, G.V., Yakhya, Y.D., Vassilieva, G.Y., Tomilovskaya, E.S., Orlov, O.I. (2021). Sleep in 21-Day Dry Immersion. Are Cardiovascular Adjustments Rapid Eye Movement Sleep-Dependent? Frontiers in Physiology, (12), 749773.
Cohen, A.O., Breiner, K., Steinberg, L., Bonnie, R.J., Scott, E.S., Taylor-Thompson, K., Casey, B.J. (2016). When is an adolescent an adult? Assessing cognitive control in emotional and nonemotional contexts. Psychological Science, 27(4), 549–562.
Cordaro, D.T. et al., “Universals and Cultural Variations in 22 Emotional Expressions Across Five Cultures,” Emotion, Advance online publication, June 12, 2017, http://dx.doi.org/10.1037/emo0000302
Darvin, Ch., Ekman, P. (2013). On the expression of emotions in humans and animals. Trans. from English. St. Petersburg: Piter. (In Russ.).
Ekman, P. (1989). The Argument and Evidence about Universals in Facial Expression of Emotion. In Wagner, H. and Manstead, A. (Eds.), Handbook of Social Psychophysiology (pp. 143–164). Chichester: John Wiley and Sons, Ltd. Ekman, P., Friesen, W.V., Hager, J.C. (2002). The facial action coding system (2nd ed.). London: Weidenfeld and Nicolson.
Ellgring, H. (2008). Non-verbal communication in Depression. Cambridge: Cambridge Univ. Press.
Gusev, A.N., Baev, M.S., Kremlev, A.E. (2021). Method of direct assessment of facial expressions on video recordings: from expert perception to computer vision. In: T.A. Zhalagin (Ed.), Socio-psychological problems of digitalization of modern society: personality organization, management (pp. 268–278). Tver’: TGU. (In Russ.).
Gushchin, V.I., Kuvshinova, O.L., Shalina, O.S., Vinokhodova, A.G., Zyudfeld, P., Dzhonson, F.D. (2018). Methodical approach to the study of autobiographical representations of cosmonauts. Aviakosmicheskaya i Ekologicheskaya Meditsina (Aerospace and Environmental Medicine), 52(5), 23–27. (In Russ.).
Izard, E. (2021). Psychology of Emotions. Translated from English. St. Petersburg: Piter. (In Russ.).
Kanas, N. (2023). Living and Working in Space. Behavioral Health and Human Interactions in Space. Cham: Springer International Publishing.
Koglbauer, I.V., Braunstingl, R. (2021). Applications of Cardiac and Electrodermal Activity Assessment in Aviation. In: I. Koglbauer, S. Biede-Straussberger (Eds.), Aviation Psychology: Applied Methods and Techniques (pp. 141–162). Hogrefe Verlag GmbH and Co.KG.
Lebedeva, S., Shved, D., Savinkina, A. (2022). Assessment of the Psychophysiological State of Female Operators Under Simulated Microgravity. Frontiers in Psychology, (12), 2562.
Lebedeva, S.A., Shved, D.M., Gushchin, V.I. (2019). Preliminary results of studying the functional state of a human operator by analyzing acoustic characteristics of speech under the influence of simulated factors of space flight. Aviakosmicheskaya i Ekologicheskaya Meditsina (Aerospace and Environmental Medicine), 53(2), 50–56. (In Russ.).
Leonova, A.B. (1984). Psychodiagnostics of functional states of a person. Moscow: Ripol Klassik. (In Russ.).
Leonova, A.B., Kuznetsova, A.S. (2007). Psychological technologies of human condition management. Moscow: Smysl. (In Russ.).
Logan, D.L. (2022). First Course in the Finite Element Method, Enhanced Edition, SI Version. Cengage Learning.
Nikonov, A.V. (1985). Psychological problems of acoustic diagnostics of functional states of the operator in special conditions (pp. 136–153). In: Psychological Problems of Activity in Special Conditions: Collection of Articles. Moscow: Nauka. (In Russ.).
Oluwafemi, F.A., Abdelbaki, R., Lai, J.C.Y., Mora-Almanza, J.G., & Afolayan, E.M. (2021). A review of astronaut mental health in manned missions: Potential interventions for cognitive and mental health challenges. Life Sciences in Space Research, (28), 26–31.
Osin, E.N. (2012). Measurement of positive and negative emotions: development of a Russian-language analogue of the PANAS methodology. Psikhologiya. Zhurnal Vysshei Shkoly Ekonomiki (Psychology. Journal of the Higher School of Economics), 9(4), 91–110. (In Russ.).
Robin, A., Auvinet, A., Degryse, B., Murphy, R., Bareille, M.P., Beck, A., Navasiolava, N. (2020). DI-5-CUFFS: venoconstrictive thigh cuffs lim it body fluid changes but not orthostatic intolerance induced by a 5-day dry immersion. Frontiers in Physiology, (11), 383.
Rosenberg, E.L., Ekman, P. (Eds.). (2020). What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). Oxford: Oxford Univ. Press.
Rusanov, V.B., Pastushkova, L.K., Larina, I.M., Chernikova, A.G., Goncharova, A.G., Nosovsky, A.M., Nikolaev, E.N. (2020). The effect of five-day dry immersion on the nervous and metabolic mechanisms of the circulatory system. Frontiers in Physiology, (11), 692.
Slavich, G.M., Taylor, S., Picard, R.W. (2019). Stress measurement using speech: Recent advancements, validation issues, and ethical and privacy considerations. Stress, 22(4), 408–413.
Smirnov, B.A., Dolgopolova, E.V. (2007). Psychology of activity in extreme situations. Kharkov: Publishing house Humanities Centre. (In Russ.).
Supolkina, N., Yusupova, A., Shved, D., Gushin, V., Savinkina, A., Lebedeva, S.A., Kuznetsova, P. (2021). External communication of autonomous crews under simulation of interplanetary missions. Frontiers in Physiology, (12), 751170.
Tomilovskaya, E., Shigueva, T., Sayenko, D., Rukavishnikov, I., Kozlovskaya, I. (2019). Dry immersion as a ground-based model of microgravity physiological effects. Frontiers in Physiology, (10), 284.
Yusupova, A.K., Gushchin, V.I., Ushakov, I.B. (2011). Communications of space crews in real and simulated space flights. Moscow: SSC RF — IMBP RAS. (In Russ.).
Gusev, A.N. , Baev, M.S., Lebedeva, S. A. , Savinkina, A.O.. Change in Subjects’ Emotional States as Observed through Facial Expressions during a Seven-Day Dry Immersion Experiment. // National Psychological Journal 2024. 1. p.158-174. doi: 10.11621/npj.2024.0111
Copied to Clipboard
Copy