Emotion Perception in AI-Generated Facial Expressions
DOI:
https://doi.org/10.52825/th-wildau-ensp.v2i.2943Keywords:
Artificial Intelligence, Generative AI, Emotion PerceptionAbstract
This study analyses whether facial expressions in generated images are perceived in the same way as in real images. It examines the perception of emotional intensity and sympathy, the ability to recognise emotions, and the distinction between real and generated images. To answer these questions, an online survey was conducted with more than 200 participants. The results show slight to moderate differences in perception between generated and real images, but it also becomes clear that the distinction between the two is becoming increasingly difficult.
Downloads
References
lilmiquela [@lilmiquela]. “Instagram profile.” eprint: Instagram, Accessed: Jan. 16, 2025. [Online]. Available: https://www.instagram.com/lilmiquela/.
imma [@imma.gram]. “Instagram profile.” eprint: Instagram, Accessed: Jan. 16, 2025. [Online]. Available: https://www.instagram.com/imma.gram/.
l. Miquela], "The first-ever BMW iX2 × lil Miquela. Youtube video" Accessed: Jan. 16, 2025. ePrint: youtube. [Online]. Available: https://www.youtube.com/watch?v=MXSaZQ2aAAc.
bmw, and lilmiquela, "Instagram post" Accessed: Jan. 16, 2025. ePrint: Instagram. [Online]. Available: https://www.instagram.com/p/CyP2zNuoOEV/.
Prada, "Prada Candy - Rethink Reality - Sensations. Youtube video" Accessed: Jan. 16, 2025. ePrint: Youtube. [Online]. Available: https://www.youtube.com/watch?v=E0skE.
lilmiquela, "I am here. That is my truth. #MYTRUTH #MYCALVINS" Accessed: Jan. 16, 2025. ePrint: Instagram. [Online]. Available: https://www.instagram.com/p/Bxh4AdrnTel/.
E. Brynjolfsson, D. Li, and L. Raymond, "Generative AI at Work", 2023. DOI: 10.3386/w31161.
E. Rykova, and M. Walther, "AphaDIGITAL – Digital Speech Therapy Solution for Aphasia Patients with Automatic Feedback Provided by a Virtual Assistant", in 57th Hawaii International Conference on System Sciences, HICSS 2024, Honolulu, Hawaii, USA, 2024, pp. 3385–3394.
E. Ojo, "Perception of basic emotions in facial expressions created by generative AI: tools and empirical tests", unpublished, Bachelor's thesis, Technical University of Applied Sciences Wildau, 2024.
A. Vinciarelli, M. Pantic, H. Bourlard, and A. Pentland, "Social signal processing: state-of-the-art and future perspectives of an emerging domain", in Proceedings of the 16th ACM international conference on Multimedia, 2008, pp. 1061–1070.
J.A. Hall, T.G. Horgan, and N.A. Murphy, "Nonverbal Communication", Annual Review of Psychology, vol. 70, Jan. 2019. DOI: 10.1146/annurev-psych-010418-103145. [Online]. Available: http://dx.doi.org/10.1146/annurev-psych-010418-103145.
A. Mehrabian, and S.R. Ferris, "Inference of attitudes from nonverbal communication in two channels.", vol. 31, no. 3, pp. 248–252, 1967, ISSN: 0095-8891. DOI: 10.1037/h0024648.
D. Lapakko, "Three cheers for language: A closer examination of a widely cited study of nonverbal communication", Communication Education, vol. 46, Jan. 1997. DOI: 10.1080/03634529709379073.
P. Ekman, "Emotions Revealed", Times Books, New York, 2003.
A. Vinciarelli, M. Pantic, and H. Bourlard, "Social signal processing: Survey of an emerging domain", Image and Vision Computing, vol. 27, no. 12, pp. 1743–1759, 2009.
U. Hess, and P. Thibault, "Darwin and emotion expression.", American Psychologist, vol. 64, Feb. 2009. DOI: 10.1037/a0013386. [Online]. Available: http://dx.doi.org/10.1037/a0013386.
P.R. Kleinginna, and A.M. Kleinginna, "A categorized list of emotion definitions, with suggestions for a consensual definition", vol. 5, no. 4, pp. 345–379, 1981.
C. Darwin, "On the Expression of the Emotions in Man and Animals", John Murray, London, 1872. [Online]. Available: http://books.google.de/books?id=NWAJAAAAQAAJ.
A. Paeschke, "Prosodische Analyse emotionaler Sprechweise", Logos, Mündliche Kommunikation, 2003, ISBN: 3-8325-0146-0, 978-3-8325-0146-4.
Paul Ekman Group, "Universal Emotions | What are Emotions? | Paul Ekman Group", Online. https://www.paulekman.com/universal-emotions/, no date.
E. Ojo, and M. Walther, "Empirical Evaluation of Basic Emotion Perception in AI-Generated Facial Expressions", in Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems.
M. Testerman, "Face Image Databases", Online. https://libguides.princeton.edu/facedatabases, 2022.
J. van der Schalk, S.T. Hawk, A.H. Fischer, and B. Doosje, "Moving faces, looking places: Validation of the Amsterdam Dynamic Facial Expression Set (ADFES).", vol. 11, no. 4, pp. 907–920, 2011, ISSN: 1528-3542. DOI: 10.1037/a0023853.
T. Kanade, Y. Li, and J. Cohn, "Comprehensive Database for Facial Expression Analysis", in Proceedings of International Conference on Face and Gesture Recognition, 2000, pp. 46-53.
K.S. Scherf, and M.S. Benda, "The Complex Emotion Expression Database: A Validated Stimulus Set of Trained Actors", 2019. DOI: 10.17910/B7.874. [Online]. Available: http://databrary.org/volume/874.
N.C. Ebner, M. Riediger, and U. Lindenberger, "FACES – A database of facial expressions in young, middle-aged, and older women and men: Development and validation", Behavior Research Methods, vol. 42, Feb. 2010. DOI: 10.3758/brm.42.1.351.
F. Wallhoff, B. Schuller, M. Hawellek, and G. Rigoll, "Efficient Recognition of Authentic Dynamic Facial Expressions on the Feedtum Database", 2006 IEEE International Conference on Multimedia and Expo, Jul. 2006. DOI: 10.1109/icme.2006.262433.
D. Lundqvist, A. Flykt, and A. Öhman, "Karolinska Directed Emotional Faces", 1998. [Online]. Available: https://api.semanticscholar.org/CorpusID:150212888.
A. Borji, "Generated Faces in the Wild: Quantitative Comparison of Stable Diffusion, Midjourney and DALL-E 2", Oct. 2022. DOI: 10.48550/arXiv.2210.00586. ePrint: arXiv:10.48550/arXiv.2210.00586. [Online]. Available: http://arxiv.org/abs/2210.00586v2.
civitai.com, "Faces by thegipper | LoRA-collection", Online. https:/https://civitai.com/tag/faces, 2024.
L. Zhang, A. Rao, and M. Agrawala, "Adding Conditional Control to Text-to-Image Diffusion Models", Feb. 2023. DOI: 10.48550/arXiv.2302.05543. ePrint: arXiv:10.48550/arXiv.2302.05543. [Online]. Available: http://arxiv.org/abs/2302.05543v3.
K. Mehreen, "Using LoRA in Stable Diffusion", Online. https://machinelearningmastery.com/using-lora-in-sta- ble-diffusion/, 2024.
N. Nachar, "The Mann-Whitney U: A Test for Assessing Whether Two Independent Samples Come from the Same Distribution", Tutorials in Quantitative Methods for Psychology, vol. 4, no. 1, pp. 13-20, 2008. DOI: 10.20982/tqmp.04.1.p013. [Online]. Available: http://www.tqmp.org/RegularArticles/vol04-1/p013/p013.pdf.
P. Ekman et al., "Universals and cultural differences in the judgments of facial expressions of emotion.", Journal of Personality and Social Psychology, vol. 53, 1987. DOI: 10.1037/0022-3514.53.4.712. [Online]. Available: http://dx.doi.org/10.1037/0022-3514.53.4.712.
J. Frank et al., "A Representative Study on Human Detection of Artificially Generated Media Across Countries", Dec. 2023. DOI: 10.48550/arXiv.2312.05976. ePrint: arXiv:10.48550/arXiv.2312.05976. [Online]. Available: http://arxiv.org/abs/2312.05976v1.
S.J. Nightingale, and H. Farid, "AI-synthesized faces are indistinguishable from real faces and more trustworthy", Proceedings of the National Academy of Sciences, vol. 119, Feb. 2022. DOI: 10.1073/pnas.2120481119.
F. Lago, C. Pasquini, R. Bohme, H. Dumont, V. Goffaux, and G. Boato, "More Real Than Real: A Study on Human Visual Perception of Synthetic Faces [Applications Corner]", IEEE Signal Processing Magazine, vol. 39, Jan. 2022. DOI: 10.1109/msp.2021.3120982.
Downloads
Published
How to Cite
Conference Proceedings Volume
Section
License
Copyright (c) 2025 Emil Ojo, Mathias Walther
This work is licensed under a Creative Commons Attribution 4.0 International License.