Another You: Virtual Embodiment Phenomena
DOI:
https://doi.org/10.37130/w9bx5079Keywords:
virtual reality, corporeality, virtual embodiment, immersive storytelling, You Are Another Me—A Cathedral of the BodyAbstract
As the virtual space expands through various forms of digital media, visual arts are progressively incorporating nonverbal interactive languages, unlocking novel immersive experiences that contribute to the emergence of innovative storytelling techniques and art forms. In this creative research paper, the co-author and lead designer of the virtual embodiment installation “In Search of the Lost Body” examines his contribution to Adina Pintilie’s multi-platform project You Are Another Me—A Cathedral of the Body showcased at the 59th International Art Exhibition of La Biennale di Venezia in 2022. Focusing on the convergence of virtuality and corporeality, the VR art installation aspires to facilitate the phenomenological experience that evokes the You Are Another Me tender and supportive relationships between bodies, helping to break down barriers of prejudice and discrimination. Using a mix of creative practices and academic research, empirical investigation, and theoretical analysis, the paper delves into the phenomenon of virtual embodiment, investigating its potential as a transformative artistic experience. Drawing on the author’s unique perspective and Pintilie’s aspiration to venture beyond the fourth wall of cinema, the paper explores how virtual embodiment can foster sensorial immersive experiences that strengthen the connection between audiences and artistic narratives.
References
Argelaguet, F., Hoyet, L., Trico, M., and Lecuyer A. (2016) “The Role of Interaction in Virtual Embodiment: Effects of the Virtual Hand Representation,” 2016 IEEE Virtual Reality (VR), Greenville, SC, USA, pp. 3–10. doi: 10.1109/VR.2016.7504682.
Asher, T., Ogle, E., Bailenson, J., and Herrera, F. (2018) “Becoming Homeless: A Human Experience,” ACM SIGGRAPH 2018 Virtual, Augmented, and Mixed Reality, pp. 1–1. doi: 10.1145/3226552.3226576.
Aseeri, S., Marin, S., Landers, R.N., Interrante, V., and Rosenberg, E.S. (2020) “Embodied Realistic Avatar System with Body Motions and Facial Expressions for Communication in Virtual Reality Applications,” 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pp. 580–581. doi: 10.1109/ VRW50115.2020.00141.
Aymerich-Franch, L. (2020) “Avatar Embodiment Experiences to Enhance Mental Health,” Technology and Health, pp. 49–66. doi: 10.1016/B978-0-12-816958-2.00003-4.
Banakou, D., Hanumanthu, P.D., and Slater, M. (2016) “Virtual Embodiment of White People in a Black Virtual Body Leads to a Sustained Reduction in Their Implicit Racial Bias,” Frontiers in Human Neuroscience, vol. 10, doi: 10.3389/fnhum.2016.00601.
Barsalou, L.W. (2008) “Grounded cognition,” Annual Review of Psychology, vol. 59, pp. 617–645. doi: 10.1146/annurev.psych.59.103006.093639.
Bönsch, A., Radke, S., Ehret, J., Habel, U., and Kuhlen, T.W. (2020) “The Impact of a Virtual Agent’s Non-Verbal Emotional Expression on a User’s Personal Space Preferences,” Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents (IVA ‘20), Association for Computing Machinery, Article 12, pp. 1–8. doi: 10.1145/3383652.3423888.
De Oliveira, E.C., Bertrand, P., Lesur, M.E.R., Palomo, P., Demarzo, M., Cebolla, A., Banos, R., and Tori, R. (2016) “Virtual Body Swap: A New Feasible Tool to Be Explored in Health and Education,” 2016 XVIII Symposium on Virtual and Augmented Reality (SVR), Gramado, pp. 81-89. doi: 10.1109/SVR.2016.23.
Falconer, C.J., Rovira, A., King, J.A., Gilbert, P., Antley, A., Fearon, P., Ralph, N., Slater, M., and Brewin, C.R. (2018) “Embodying Self-Compassion within Virtual Reality and Its Effects on Patients with Depression,” BJPsych Open, 2(1), pp. 74–80. doi: 10.1192/bjpo.bp.115.002147.
Gallagher, S. (2005) How the Body Shapes the Mind. Oxford University Press. doi: 10.1093/0199271941.001.0001.
Gallese, V., and Sinigaglia, C. (2011) “What Is so Special about Embodied Simulation?” Trends in Cognitive Sciences, 15(11), pp. 512-519. doi: 10.1016/j.tics.2011.09.003.
Guy, M., Jeunet, C., Moreau, G., and Normand, J. (2022) “Manipulating the Sense of Embodiment in Virtual Reality: A Study of the Interactions between the Senses of Agency, Self-Location, and Ownership,” ICAT-EGVE2022, the joint international conference of the 32nd International Conference on Artificial Reality and Telexistence & the 27th Eurographics Symposium on Virtual Environments, pp. 1-11. doi: 10.2312/EGVE.20221281.
Husserl, E. (2012) [1913] Ideas: General Introduction to Pure Phenomenology, translated by Gibson Boyce, W.R. London and New York: Routledge.
Kim, C.S., Jung, M., Kim, S.Y., and Kim, K. (2020). “Controlling the Sense of Embodiment for Virtual Avatar Applications: Methods and Empirical Study,” JMIR Serious Games, 8(3), e21879. doi: 10.2196/21879.
Kishore, S., Spanlang, B., Iruretagoyena, G., Szostak, D., and Slater, M. (2021) “A Virtual Reality Embodiment Technique to Enhance Helping Behavior of Police Towards a Victim of Police Racial Aggression,” PRESENCE: Virtual and Augmented Reality, pp. 1-23. doi: 10.1162/pres_a_00339.
Kreutzberg, A. (2015) “Conveying Architectural Form and Space with Virtual Reality,” eCAADe Proceedings, pp. 1-8, doi: 10.52842/conf.ecaade.2015.1.117.
Kilteni, K., Groten, R., and Slater, M. (2012) “The Sense of Embodiment in Virtual Reality,” Presence: Teleoperators and Virtual Environments, 21(4), pp. 373-387. doi: 10.1162/ PRES_a_00124.
Longo, M.R., and Haggard, P. (2012) “What Is It like to Have a Body?,” Current Directions in Psychological Science, 21(2), pp. 140–145. doi: 10.1177/0963721411434982.
Lush, P. (2021) “Order Effects in the Rubber Hand Illusion,” PsyArXi, doi: 10.31234/ osf.io/amsrp.
Lux, V., Gredebäck, G., Non, A.L., and Krüger, M. (2022) “Editorial: The Next Step in Developmental Embodiment Research: Integrating Concepts and Methods,” Frontiers in systems neuroscience, 16, doi: 10.3389/fnsys.2022.871449.
Lux, V., Non, A.L., Pexman, P.M., Stadler, W., Weber, L.A.E., and Krüger, M. (2021) “A Developmental Framework for Embodiment Research: The Next Step Toward Integrating Concepts and Methods,” Frontiers in Systems Neuroscience, 15, 672740. doi: 10.3389/fnsys.2021.672740.
Maples-Keller, J.L., Bunnell, B.E., Kim, S.-J., and Rothbaum, B.O. (2017) “The Use of Virtual Reality Technology in the Treatment of Anxiety and Other Psychiatric Disorders,” Harvard Review of Psychiatry, 25(3), pp. 103-113, doi: 10.1097/ HRP.0000000000000138.
Matamala-Gomez, M., Donegan, T., Bottiroli, S., Sandrini, G., Sanchez-Vives, M.V., and Tassorelli, C. (2019) “Immersive Virtual Reality and Virtual Embodiment for Pain Relief,” Frontiers in Human Neuroscience, 13, pp. 279. doi: 10.3389/fnhum.2019.00279.
Merleau-Ponty, M. (2005) [1945]. Phenomenology of Perception, translated by Smith, C. London and New York: Routledge.
Milgram, P., and Kishino, F. (1994) “A Taxonomy of Mixed Reality Visual Displays,” IEICE Transactions on Information and Systems, 77, 1321-1329.
Patané, I., Lelgouarch, A., Banakou, D., Verdelet, G., Desoche, C., Koun, E., Salemme, R., Slater, M., and Farnè, A. (2020) “Exploring the Effect of Cooperation in Reducing Implicit Racial Bias and Its Relationship With Dispositional Empathy and Political Attitudes,” Frontiers in Psychology, 11, doi: 10.3389/fpsyg.2020.510787.
Riva, G. (2003). “Virtual Environments in Clinical Psychology,” Psychotherapy: Theory, Research, Practice, Training, 40(1-2), pp. 68-76. doi: 10.1037/0033-3204.40.1-2.68.
Riva, G., Wiederhold, B.K., and Mantovani, F. (2019) “Neuroscience of Virtual Reality: From Virtual Exposure to Embodied Medicine,” Cyberpsychology, Behavior, and Social Networking, 22(1), pp. 82-96. doi: 10.1089/cyber.2017.29099.gri.
Ruddle, R. A., Volkova, E., and Bülthoff, H.H. (2011) “Walking Improves Your Cognitive Map in Environments That Are Large-Scale and Large in Extent,” ACM Transactions on Computer-Human Interaction, 18(2), pp. 1-20, doi: 10.1145/1970378.1970384.
Slater, M., Neyret, S., Johnston, T., Iruretagoyena, G., Álvarez de la Campa Crespo, M., Alabèrnia-Segura, M., Spanlang, B., and Feixas, G. (2019) “An Experimental Study of a Virtual Reality Counseling Paradigm Using Embodied Self-Dialogue,” Scientific Reports, 9(1), doi: 10.1038/s41598-019-46877-3.
Slater, M., and Sanchez-Vives, M.V. (2022) “Is Consciousness First in Virtual Reality?,” Frontiers in Psychology, 13, doi: 10.3389/fpsyg.2022.787523.
Smith, J.A. (2020). Emotions, Embodied Cognition and the Adaptive Unconscious: A Complex Topography of the Social Making of Things (1st ed.). London: Routledge. doi: 10.4324/9780429398339.
Vallance, M., and Phillip, A.T. (2023). “Perspective: Narrative Storyliving in Virtual Reality Design,” Frontiers in Virtual Reality, 3, doi: 10.3389/frvir.2022.779148.
Wiehl, A. (2021). “The Body and the Eye—The I and the Other: Critical Reflections on the Promise of Extended Empathy in Extended Reality Configurations,” Augmented and Mixed Reality for Communities (1st ed.), pp. 18, doi: 10.4324/9781003052838.
Wilson, T.D. (2004) Strangers to Ourselves: Discovering the Adaptive Unconscious. Belknap Press/Harvard University Press.
Yao, W. (2018). “Adina Pintilie and the End of the Romanian New Wave,” Close Up, 2(2), pp.47-60.
Yee, N., and Bailenson, J.N. (2009). “The Difference Between Being and Seeing: The Relative Contribution of Self-Perception and Priming to Behavioral Changes via Digital Self-Representation,” Media Psychology, 12(2), pp. 195-209. doi: 10.1080/15213260902849943
Beanotherlab (2018). BeAnotherLab, Available at: http://beanotherlab.org (Accessed: 17 January 2022).
Embodied Labs (2016). Embodied Labs - Immersive Training Platform, Available at: https://www.embodiedlabs.com (Accessed: 7 February 2022).
Gelmi, G. (2023) «Investigating Intimacy: Adina Pintilie’s project for the Romanian Pavilion,” Art Margins [Online] Available at: https://artmargins.com/investigating- intimacy-adina-pintilie(Accessed 30 January 2023).
Greenberger, A. (2022) «The 10 Best National Pavilions at the 2022 Venice Biennale,” ARTnews [Online] Available at: https://www.artnews.com/list/art-news/artists/venice- biennale-2022-best-national-pavilions-1234626216 (Accessed 25 April 2022).
Searle, A. (2022) “Cyborgs, Sirens and a Singing Murderer: The Thrilling, Oligarch- free Venice Biennale – Review,” The Guardian [Online]. Available at: https://www. theguardian.com/artanddesign/2022/apr/25/cyborgs-sirens-singing-murderer-best- oligarch-free-venice-biennale (Accessed 30 May 2022).
Thaddeus-John, J. (2022) “How VR Is Reconsidering Human Connection, Firenze,” Frieze [Online] Available at: https://www.frieze.com/article/how-vr-reconsidering- human-connection (Accessed 11 November 2022).
Stanford University. (2020). Virtual HumanInteraction Lab, Available at: http:// stanfordvr.com (Accessed: 3 March 2023).
VR-EP (2017). Virtual Reality Empathy Platform, Available at: https://vr-ep.com (Accessed: 3 March 2023).
