Believing the virtual: semio-philosophical fundaments and narrative consequences of experience in VR
Abstract
The topic at the center of this paper is the renowned believability of Virtual Reality, which is deemed as capable to both replicate and create experiences beyond representation. A characteristic which has historically represented a critical issue for disciplines such as semiotics, seemingly unable to efficiently apply its methodology to such experiential narrations in which feelings and sensorial immersion seems to dominate meaning-making. To overcome this issue, we examine the Peircean notion of belief and propose to correlate this concept with the form of embodied knowledge that we constantly use and produce to act in virtual contexts and that is enacted through interactions. Indeed, since beliefs are tightly bounded to a way to produce intuitively trusted inferences, this notion can both explain the psycho-phenomenological effects of VR and expose it as a new discursive form of rhetoric. Such proposal is then epistemologically justified from both the standpoint of semiotics and of the theories of embodiment. Finally, in the conclusions we expose how such notion could allow us not only to finally have a strong grip on VR narrations but also to rethink the very notions of experience and virtuality in a perspective that is of great interdisciplinary value.
References
Aarseth, Espen (1997), Cybertext: Perspectives on Ergodic Literature, The Johns Hopkins University Press, Baltimore and London.
Barthes, Roland (1957) Mythologies, Seuil, Paris.
Beividas, Walter (2016), « La sémioception et le pulsionnel en sémiotique. Pour l’homogénéisation de l’univers thymique », Actes Sémiotiques [En ligne], 119, 2016, consulté le 29/01/2022, URL : https://www.unilim.fr/actes-semiotiques/5613, DOI : 10.25965/as.5613
Bogost, Ian (2007) Persuasive Games: The Expressive Power of Videogames, MIT Press, Cambridge.
Eco, Umberto (1979) Lector in fabula. La cooperazione interpretativa nei testi narrativi, Bompiani, Milan.
Eco, Umberto (1975), Trattato di semiotica generale, Bompiani, Milan.
Eco, Umberto (1997) Kant e L’Ornitorinco, Bompiani, Milan.
Fontanille, Jacques (2004) Figure del corpo. Per una semiotica dell’impronta, Meltemi, Rome.
Fontanille, Jacques (2011) Corps et Sens, Presse Universitaire Française, Paris.
Gallese, V., Fadiga, L., Fogassi, L., Rizzolatti, G. (1996), «Action recognition in the premotor cortex», in Brain, 1996 Apr 119 (Pt2), pp. 593-609. doi: 10.1093/brain/119.2.593. PMID: 8800951.
Giuliana, G. T. and Alexiev, M. (2020), Deconstructing the Experience. Meaning–Making in Virtual Reality Between and Beyond Games and Films, in Biggio, F., Dos Santos, V., and Giuliana, G. T. (2020), Meaning-making in Extended Reality. Senso e virtualità, Aracne, Rome, pp. 63-90.
Greimas, A. J, and Fontanille, J. (1991), Sémiotique des passions: Des états de choses aux états d'âme, Seuil, Paris.
Grimshaw, Mark (2014), The Oxford handbook of virtuality, Oxford University Press, Oxford.
Grodal, Torben (2003), Stories for Eye, Ear, and Muscles: Video Games, Media, an
d Embodied Experiences, in Wolf, M. and Perron, B. (eds), The Video Game Theory Reader, Routledge, London & New York
.
Grodal, T., and Gregersen, A. (2008), Embodiment and interface, in Perron, B. and Wolf, M. (eds.), Video Game Theory Reader 2, Routledge, New York.
Harringan, P. and Wardrip-Fruin, N. (eds), (2004), First Person. New Media as Story, Performance, and Game, MIT Press, Cambridge.
Herrera, F., Bailenson, J., Weisz, E., Ogle, E., and Zaki, J. (2018), «Building long-term empathy: A large-scale comparison of traditional and virtual reality perspective-taking.», PloS one, 13(10), e0204494, https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0204494
Malafouris, Lambros (2014), How things shape the mind. A theory of material engagement, The MIT Press, Cambridge.
Maldonado, Tomás (1992) Reale e Virtuale, Feltrinelli, Milano.
Marrone, Gianfranco (2005) The Ludovico Cure. On Body and Music in A Clockwork Orange, Legas, Toronto.
Marrone, G., Dusi, N., and Lo Feudo, G. (2007), Narrazione ed esperienza. Intorno a una semiotica del quotidiano, Meltemi, Rome.
Matamala-Gomez, M., Donegan, T., Bottiroli, S., Sandrini, G., Sanchez-Vives M. V., Tassorelli, C. (2019), «Immersive Virtual Reality and Virtual Embodiment for Pain Relief.», in Frontiers in human neuroscience, n.13, pp.279-321, doi:10.3389/fnhum.2019.00279
Murphy, Dooley (2017), «Virtual Reality is ‘Finally Here’: A Qualitative Exploration of Formal Determinants of Player Experience in VR», in Proceedings of DiGRA 2017, https://www.researchgate.net/publication/319154465_Virtual_Reality_is_'Finally_Here'_A_Qualitative_Exploration_of_Formal_Determinants_of_Player_Experience_in_VR
Newen, A., de Bruin, L. and Gallagher, S. (eds.), (2018), The Oxford handbook of 4E cognition, Oxford University Press, Oxford.
Paolucci, Claudio (2011), «The "External Mind": Semiotics, Pragmatism, Extended Mind and Distributed Cognition», in Versus-Quaderno di Studi Semiotici, n.112-113, pp. 69-96.
Paolucci, Claudio (2020), Una percezione macchinica: Realtà virtuale e realtà aumentata tra simulacri e protesi dell’enunciazione, in Biggio, F., Dos Santos, V. e Giuliana G. T. (eds), Meaning- Making in Extended Reality: Senso e virtualità, Aracne Editrice, Roma, pp. 43-62.
Paolucci, Claudio (2021) Cognitive Semiotics: Integrating Signs, Minds, Meaning and Cognition, Springer, Berlin.
Di Pellegrino, G., and Làdavas, E. (2014), «Peripersonal space in the brain», in Neuropsychologia, n.66, pp. 126-133.
Prinz, Jesse (2006), Gut Reactions. A Perceptual Theory of Emotion, Oxford University Press, Oxford.
Szekely, G. and Satava, R. (1999), «Virtual reality in medicine», in BMJ, n.319 (7220), 1305, doi: 10.1136/bmj.319.7220.1305
Swink, Steve (2008), Game Feel: A Game Designer's Guide to Virtual Sensation, CRC Press, Boca Raton.
Varela, F., Thompson, E. and Rosch, E. (1993), L’inscription corporelle de l’esprit, sciences cognitives et expériences humaine, Editions du Seuil, Paris.
Vecchio, Sebastiano (2019), Semiosi e conoscenza. Intorno a Peirce, Duetredue Edizioni, Lentini.
Vecchio, Sebastiano (2020), «Modi e questioni del credere», in Rivista Italiana di Filosofia del Linguaggio, n.14 (1), doi: 10.4396/2020111.
Volli, Ugo (2020), Archeologia semiotica del virtuale, in Biggio, F., Dos Santos, V., and Giuliana, G. T. (2020), Meaning-making in Extended Reality. Senso e virtualità, Aracne, Rome, pp. 21-42.
Ward, D., Silverman, D. and Villalobos, M. (2017), «Introduction: The Varieties of Enactivism», in Topoi, n.36, pp.365–375.
Zahra, A. M., Lavanya, A., Jason J., Moore, J. D, Cushman, C., Vuong and
Mayank, R. M. (2015), «Impaired spatial selectivity and intact phase precession in two dimensional virtual reality», in Nature Neuroscience, vol.18, pp.121–128.
Zlatev, Jordan (2012), «Cognitive Semiotics: an emerging field for the transdisciplinary study of meaning», in The Public Journal of Semiotics, n. IV, vol.1, from https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.1038.749&rep=rep1&type=pdf
Works published in RIFL are released under Creative Commons Licence:Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
