Layered communication. Narration and digital multimodality
Abstract
Abstract Before the advent of digital culture, quoting reality in the narration was a complex procedure; many of the elements that this type of intertextuality now commonly makes use of were not available in real time, could not be recalled extemporaneously, and if they were, the operation would have required high technical skills. The turning point – with an oxymoron we could call it analogical – that characterises narration in the digital environment is therefore first and foremost linked to its diatechnical peculiarities. Today, through the web and social networks, materials documenting events that have taken place in real life are available to everyone. In the typical dimension of digital communication, words, images and, in general, all textual quotations – but also graphic, photographic, video, audio, etc., and the timing with which they are recalled by readers – take on a semantic weight and are decisive for the construction of the meaning of the text. Real-world events are quoted in the text without mediation, hybridising it so that the message integrates them, with the result that the written text becomes increasingly shorter, elliptical and non-sequential.
References
Andor, József (2019), On the Text Organizing Status of Key Words in News Discourse, An Empirical Study in Terms of János S. Petőfi’s Legacy, in Margarita Borreguero Zuloaga, Luciano Vitacolonna (eds), The Legacy of János S. Petőfi, Text Linguistics, Literary Theory and Semiotics, Cambridge Scholars Publishing, Cambridge, pp. 2-23.
Antos, Gerd, Opiłowski, Roman, Jarosz, Jozef, Bogacki, Jarosław, Iluk, Jan, Juesten, Anna et al. (2014), (eds), Sprache und Bild im massenmedialen Text, Formen, Funktionen und Perspektiven im deutschen und polnischen Kommunikationsraum, Neisse-Verlag, Dresden.
Barthes, Roland (1973), Le plaisir du texte, Seuil, Paris (Il piacere del testo, trad. it. di L. Lonzi, Einaudi, Torino 1975).
Bateman, John, Wildfeuer, Janina, Hiippala, Tuomo (2017), (eds), Multimodality. Foundations, Research and Analysis. A Problem-Oriented Introduction, De Gruyter Mouton, Berlin, Boston.
Bezemer, Jeff, Kress, Gunther (2016), The Textbook in a Changing Multimodal Landscape, in Nina-Maria Klug, Hartmut Stöckl (eds), Handbuch Sprache im multimodalen Kontext, De Gruyter Mouton, Berlin, Boston, pp. 476-498.
Bolter, Jay David, Grusin, Richard (2000), (eds), Remediation, Understanding New Media, MIT Press, Cambridge, MA.
Cuyckens, Hubert, Geeraerts, Dirk (2007), (eds), The Oxford Handbook of Cognitive Linguistics, University Press, Oxford.
Diekmannshenke, Hajo, Klemm, Michael, Stöckl, Hartmut (2011), (eds), Bildlinguistik, Theorien - Methoden – Fallbeispiele, Erich Schmidt Verlag GmbH & Co., Berlin.
Diekmannshenke, Hajo, Stöckl, Hartmut (2011), «Kommentierte Literaturhinweise», in Hajo Diekmannshenke, Michael Klemm, Hartmut Stöckl (eds), Bildlinguistik, Theorien - Methoden – Fallbeispiele, Erich Schmidt Verlag GmbH & Co, Berlin, pp. 369-380.
Doelker, Christian (1997), Ein Bild ist mehr als ein Bild, Visuelle Kompetenz in der Multimedia-Gesellschaft, Klett-Cotta, Stuttgart.
Grant, August E., Wilkinson. Jeffrey S. (2009), (eds), Understanding media convergence, the state of the field, Oxford University Press, New York, Oxford.
Halliday, Michael A. K., Hasan, Ruqaiya (1976), Cohesion in English, Longman, London.
Hartmann, Nicolai (1964), Der Aufbau der realen Welt, Grundriß der allgemeinen Kategorienlehre, De Gruyter Mouton, Berlin.
Hassler-Forest, Dan, Nicklas, Pascal (2015), The Politics of Adaptation, Media Convergence and Ideology, Palgrave Macmillan, Basingstoke.
Hatakeyama, Katsuhiko, Petöfi, Jänos S., Sözer, Emel (1985), Text, Connexity, Cohesion, Coherence, in Sözer, Emel (ed.), Text Connexity, Text Coherence, Buske, Hamburg, pp. 1-71.
Hölker, Klaus (2019), From Text Grammar to Macropragmatics via Coherence, in Margarita Borreguero Zuloaga, Luciano Vitacolonna (eds), The Legacy of János S. Petőfi, Text Linguistics, Literary Theory and Semiotics, Cambridge Scholars Publishing, Cambridge, pp. 24-33.
Holly, Werner (2007), Audiovisuelle Hermeneutik. Am Beispiel der TV-Spots der Kampagne ‚Du bist Deutschland‘, in Fritz Hermanns, Werner Holly (eds), Linguistische Hermeneutik, Theorie und Praxis des Verstehens und Interpretierens, Niemeyer Verlag, Tübingen, pp. 387-420.
Jenkins. H. (2008), Convergence Culture, Where Old and New Media Collide, NYU Press, New York.
Jewitt, Carey, Henriksen, Berit (2016), 6. Social Semiotic Multimodality, in Nina-Maria Klug, Hartmut Stöckl (eds), Handbuch Sprache im multimodalen Kontext, De Gruyter Mouton, Berlin, Boston, pp. 145-164.
Klug, Nina-Maria, Stöckl, Hartmut (2016), Handbuch Sprache im multimodalen Kontext, Vol. 7, De Gruyter Mouton, Berlin, Boston.
Krämer, Sybille (2001), Sprache, Sprechakt, Kommunikation, sprachtheoretische Positionen des 20. Jahrhunderts, Suhrkamp Verlag, Frankfurt am Main.
Lemke, Jayl L. (1998), Multiplying meaning, visual and verbal semiotics in scientific text, in J.R. Martin, Robert Veel (eds), Reading science, critical and functional perspectives on discourses of science, Routledge, London, pp. 87-113.
Manco, Alberto (2016), «Forme testuali non rilevate nel fumetto. Descrizione, metalinguaggio, aspetti storici», in Alberto Manco, Azzurra Mancini, a cura di, Scritture brevi, segni, testi e contesti dalle iscrizioni antiche ai tweet, Napoli, «Quaderni di Aiωn», N.S. 5, pp. 129-148.
Marello, Carla, Verdiani, Silvia (2021), La testologia semiotica di J.S. Petőfi, dalla multimedialità alla multimodalità, in Margarita Borreguero Zuloaga, Paola Desideri, Luciano Vitacolonna, a cura di, Dalla TeSWeST alla Testologia Semiotica, teoria, metodi, applicazioni. “II International Workshop – János S. Petőfi”, Carabba Editore, Lanciano, pp. 109-133.
Petőfi, János S., Vitacolonna, Luciano (1996), (a cura di), Sistemi segnici e loro uso nella comunicazione umana. 3. La testologia semiotica e la comunicazione multimediale, Università di Macerata, Macerata.
Petőfi, Sándor János (2011), Per una teoria semiotica integrata del testo. Dalla teSWeST alla testologia semiotica, trad. di L. Vitacolonna, Carabba Editore, Lanciano.
Petőfi, Sándor János (2018 [2004]), «Talk at the Tavola Rotonda. Linguistica del testo, semiotica del testo, linguistica dei corpora, quali rapporti?», Turin, 27 February 2004, in RiCognizioni, Vol. 9, from
Petőfi, Sándor János (1985), «La ricerca sulla testologia semiotica in Europa. Una guida storica, tematica e bibliografica», in Studi Italiani di Linguistica Teorica ed Applicata, n. XIV, pp. 371-400.
Petőfi, Sándor János (1971), Transformationsgrammatiken und eine ko-textuelle Texttheorie, Grundfragen und Konzeptionen, Athenäum, Frankfurt am Main.
Petőfi, Sándor János (1996 [1988]), «La lingua come mezzo di comunicazione scritta, il testo», in János S. Petőfi, Luciano Vitacolonna, a cura di, Sistemi segnici e loro uso nella comunicazione umana. 3. La testologia semiotica e la comunicazione multimediale, Università di Macerata, Macerata, pp. 66-107. Prima edizione, Centro internazionale di semiotica e linguistica dell’Università di Ur¬bino, Urbino, 1988. Edizione inglese in An Encyclopedia of Language, edited by N[eville] E. Collinge, Routledge, 1990, London - New York, pp. 207-243.
Stöckl, Hartmut (2016), 1. Multimodalität - Semiotische und textlinguistische Grundlagen, in Nina-Maria Klug, Hartmut Stöckl (eds), Handbuch Sprache im multimodalen Kontext, De Gruyter Mouton, Berlin, Boston, pp. 3-35.
Verdiani, Silvia (2020), «Conglomerati di lingua e immagini nel discorso on line dell’attivismo politico. Modelli, esempi», in Linx – Revue des linguistes de l’Université Paris Ouest Nanterre La Défense, n. 13, Collocations et traditions discursives (Actes du Colloque du Collège Doctoral Franco-allemand (CDFA) tenu à l’Université de Potsdam le 4 juillet 2018) Paris, from https,//doi.org/10.4000/linx.3942
Verdiani, Silvia (2020), Silenzio, immagini e parole. La costruzione del significato nella multimodalità digitale, Torino, QuadRi-RiCOGNIZIONI, Vol. 10, from https://www.ojs.unito.it/index.php/QuadRi/issue/view/383
Works published in RIFL are released under Creative Commons Licence:Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
