The Art of Generative Narrativity

Authors

DOI:

https://doi.org/10.13136/2281-4582/2024.i24.1543

Keywords:

Artificial Intelligence, Computational Art, Generative AI, Generative art, Narrativity

Abstract

Recent advancements in generative artificial intelligence (generative AI) technologies have transformed the computer science discipline of natural language processing. However, generative AI retains the anthropomorphic model of simulating human narrative construction and verbal communication whereas, for artists, the ideational exploration is often more important than human mimicry or even plausibility in storytelling. It sometimes leads to generative experiments with non-verbal forms or events that have the potential to incite narratives through the audience’s experience of the works’ functionalities, backgrounds, and contexts. In this paper, we focus on such artistic approaches to narrativity. In five central sections, we discuss interrelated exemplars whose conceptual frameworks, methodologies, and other attributes anticipate or underscore the issues of contemporary linguistic automation based on massive datafication and statistical retrospection. In closing sections, we summarize the expressive features of these exemplars and underline their value for critically assessing generative AI’s cultural influence and fallouts.

Author Biographies

  • Dejan Grba, Interdisciplinary Graduate Center, University of the Arts, Belgrade

    Dejan Grba is an artist and scholar who explores the expressive and relational features of emerging media arts. His work has been exhibited and published worldwide. He has served as an associate professor in the Digital Art Program of the Interdisciplinary Graduate Center at the University of the Arts in Belgrade, and as a founding chair of the New Media department at the Faculty of Fine Arts in Belgrade. He was a Visiting Associate Professor in the School of Art Design and Media at the NTU in Singapore.

  • Vladimir Todorović, School of Design, University of Western Australia, Perth

    Vladimir Todorović is an artist, researcher, and educator living in the Whadjuk region, Australia, where he is the chair of Fine Arts in the School of Design at UWA. He works with new technologies for immersive and generative storytelling. His art explores our relationship with the changing environment and our misuse of past, current, and future technologies. His projects have won multiple awards and have been showcased at festivals, exhibitions, museums and galleries across the globe.

References

Aarseth, Espen J. Cybertext: Perspectives on Ergodic Literature. Baltimore: Johns Hopkins University Press, 1997.

Abbott, Porter H. The Cambridge Introduction to Narrative. Cambridge: Cambridge University Press, 2008.

ACMI Museum. “Hundred Thousand Billion Poems.” ACMI Museum, 2024. www.acmi.net.au/works/112--hundred-thousand-billion-poems/. All websites were visited on 18/06/2024.

Ars Electronica. “Conversations Beyond the Ordinary: Jan Zuiderveld.” Ars Electronica, 2024. ars.electronica.art/hope/en/conversations-beyond-the-ordinary/.

Bajohr, Hannes. “Writing at a Distance: Notes on Authorship and Artificial Intelligence.” German Studies Review 47.2 (2024): 315-337.

Bender, Emily, et al. “On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?” FAccT '21: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 2021. 610-623.

Benney, Marnie and Pete Kistler. “Generative Art Guide: Examples, Software and Tools to Make Algorithm Art.” AI Artists, 2023. aiartists.org/generative-art-design.

Bernhart, Toni. “Beiwerk als Werk: Stochastische Texte von Theo Lutz.” editio 34 (2020): 180-206.

Berry, David M. Critical Theory and the Digital. London: Bloomsbury Publishing, 2014.

Böhlen, Marc. “Amy and Klara.” Marc Böhlen, 2008. realtechsupport.org/projects/maledicta.html.

Bommasani, Rishi, et al. “On the Opportunities and Risks of Foundation Models.” arXiv, 2022. doi.org/10.48550/arXiv.2108.07258.

Breton, André, Philippe Soupault and David Gascoyne. The Magnetic Fields. London: Atlas Press, 1985.

Bulhak, Andrew C. “On the Simulation of Postmodernism and Mental Debility Using Recursive Transition Networks.” Department of Computer Science Technical Report 96/264. Monash University, 1996.

Bullivant, Lucy. “The Listening Post: Ben Rubin and Mark Hansen.” Architectural Design 75.1 (2005): 91-93.

Butler, Christopher. Postmodernism: A Very Short Introduction. Oxford: Oxford University Press, 2003.

Cabell, Mimi. “American Psycho.” Mimi Cabell, 2012. www.mimicabell.com/#/american-psycho.

Cirio, Paolo and Alessandro Ludovico. “Face to Facebook.” Face to Facebook, 2011. www.face-to-facebook.net.

Clements, Wayne. “Tape Mark 1.” Wayne Clements, 2013. www.in-vacua.com/cgi-bin/tapemark.pl.

D’Ambrosio, Matteo. “The Early Computer Poetry and Concrete Poetry.” MATLIT: Materialidades Da Literatura 6.1 (2018): 51-72.

Dal Dosso, Silvia. “The Future Ahead Will Be Weird AF (The Ultimate AI CoreCore Experience).” Silvia Dal Dosso, 2023. youtu.be/ZpNRfzwnXJc?si=WnT6HlUAWnx_wnYW.

Decker-Phillips, Edith. Paik Video. Barrytown: Station Hill Press, 2010.

DuBois, R. Luke. “A More Perfect Union.” Luke DuBois, 2011. www.lukedubois.com/projects-2/perfect.

Dyment, Dave. “Watching Night of the Living Dead.” Dave Dyment, n.d. www.dave-dyment.com/watching-night-of-the-living-dead.

Dzieza, Josh. “The Strange World of Computer-generated Novels.” The Verge 25 November 2014. www.theverge.com/2014/11/25/7276157/nanogenmo-robot-author-novel.

Electronic Literature Collection. “Façade.” Electronic Literature Collection, n.d. collection.eliterature.org/2/works/mateas_facade.html.

Eltes, Jonas. “Lost in Computation.” Jonas Eltes, 2017. jonaselt.es/projects/lost-in-computation.

Elwes, Jake. “A.I. Interprets A.I. Interpreting ‘Against Interpretation’ (Sontag 1966).” Jake Elwes, 2023. www.jakeelwes.com/project-sontag.html.

---. “Closed Loop.” Jake Elwes, 2017. www.jakeelwes.com/project-closedLoop.html.

Epstein, Ziv, et al. “Art and the Science of Generative AI: Understanding Shifts in Creative Work Will Help Guide AI’s Impact on the Media Ecosystem.” Science 380.6650 (2023): 1110-1111.

Feingold, Ken. “Works.” Ken Feingold, 2021. www.kenfeingold.com.

Franke, Herbert. W. Computergraphik, Computerkunst. München: Bruckmann, 1985.

Funkhouser, Christopher Thompson. Prehistoric Digital Poetry: An Archaeology of Forms, 1959-1995. Tuscaloosa: The University of Alabama Press, 2007.

Gaboury, Jacob. “A Queer History of Computing: Part Three [Christopher Strachey].” Rhizome, 2013. rhizome.org/editorial/2013/apr/9/queer-history-computing-part-three/.

Galanter, Philip. “Generative Art Theory.” A Companion to Digital Art. Edited by Christiane Paul. Chichester: John Wiley & Sons, Inc., 2016. 146-180.

Galloway, Alexander R. Gaming: Essays on Algorithmic Culture. Minneapolis: University of Minnesota Press, 2006.

Garber, Megan. “When PARRY Met ELIZA: A Ridiculous Chatbot Conversation From 1972.” The Atlantic, 8 June 2014. www.theatlantic.com/technology/archive/2014/06/when-parry-met-eliza-a-ridiculous-chatbot-conversation-from-1972/372428.

Goodwin, Ross. “Sunspring.” YouTube, 2016. youtu.be/LY7x2Ihqjmc.

Grba, Dejan. “Alpha Version, Delta Signature: Cognitive Aspects of Artefactual Creativity.” Journal of Science and Technology of the Arts 12.3 (2020): 63-83.

---. “Art Notions in the Age of (Mis)anthropic AI.” Arts 13.5 (2024): 1-27.

---. “Avoid Setup: Insights and Implications of Generative Cinema.” Leonardo 50.4 (2017): 384-393.

---. “Get Lucky: Cognitive Aspects of Generative Art.” XIX Generative Art Conference Proceedings. Edited by Celestino Sodu. Milan: Domus Argenia, 2015. 200-213.

Grierson, Mick. “Plundermatics: Real-time Interactive Media Segmentation for Audiovisual Analysis, Composition and Performance.” EVA’09 Proceedings. Swindon: BCS Learning & Development Ltd., 2009. 276-284.

Hall, Jason David. Nineteenth-century Verse and Technology: Machines of Meter. Cham: Palgrave Macmillan/Springer Nature, 2017.

---. “Popular Prosody: Spectacle and the Politics of Victorian Versification.” Nineteenth-Century Literature 62.2 (2007): 222-249.

Higgins, Hannah B. and Douglas Kahn, eds. Mainframe Experimentalism: Early Computing and the Foundation of the Digital Arts. Berkeley: University of California Press, 2012.

Ho, Jonathan, et al. “Cascaded Diffusion Models for High Fidelity Image Generation.” Journal of Machine Learning Research 23.47 (2022): 1-33.

Hodges, Andrew. Alan Turing: The Enigma. Princeton: Princeton University Press, 2014.

Hopkins, David. After Modern Art: 1945-2000. Oxford: Oxford University Press, 2000.

Hosein, Lise. “Night of the Living Dead Has a Scarier Story Than You Think...because Copyright Is Terrifying.” CBC Arts 31 July 2018. www.cbc.ca/arts/night-of-the-living-dead-has-a-scarier-story-than-you-think-because-copyright-is-terrifying-1.4768307.

Huang, Lei, et al. “A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions.” arXiv, 2023. doi.org/10.48550/arXiv.2311.05232.

Jay, Ricky. “The Automaton Chess Player.” Jay’s Journal of Anomalies. New York: Farrar, Straus and Giroux, 2001. 148.

Karmann, Bjørn. “Paragraphica.” Bjørn Karmann, 2023. bjoernkarmann.dk/project/paragraphica.

Larson, Erik J. The Myth of Artificial Intelligence: Why Computers Can’t Think the Way We Do. Cambridge: The Belknap Press of Harvard University Press, 2021.

Lund, Jonas. “The Future of Nothing.” Jonas Lund, 2023a. jonaslund.com/works/the-future-of-nothing/.

---. “The Future of Something.” Jonas Lund, 2023b. jonaslund.com/works/the-future-of-something/.

Marcus, Gary F. Taming Silicon Valley: How We Can Ensure That AI Works for Us. Cambridge: The MIT Press, 2024.

Memelink, Marissa and Edwin van der Heide. “Tracing Autonomy & Artistic Significance: An Alternative Framework for Analysing & Comparing Generative Art.” Proceedings of xCoAx 2023, 11th Conference on Computation, Communication, Aesthetics & X. Edited by Mario Verdicchio, et al. Porto: i2ADS, 2023. 237-305.

Merchant, Brian. “This App Translates Your Photos into Stories.” Motherboard, 13 April 2015. motherboard.vice.com/en_us/article/8qx7q3/the-app-that-translates-your-pictures-into-words.

Mindell, David A. Our Robots, Ourselves: Robotics and the Myths of Autonomy. New York: Viking Adult, 2015.

MIT Docubase. “Jonathan Harris and Greg Hochmuth: Network Effect.” MIT Docubase, 2015. docubase.mit.edu/project/network-effect/.

Mitchell, Melanie and David C. Krakauer. “The Debate Over Understanding in AI’s Large Language Models.” Proceedings of the National Academy of Sciences (PNAS) 120.13 (2023).

Mitchell, Melanie. Artificial Intelligence: A Guide for Thinking Humans. New York: Farrar, Straus and Giroux, 2019.

Molderings, Herbert. Duchamp and the Aesthetics of Chance: Art as Experiment. New York: Columbia University Press, 2010.

Montfort, Nick. “Love Letters.” Nick Montfort, 2014. nickm.com/memslam/love_letters.html.

---. “World Clock.” Nick Montfort, 2013. nickm.com/post/2013/11/world-clock/.

Muldtofte Olsen, Lea. “Grammatized Psychopath: American Psycho Online and Offline.” APRJA Journal 4.1 (2015): 78-86.

O’Neil, Cathy. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. New York: Crown, 2016.

Parrish, Allison. “Articulations.” Allison Parrish, 2018. counterpathpress.org/articulations-allison-parrish.

Paulsen, Kris. “Shitty Automation: Art, Artificial Intelligence, Humans in the Loop.” Media-N | The Journal of the New Media Caucus 16.1 (2020): 4-23.

Quinn, Marc. “DNA Portrait of Sir John Sulston.” Marc Quin, 2001. marcquinn.com/artworks/single/dna-portrait-of-sir-john-sulston.

Quinn, Marc. “Self-Conscious.” Marc Quin, 2000. marcquinn.com/artworks/single/self-conscious-19-10-2000.

Ramesh, Aditya, et al. “Zero-Shot Text-to-Image Generation.” arXiv, 2021. arxiv.org/pdf/2102.12092.

Richardson, Matt. “Descriptive Camera.” Matt Richardson, 2012. mattrichardson.com/Descriptive-Camera/index.html.

Rosen, Diane. “Figuration of the Possible: Complexity, Interactive Art, and Social Change.” Nonlinear Dynamics Psychol Life Sci 26.4 (2022): 465-486.

Rosenberg, Alex. How History Gets Things Wrong: The Neuroscience of Our Addiction to Stories. Cambridge: The MIT Press, 2018.

Sanchez, Téo. “Examining the Text-to-Image Community of Practice: Why and How do People Prompt Generative AIs?” ACM Conference on Creativity & Cognition, Association for Computing Machinery, 2023. hal.science/hal-04127516.

Sephton, Matt. “Christopher Strachey’s Loveletters (1952).” Matt Sephton, n.d. www.gingerbeardman.com/loveletter/.

Slater, Avery. “Post-Automation Poetics: or How Cold-War Computers Discovered Poetry.” American Literature 95.2 (2023): 205-227.

Sokal, Alan and Jean Bricmont. Fashionable Nonsense: Postmodern Philosophers’ Abuse of Science. New York: Picador, 1998.

Sokal, Alan. Beyond the Hoax: Science, Philosophy and Culture. Oxford: Oxford University Press, 2008.

Stephens, Elizabeth. “The Mechanical Turk: A Short History of ‘Artificial Artificial Intelligence.’” Cultural Studies 37.1 (2023): 65-87.

Strachey, Christopher. “The ‘Thinking’ Machine.” Encounter 3 (1954): 25-31.

Todorović, Vladimir and Dejan Grba. “Wandering Machines: Narrativity in Generative Art.” CITAR Journal of Science and Technology of the Arts, Special xCoAx Issue (2019): 50-58.

Tzara, Tristan. “Dada Manifesto on Feeble Love and Bitter Love.” Seven Dada Manifestos and Lampisteries. Richmond: Alma Classics, 2013. 31-48.

V.A. Robert Morris: The Mind-body Problem. New York: Rizzoli, 1994.

Van Buskirk, Eliot. “The Man Behind Scrambled Hackz.” WIRED 17 April 2006. www.wired.com/2006/04/the-man-behind-scrambled-hackz/.

von Bismarck, Julius and Benjamin Maus. “Perpetual Storytelling Apparatus.” Julius von Bismarck, 2008, juliusvonbismarck.com/bank/index.php?/projects/perpetual-storytellin-apparatus/.

Waagner Falkenstrøm, Cecilie. “Covid-19 AI Battle.” Cecilie Waagner Falkenstrøm, 2020. www.artificialmind.ai/projects/covid-19-ai-battle.

Wardrip-Fruin, Noah. Expressive Processing: Digital Fictions, Computer Games, and Software Studies. Cambridge: The MIT Press, 2009.

Weizenbaum, Joseph. Computer Power and Human Reason: From Judgment to Calculation. New York: W. H. Freeman and Company, 1976.

---. “ELIZA: A Computer Program for the Study of Natural Language Communication Between Man and Machine.” Communications of the ACM 9.1 (1966): 36-45.

Wikipedia. “Corecore.” Wikipedia, 2024. en.wikipedia.org/wiki/Corecore.

Wilde, Lukas R. A., et al., eds. “Generative Imagery: Towards a ‘New Paradigm’ of Machine Learning-Based Image Production.” Image 37.1 (2023).

Xu, Ziwei, et al. “Hallucination is Inevitable: An Innate Limitation of Large Language Models.” arXiv, 2024. doi.org/10.48550/arXiv.2401.11817.

Yang, Ling, et al. “Diffusion Models: A Comprehensive Survey of Methods and Applications.” arXiv, 2022. arxiv.org/abs/2209.00796v11.

Zhu, Yukun, et al. “Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books.” arXiv, 2015. arxiv.org/abs/1506.06724.

ZKM. “Theo Lutz: Stochastische Texte.” ZKM | Center for Art and Media Karlsruhe, 2020. zkm.de/en/artwork/stochastic-texts.

Zuboff, Shoshana. The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power. New York: Public Affairs, 2019.

Downloads

Published

2024-12-20