Writing with a Reader in Mind

The Rhetorical Gap Between Genuine EFL Student Essays and LLM-Generated Essays

Autori

DOI:

https://doi.org/10.13136/2281-4582/2025.i26.1705

Parole chiave:

EFL, LLMs, Academic writing, Metadiscourse, AI-generated texts

Abstract

Recent research has highlighted the potential of large language models (LLMs) such as ChatGPT to support the development of ESP writing skills. However, concerns have also emerged about learners delegating writing tasks to these tools, potentially undermining learners’ motivation and autonomy. LLMs’ capacity to generate human-like text challenges the ability to ensure the authenticity of EFL students’ writing. Some studies have investigated LLM-generated text characteristics, comparing them with student writing. However, research on LLMs in EFL education remains limited. This paper seeks to address this gap and advance critical understanding of LLM-generated text. It reports on a small-scale study comparing three corpora: genuine undergraduate EFL student essays, suspected LLM-generated essays, and texts produced by ChatGPT 4.0 and DeepSeek-V3. The study examined patterns of interactive and interactional metadiscourse in the essays. Combining quantitative analysis with qualitative interpretation, it was found that although interactive features have limited explanatory power in distinguishing between LLM-generated text and genuine student essays, LLMs place strong emphasis on explicit cohesion, coherence and logical organization, favoring an objective and factual style. Most importantly, while they approximate human stance-taking, LLMs show very limited capacity to model audience and engage readers. This pattern was mirrored in the essays suspected to be LLM-generated. In contrast, genuine student writing was found to display a more personal tone and substantially greater reader engagement, regardless of target language proficiency.

Riferimenti bibliografici

Alexander, Katarzyna, Christine Savvidou and Chris Alexander. “Who Wrote this Essay? Detecting AI-Generated Writing in Second Language Education in Higher Education.” Teaching English with Technology 23.2 (2023): 25-43.

Amirjalili, Forough, Masoud Neysani and Ahmadreza Nikbakht. “Exploring the Boundaries of Authorship: A Comparative Analysis of AI-Generated Text and Human Academic Writing in English Literature.” Frontiers in Education 9 (2024): 9:1347421.

Barrot, Jessie S. “Using ChatGPT for Second Language Writing: Pitfalls and Potentials.” Assessing Writing 57 (2023): 100745.

Basic, Zeljana, et al. “Better by You, Better than Me? ChatGPT-3 as Writing Assistance in Students’ Essays.” arXiv (2023). https://arxiv.org/abs/2302.04536. Last visited 20/06/2025.

Bishop, Lea. “A Computer Wrote this Paper: What ChatGPT Means for Education, Research, and Writing.” SSRN (2023): 4338981. https://ssrn.com/abstract=4338981. Last visited 20/06/2025.

Borji, Ali. “A Categorical Archive of ChatGPT Failures.” arXiv preprint (2023): 2302.03494. https://arxiv.org/abs/2302.03494. Last visited 20/06/2025.

Cain, William. “Prompting Change: Exploring Prompt Engineering in Large Language Model AI and Its Potential to Transform Education.” TechTrends 68 (2024): 47-57.

Cogo, Alessia, Laura Patsko and Joanna Szoke. “Generative Artificial Intelligence and ELT.” ELT Journal 78.4 (2024): 373-377.

Creely, Edwin. “Exploring the Role of Generative AI in Enhancing Language Learning: Opportunities and Challenges.” International Journal of Changes in Education 1.3 (2024): 158-167.

De Wilde, Vanessa. “Can Novice Teachers Detect AI-generated Texts in EFL Writing?” ELT Journal 78.4 (2024): 414-422.

Frye, Brian L. “Should Using an AI Text Generator to Produce Academic Writing Be Plagiarism?” Fordham Intellectual Property, Media & Entertainment Law Journal 33.4 (2023): 946-968. https://ssrn.com/abstract=4292283. Last visited 20/06/2025.

Fyfe, Paul. “How to Cheat on Your Final Paper: Assigning AI for Student Writing.” AI & Society 38 (2023): 1395-1405.

Herbold, Steffen, et al. “A Large-Scale Comparison of Human-Written Versus ChatGPT-Generated Essays.” Scientific Reports 13.1 (2023): 18617.

Ho, Victor and Cissy Li. “The Use of Metadiscourse and Persuasion: An Analysis of First Year University Students’ Timed Argumentative Essays.” Journal of English for Academic Purposes 33 (2018): 53-68.

Huang, Jerry. “Engineering ChatGPT Prompts for EFL Writing Classes.” International Journal of TESOL Studies 5.4 (2023): 73-79.

Hyland, Ken. Metadiscourse: Exploring Interaction in Writing. London: Continuum, 2005.

---. “Stance and Engagement: A Model of Interaction in Academic Discourse.” Discourse Studies 7.2 (2005): 173-192.

Jiang, Feng Kevin and Ken Hyland. “Does ChatGPT Write Like a Student? Engagement Markers in Argumentative Essays.” Written Communication 42.3 (2025a): 463-492.

---. “Rhetorical distinctions: Comparing Metadiscourse in Essays by ChatGPT and Students.” English for Specific Purposes 79 (2025b): 17-29.

Kohnke, Lucas, Benjamin Luke Moorhouse and Di Zou. “ChatGPT for Language Teaching and Learning.” RELC Journal 54.2 (2023): 537-550.

Mo, Zishan and Peter Crosthwaite. “Exploring the Affordances of Generative AI Large Language Models for Stance and Engagement in Academic Writing.” Journal of English for Academic Purposes 75 (2025): 101499.

Moorhouse, Benjamin Luke, Marie Alina Yeo and Yuwei Wan. “Generative AI Tools and Assessment: Guidelines of the World’s Top-Ranking Universities.” Computers & Education Open 5 (2023): 1-10.

Ramazani, Alireza, Houman Bijani and Mohammad Reza Oroji. “Comparative Analysis of AI vs. Human Feedback Effects on IELTS Candidates’ Writing Performance.” Journal of Foreign Language Teaching and Translation Studies 10.1 (2025): 17-40.

Rong, Hui and Charlene Chun. “Digital Education Council Global AI Student Survey 2024.” Digital Education Council (2024). https://www.digitaleducationcouncil.com/post/

digital-education-council-global-ai-student-survey-2024. Last visited 20/06/2025.

Schulhoff, Sander, et al. “The Prompt Report: A Systematic Survey of Prompting Techniques.” arXiv preprint (2024): 2406.06608. https://arxiv.org/abs/2406.06608. Last visited 20/06/2025.

Su, Yanfang, Yun Lin and Chun Lai. “Collaborating with ChatGPT in Argumentative Writing Classrooms.” Assessing Writing 57 (2023): 100752.

Teng, Mark Feng. “Metacognitive Awareness and EFL Learners’ Perceptions and Experiences in Utilising ChatGPT for Writing Feedback.” European Journal of Education 60.1 (2025): e12811.

Warschauer, Mark, et al. “The Affordances and Contradictions of AI-Generated Text for Writers of English as a Second or Foreign Language.” Journal of Second Language Writing 62 (2023): 101071.

Woo, David J., et al. “Exploring AI-Generated Text in Student Writing: How Does AI Help?” Language Learning & Technology 28.2 (2024): 183-208.

Yoo-Jean, Lee. “Can My Writing Be Polished Further? When ChatGPT Meets Human Touch.” ELT Journal 78.4 (2024): 401-413.

Yoon, Hyung-Jo. “Interactions in EFL Argumentative Writing: Effects of Topic, L1 Background, and L2 Proficiency on Interactional Metadiscourse.” Reading and Writing 34.3 (2021): 705-725.

Zhao, Cecilia Guanfang. “Voice in Timed L2 Argumentative Essay Writing.” Assessing Writing 31 (2017): 73-83.

Pubblicato

2025-12-19

Fascicolo

Sezione

Articoli (sezione generale) - lingua e linguistica inglese