Mediating Effects of Essay Writing on the Relationship Between ChatGPT Usage and Critical Thinking in Undergraduate EFL Students: A SmartPLS Approach

Yenni Shintia, Nunung Nurjati, Endah Yulia Rahayu

Abstract


This study investigates whether essay-writing skills mediate the relationship between ChatGPT usage and critical thinking among undergraduate English as a foreign language (EFL) students. Using a quantitative design with partial least squares structural equation modeling (PLS-SEM) in SmartPLS, we analyzed data from 201 students at UINSA Surabaya (167 women; 34 men). PLS-SEM was selected for its suitability in modeling complex mediation with small to medium samples. The measurement model captured essay-writing elements (e.g., clarity, argumentation, coherence) and critical-thinking facets (e.g., inference, reasoning, evaluation). Structural results indicate that ChatGPT usage has a significant, positive association with critical thinking (path coefficient β = 0.401, p < .001). Essay-writing skills also exhibit a positive effect on critical thinking and function as a meaningful mediator, suggesting that gains in writing quality help translate the use of ChatGPT into higher-order thinking. Diagnostic checks flagged several cross-loadings, indicating potential threats to discriminant validity and construct clarity. Because unaddressed cross-loadings can bias parameter estimates and reduce measurement equivalence, educators and researchers should interpret structural paths with caution and align decisions with theory. Pedagogically, the findings support the guided integration of ChatGPT, emphasizing the critical appraisal of AI output, source evaluation, and iterative drafting, to strengthen students’ argumentation and reasoning. We recommend that instructors scaffold reflective prompts and verification routines so that perceived accuracy aligns with actual accuracy, thereby leveraging AI while safeguarding academic rigor.

Keywords


Artificial Intelligence; AI Chat GPT; Critical Thinking;Essay Writing

rticle

References


Barton, H., Vlachopoulos, D., Benjamin, A., & Opuni, J. (2024). ChatGPT effects on cognitive skills of undergraduate students: Receiving instant responses from AI-based conversational large language models (LLMs). Computers and Education: Artificial Intelligence, 6, 100198. https://doi.org/10.1016/j.caeai.2023.100198

Darwin, Rusdin, D., Mukminatien, N., Suryati, N., Laksmi, E. D., & Marzuki. (2024). Critical thinking in the AI era: An exploration of EFL students’ perceptions, benefits, and limitations. Cogent Education, 11(1), 2290342. https://doi.org/10.1080/2331186X.2023.2290342

Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 61(3), 460–474. https://doi.org/10.1080/14703297.2023.2195846

Fithriani, R. (2021). The utilization of mobile-assisted gamification for vocabulary learning: Its efficacy and perceived benefits. Computer Assisted Language Learning Electronic Journal, 22(3), 146–163.

Floris, F. D., Widiati, U., Renandya, W. A., & Basthomi, Y. (2024). Artificial intelligence in English language teaching: Fostering joint enterprise in online communities. JEES (Journal of English Educators Society), 9(1), 12–21. https://doi.org/10.21070/jees.v9i1.1825

Goodwin, M., & Liu, Y. (2023). Investigating SmartPLS in education research: Applications in language skills. Journal of Educational Research, 116(4), 409–419. https://doi.org/10.1080/00220671.2023.1324434

Hughes, J. (2014). Critical thinking in the language classroom. ELI Publishing.

Lo, C. K., Hew, K. F., & Jong, M. S. (2024). The influence of ChatGPT on student engagement: A systematic review and future research agenda. Computers & Education, 219, 105100. https://doi.org/10.1016/j.compedu.2024.105100

Maghamil, M., & Sieras, S. (2024). Impact of ChatGPT on the academic writing quality of senior high school students. Journal of English Language Teaching and Applied Linguistics, 6(2), 115–128. https://doi.org/10.32996/jeltal.2024.6.2.14

Mahapatra, S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: A mixed-methods intervention study. Smart Learning Environments, 11(9), 1–18. https://doi.org/10.1186/s40561-024-00295-9

Mhlanga, D. (2023). OpenAI in education: The responsible and ethical use of ChatGPT towards lifelong learning. In Responsible AI in higher education (pp. 387–409). Springer. https://doi.org/10.1007/978-3-031-37776-1_17

Montgomery, D. P. (2023). “This study is not without its limitations”: Acknowledging limitations and recommending future research in applied linguistics research articles. Journal of English for Academic Purposes, 65, 101291. https://doi.org/10.1016/j.jeap.2023.101291

Nizzolino, S. (2024). Artificial Intelligence in Language Teaching: Using ChatGPT to assist teachers of English as a Foreign Language. Form@re - Open Journal Per La Formazione in Rete, 24(1), 242–261. https://doi.org/10.36253/form-15681

Paul, R., Elder, L., & Bartell, T. (2018). A brief history of the idea of critical thinking. Kwelanga Training (Pty) Ltd.

Prasetya, R. E., & Syarif, A. (2023). ChatGPT as a tool for language development: Investigating its impact on proficiency and self-evaluation accuracy in Indonesian higher education. VELES (Voices of English Language Education Society), 7(3), 402–415. https://doi.org/10.29408/veles.v7i3.19303

Teng, M. F. (2024). “ChatGPT is the companion, not enemies”: EFL learners’ perceptions and experiences in using ChatGPT for feedback in writing. Computers and Education: Artificial Intelligence, 7, 100270. https://doi.org/10.1016/j.caeai.2024.100270

Wale, B. D., & Bishaw, K. S. (2020). Effects of using inquiry-based learning on EFL students’ critical thinking skills. Asian-Pacific Journal of Second and Foreign Language Education, 5(1), 1–17. https://doi.org/10.1186/s40862-020-00090-2




DOI: https://doi.org/10.20961/ijpte.v9i2.93423

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Yenni Shintia, Nunung Nurjati, Endah Yulia Rahayu

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

  

International Journal of Pedagogy and Teacher Education

Print ISSN: 2597-7792
Online ISSN: 2549-8525
Website: https://jurnal.uns.ac.id/ijpte/index
Email: ijpte@mail.uns.ac.id
Published by: Faculty of Teacher Training and Education, Universitas Sebelas Maret
Ir. Sutami Street, No. 36A, Surakarta, Jawa Tengah Indonesia