Is ChatGPT helpful for graduate students in acquiring knowledge about digital storytelling and reducing their cognitive load? An experiment

Authors

DOI: https://doi.org/10.6018/red.604621
Keywords: Artificial Intelligence in Education, Digital Storytelling, Cognitive Load Theory, ChatGPT, Narrative Writing Skills

Abstract

This study examines the impact of ChatGPT on narrative scriptwriting abilities and cognitive load in a sample of 41 master's students enrolled in a Digital Narratives course. Using a randomized experimental design, participants were divided into two groups: an experimental group (n = 20) that interacted with ChatGPT and a control group (n = 21) that did not. Our methods involved pre- and post-tests to assess changes in digital storytelling skills and cognitive load, as defined by intrinsic, extraneous, and germane load measures. The results indicated no significant improvement in digital storytelling skills for the experimental group compared to the control group, suggesting that the use of ChatGPT does not markedly enhance narrative writing abilities in the short term. However, a significant reduction in germane cognitive load was observed among the experimental group, pointing to ChatGPT's potential to facilitate the learning process by reducing the mental effort required for task integration and application. The study underscores the complexity of integrating AI into learning environments and highlights the need for strategic AI implementation tailored to specific educational objectives. It also points to the importance of longitudinal research to fully understand the long-term effects of AI on learning and cognitive development.

Downloads

Download data is not yet available.

References

Avello-Martínez, R., Gómez-Rodríguez, V., & Rodríguez-Monteagudo, M. (2023). Las narrativas digitales en la formación de postgrado de maestros. Una experiencia en la universidad bolivariana del Ecuador. Identidad Bolivariana, 7(3), Article 3. https://doi.org/10.37611/IB7ol3167-178

Bai, L., Liu, X., & Su, J. (2023). ChatGPT: The cognitive effects on learning and memory. Brain-X, 1(3), e30. https://doi.org/10.1002/brx2.30

Essel, H. B., Vlachopoulos, D., Essuman, A. B., & Amankwa, J. O. (2024). ChatGPT effects on cognitive skills of undergraduate students: Receiving instant responses from AI-based conversational large language models (LLMs). Computers and Education: Artificial Intelligence, 6, 100198. https://doi.org/10.1016/j.caeai.2023.100198

Fang, X., Ng, D. T. K., Leung, J. K. L., & Chu, S. K. W. (2023). A systematic review of artificial intelligence technologies used for story writing. Education and Information Technologies, 28(11), 14361-14397. https://doi.org/10.1007/s10639-023-11741-5

García-Peñalvo, F. J. (2023). La percepción de la Inteligencia Artificial en contextos educativos tras el lanzamiento de ChatGPT: Disrupción o pánico. Education in the Knowledge Society (EKS), 24, e31279-e31279. https://doi.org/10.14201/eks.31279

Hurtado-Mazeyra, A., Alejandro-Oviedo, O. M., Núñez-Pacheco, R., & Almenara, J. C. (2023). El Digital Storytelling en la modalidad 2D y con realidad aumentada para el desarrollo de la creatividad en la educación infantil. Revista de Educación a Distancia (RED), 23(73), Article 73. https://doi.org/10.6018/red.536641

Jafari, F., & Keykha, A. (2023). Identifying the opportunities and challenges of artificial intelligence in higher education: A qualitative study. Journal of Applied Research in Higher Education, ahead-of-print(ahead-of-print). https://doi.org/10.1108/JARHE-09-2023-0426

Ji, Y., Zou, X., Li, T., & Zhan, Z. (2024). The effectiveness of ChatGPT on pre-service teachers’ STEM teaching literacy, learning performance, and cognitive load in a teacher training course. Proceedings of the 2023 6th International Conference on Educational Technology Management, 16-22. https://doi.org/10.1145/3637907.3637948

Klepsch, M., Schmitz, F., & Seufert, T. (2017). Development and Validation of Two Instruments Measuring Intrinsic, Extraneous, and Germane Cognitive Load. Frontiers in Psychology, 8. https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2017.01997

Pellas, N. (2023). The Effects of Generative AI Platforms on Undergraduates’ Narrative Intelligence and Writing Self-Efficacy. Education Sciences, 13(11), Article 11. https://doi.org/10.3390/educsci13111155

Rodriguez, C. L., Garcia-Jimenez, M., Masso-Guijarro, B., & Cruz-Gonzalez, C. (2021). Digital Storytelling in Education: A Systematic Review of the Literature. Review of European Studies, 13, 13.

The jamovi project. (2024). Jamovi (Version 2.3)[Computer Software]. https://www.jamovi.org/about.html

van Gog, T., Paas, F., & Sweller, J. (2010). Cognitive Load Theory: Advances in Research on Worked Examples, Animations, and Cognitive Load Measurement. Educational Psychology Review, 22(4), 375-378. https://doi.org/10.1007/s10648-010-9145-4

Vandewaetere, M., & Clarebout, G. (2013). Cognitive Load of Learner Control: Extraneous or Germane Load? Education Research International, 2013, e902809. https://doi.org/10.1155/2013/902809

Wu, J., & Chen, D.-T. V. (2020). A systematic review of educational digital storytelling. Computers & Education, 147, 103786. https://doi.org/10.1016/j.compedu.2019.103786

Published
30-05-2024
How to Cite
Avello-Martínez, R., Gajderowicz, T., & Gómez-Rodríguez, V. G. (2024). Is ChatGPT helpful for graduate students in acquiring knowledge about digital storytelling and reducing their cognitive load? An experiment. Distance Education Journal, 24(78). https://doi.org/10.6018/red.604621
Issue
Vol. 24 No. 78 (2024): Generative AI, ChatGPT and Education. Consequences for Intelligent Learning and Educational Assessment.
Section
Articles

Copyright (c) 2024 Distance Education Journal

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Las obras que se publican en esta revista están sujetas a los siguientes términos:

1. El Servicio de Publicaciones de la Universidad de Murcia (la editorial) conserva los derechos patrimoniales (copyright) de las obras publicadas, y favorece y permite la reutilización de las mismas bajo la licencia de uso indicada en el punto 2.

2. Las obras se publican en la edición electrónica de la revista bajo una licencia Creative Commons Reconocimiento-NoComercial-SinObraDerivada 3.0 España (texto legal). Se pueden copiar, usar, difundir, transmitir y exponer públicamente, siempre que: i) se cite la autoría y la fuente original de su publicación (revista, editorial y URL de la obra); ii) no se usen para fines comerciales; iii) se mencione la existencia y especificaciones de esta licencia de uso.

Licencia Creative Commons

3. Condiciones de auto-archivo. Se permite y se anima a los autores a difundir electrónicamente las versiones pre-print (versión antes de ser evaluada) y/o post-print (versión evaluada y aceptada para su publicación) de sus obras antes de su publicación, ya que favorece su circulación y difusión más temprana y con ello un posible aumento en su citación y alcance entre la comunidad académica. Color RoMEO: verde.