Your browser does not support the PubReader view.
Go to this page to see a list of supporting browsers.
The Korean Association for the Study of English Language and Linguistics
[ Article ]
Korea Journal of English Language and Linguistics - Vol. 23, No. 0, pp.1136-1153
ISSN: 1598-1398 (Print) 2586-7474 (Online)
Print publication date 30 Jan 2023
Received 04 Nov 2023 Revised 07 Dec 2023 Accepted 13 Dec 2023
DOI: https://doi.org/10.15738/kjell.23..202312.1136

Young Korean EFL Learners’ Perception of Role-Playing Scripts: ChatGPT vs. Textbooks

Sol Kim ; Seon-Ho Park
(First author) Teacher, Hyohaeng Elementary School solkim@hyohaeng.es.kr
(Corresponding author) Professor, Dept. of English, Gyeongin National University of Education shpark@ginue.ac.kr


© 2023 KASELL All rights reserved
This is an open-access article distributed under the terms of the Creative Commons License, which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

This study explores the perceptions of elementary students in South Korea regarding two types of scripts used in reader’s theaters: those derived from textbooks and those generated by ChatGPT. The research involved 27 fourth-grade students from Gyeonggi Province. The scripts consisted of six topics, each with dialogues presented in the textbooks and those created by GPT-3.5 to match the language proficiency of 9-year-old EFL learners. Students performed both script types in reader’s theaters, and evaluations were conducted based on text flow, storyline attractiveness, English level, and practice process. Surveys were conducted twelve times, and results were analyzed using repeated measures of two-way ANOVA. The study revealed some statistical differences in the storyline attractiveness and English level, aligning with various student opinions. The study underscores the potential of integrating Artificial Intelligence (AI), such as ChatGPT, into English teaching while discussing pedagogical implications and emphasizing the need for differentiated approaches based on students’ linguistic abilities. Suggestions for future research involving Chat GPT in elementary English education are provided.

Keywords:

ChatGPT, AI, textbook, elementary, EFL, perception, storyline, English level

References

  • Aoun, J. E. 2018. Robot-Proof: Higher Education in the Age of Artificial Intelligence. MIT Press. [https://doi.org/10.7551/mitpress/11456.001.0001]
  • Ausat, A. M. A., B. Massang, M. Efendi, N. Nofirman and Y. Riady. 2023. Can chat GPT replace the role of the teacher in the classroom: A fundamental analysis. Journal on Education 5(4), 16100-16106.
  • Baidoo-Anu, D. and L. Owusu Ansah. 2023. Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI 7(1), 52-62. [https://doi.org/10.2139/ssrn.4337484]
  • Bender, E. M., T. Gebru, A. McMillan-Major and S. Shmitchell. 2021. On the dangers of stochastic parrots: Can language models be too big? In FAccT ’21: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 610-623. Association for Computing Machinery. [https://doi.org/10.1145/3442188.3445922]
  • Bonner, E., R. Lege and E. Frazier. 2023. Large language model-based artificial intelligence in the language classroom: Practical ideas for teaching. Teaching English with Technology 23(1), 23-41. [https://doi.org/10.56297/BKAM1691/WIEO1749]
  • Bora, S. F. 2021. Taking literature off page! The effectiveness of a blended drama approach for enhancing L2 oral accuracy, pronunciation and complexity. Language Teaching Research, available online at https://doi.org/10.1177/13621688211043490 [https://doi.org/10.1177/13621688211043490]
  • Brown, T., B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, ... and D. Amodei. 2020. Language models are few-shot learners. Advances in Neural Information Processing Systems 33, 1877-1901.
  • Carlini, N., F. Tramer, E. Wallace, M. Jagielski, A. Herbert-Voss, K. Lee, ... and C. Raffel. 2021. Extracting training data from large language models. In 30th USENIX Security Symposium (USENIX Security 21) 2633-2650.
  • Castillo, A., G. Silva, J. Arocutipa, H. Berrios, M. Rodriguez, G. Reyes, ... and J. Arias-Gonzáles. 2023. Effect of Chat GPT on the digitized learning process of university students. Journal of Namibian Studies: History Politics Culture 33, 1-15. [https://doi.org/10.59670/jns.v33i.411]
  • Devlin, J., M. W. Chang, K. Lee and K. Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
  • Fedus, W., B. Zoph and N. Shazeer. 2022. Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity. The Journal of Machine Learning Research 23(1), 5232-5270.
  • Godwin-Jones, R. 2021. Big data and language learning: Opportunities and challenges. Language Learning & Technology 25(1), 4-19.
  • Hassoulas, A., N. Powell, L. Roberts, K. Umla-Runge, L. Gray and M. Coffey. 2023. Investigating marker accuracy in differentiating between university scripts written by students and those produced using ChatGPT. Journal of Applied Learning & Teaching 6(2), 1-7. [https://doi.org/10.37074/jalt.2023.6.2.13]
  • Hautala, J., M. Ronimus and E. Junttila. 2023. Readers’ theater projects for special education: A randomized controlled study. Scandinavian Journal of Educational Research 67(5), 663-678. [https://doi.org/10.1080/00313831.2022.2042846]
  • Jung, H., Y. Lee and D. Shin. 2022. A survey study on pre-service teachers’ perceptions of AI-generated texts. Bilingual Research 90, 193-217.
  • Kim, H., H. Yang, D. Shin and J. Lee. 2022. Design principles and architecture of a second language learning chatbot. Language Learning & Technology 26(1), 1-18.
  • Krashen, S. D. and T. D. Terrell. 1983. The Natural Approach. Language Acquisition in the Classroom. Oxford: Pergamon Press Ltd.
  • Lekwilai, P. 2014. Reader’s theater: An alternative tool to develop reading fluency among Thai EFL learners. Journal of Language Teaching and Learning in Thailand 48, 89-111.
  • Lepikhin, D., H. Lee, Y. Xu, D. Chen, O. Firat, Y. Huang, ... and Z. Chen. 2020. Gshard: Scaling giant models with conditional computation and automatic sharding. arXiv preprint arXiv:2006.16668.
  • McGuffie, K. and A. Newhouse. 2020. The radicalization risks of GPT-3 and advanced neural language models. Technical Report. Center on Terrorism, Extremism, and Counterterrorism, Middlebury Institute of International Studies at Monterrey.
  • Pack, A. and J. Maloney. 2023. Potential affordances of generative AI in language education: Demonstrations and an evaluative framework. Teaching English with Technology 23(2), 4-24. [https://doi.org/10.56297/BUKA4060/VRRO1747]
  • Patton, M. Q. 2014. Qualitative Research & Evaluation Methods: Integrating Theory and Practice. Sage publications.
  • Ram, B. and P. V. Pratima Verma. 2023. Artificial intelligence AI-based Chatbot study of ChatGPT, Google AI Bard and Baidu AI. World Journal of Advanced Engineering Technology and Sciences 8(1), 258-261. [https://doi.org/10.30574/wjaets.2023.8.1.0045]
  • Sardegna, V. G. and A. McGregor. 2013. Scaffolding students’ self-regulated efforts for effective pronunciation practice. In J. Levis and K. LeVelle, eds., Proceedings of the 4th Pronunciation in Second Language Learning and Teaching Conference, 193-214. Ames, IA: Iowa State University.
  • Sejnowski, T. J. 2023. Large language models and the reverse turing test. Neural Computation 35(3), 309-342. [https://doi.org/10.1162/neco_a_01563]
  • Steele, J. L. 2023. To gpt or not gpt? Empowering our students to learn with AI. Computers and Education: Artificial Intelligence 5, 100160. [https://doi.org/10.1016/j.caeai.2023.100160]
  • Tarone, E. and M. Swain. 1995. A sociolinguistic perspective on second language use in immersion classrooms. The Modern Language Journal 79(2), 166-178. [https://doi.org/10.1111/j.1540-4781.1995.tb05428.x]
  • Taylor, R., M., Kardas, G. Cucurull, T. Scialom, A. Hartshorn, E. Saravia, ... and R. Stojnic. 2022. Galactica: A large language model for science. arXiv preprint arXiv:2211.09085.
  • Turing, A. M. 1950. I.—Computing machinery and intelligence. Mind 59(236), 433-460. [https://doi.org/10.1093/mind/LIX.236.433]
  • Van der Zwaard, R. and A. Bannink. 2014. Video call or chat? Negotiation of meaning and issues of face in telecollaboration. System 44, 137-148. [https://doi.org/10.1016/j.system.2014.03.007]
  • Vaswani, A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, ... and I. Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems 30, 1-11.
  • Weizenbaum, J. 1966. ELIZA-a computer program for the study of natural language communication between man and machine. Communications of the ACM 9(1), 36-45. [https://doi.org/10.1145/365153.365168]
  • Zhai, X. 2022. ChatGPT user experience: Implications for education. Available at SSRN 4312418. [https://doi.org/10.2139/ssrn.4312418]