Your browser does not support the PubReader view.
Go to this page to see a list of supporting browsers.
The Korean Association for the Study of English Language and Linguistics
[ Article ]
Korea Journal of English Language and Linguistics - Vol. 24, No. 0, pp.441-459
ISSN: 1598-1398 (Print) 2586-7474 (Online)
Print publication date 31 Jan 2024
Received 29 Dec 2023 Revised 29 Apr 2024 Accepted 02 May 2024
DOI: https://doi.org/10.15738/kjell.24..202405.441

Developing AI Chatbots for Pragmatic Instruction of Korean Secondary L2 English Learners

Min-Chang Sung ; Sooyeon Kang
(First author) Associate Professor, Department of English Education, Gyeongin National University of Education Sammak-ro 155, Manan-gu, Anyang-si Gyeonggi-do, 13910, Republic of Korea, Tel: +82-31-470-6335 mcsung@ginue.ac.kr
(Corresponding author) English Teacher, Sinyeon Middle School Moraenae-ro 408, Seodaemun-gu, Seoul, 03717, Republic of Korea, Tel: +87-2-379-4317 englishsk329@naver.com


© 2024 KASELL All rights reserved
This is an open-access article distributed under the terms of the Creative Commons License, which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

This study explores the design and application of AI chatbots tailored for L2 English pragmatic instruction. Addressing the importance of pragmatic competence alongside the challenges faced by L2 learners, we developed four chatbots through Dialogflow CX and integrated them onto web user interfaces to examine the effectiveness of the AI chatbots in L2 pragmatic learning. We invited a cohort of six middle school students to practice the conversations in pragmatically intensive (i.e., PDR-high) situations. Our findings reveal the need for a dual structure in chatbot design, a separation of technological operation from dialogic content, and a pair-wise page design for cohesive conversations. Additionally, user interfaces should offer contextual clues and linguistic supports to assist learners in understanding and navigating pragmatic exchanges. The participants’ positive perceptions highlight the chatbots’ effectiveness in improving pragmatic awareness and knowledge, akin to other dialogue-based computer-assisted language learning systems. However, the need for guiding feedback mechanisms and inclusive training data for chatbot development has also been noted. In conclusion, chatbots show promise for L2 pragmatic instruction especially when their design architectures and user interfaces carefully reflect dialogue contents, information technology, and supportive elements for effective learner interaction.

Keywords:

L2 pragmatic instruction, PDR-high request, AI chatbot, Dialogflow CX, user interface

References

  • Ahmadian, M. J. 2020. Explicit and implicit instruction of refusal strategies: Does working memory capacity play a role? Language Teaching Research 24(2), 163-188. [https://doi.org/10.1177/1362168818783215]
  • Ajabshir, Z. F. 2019. The effect of synchronous and asynchronous computer-mediated communication (CMC) on EFL learners’ pragmatic competence. Computers in Human Behavior 92, 169-177. [https://doi.org/10.1016/j.chb.2018.11.015]
  • Al-Gahtani, S. and C. Roever. 2018. Proficiency and preference organization in second language refusals. Journal of Pragmatics 129, 140-153. [https://doi.org/10.1016/j.pragma.2018.01.014]
  • Alemi, M. and N. S. Haeri. 2020. Robot-assisted instruction of L2 pragmatics: Effects on young EFL learners’ speech act performance. Language Learning & Technology 24(2), 86-103.
  • Allami, H. and A. Naeimi. 2011. A cross-linguistic study of refusals: An analysis of pragmatic competence development in Iranian EFL learners. Journal of Pragmatics 43(1), 385-406. [https://doi.org/10.1016/j.pragma.2010.07.010]
  • Bardovi‐Harlig, K. and Z. Dörnyei. 1998. Do language learners recognize pragmatic violations? Pragmatic versus grammatical awareness in instructed L2 learning. TESOL Quarterly 32(2), 233-259. [https://doi.org/10.2307/3587583]
  • Beltrán-Planques, V. and M. Querol-Julián. 2018. English language learners’ spoken interaction: What a multimodal perspective reveals about pragmatic competence. System 77, 80-90. [https://doi.org/10.1016/j.system.2018.01.008]
  • Bibauw, S., T. François and P. Desmet. 2022. Dialogue systems for language learning: Chatbots and beyond. In N. Ziegler and M. González-Lloret, eds., The Routledge Handbook of Second Language Acquisition and Technology, 121-134. New York: Routledge. [https://doi.org/10.4324/9781351117586-12]
  • Brown, P. and S. D. Levinson. 1987. Politeness: Some Universals in Language Usage. Cambridge: Cambridge University Press. [https://doi.org/10.1017/CBO9780511813085]
  • Cohen, A. D. and E. Olshtain. 1993. The production of speech acts by EFL learners. TESOL Quarterly 27(1), 33-56. [https://doi.org/10.2307/3586950]
  • Colaizzi, P. 1978. Psychological research as the phenomenologist views it. In R. Vale and M. King, eds., Existential-Phenomenological Alternatives for Psychology, 48-71. Oxford: Oxford University Press.
  • Cunningham. D. J. 2016. Request modification in synchronous computer-mediated communication: The role of focused instruction. The Modern Language Journal 100(2), 484-507. [https://doi.org/10.1111/modl.12332]
  • Dizon, G. 2020. Evaluating intelligent personal assistants for L2 listening and speaking development. Language Learning & Technology 24(1), 16-26. [https://doi.org/10.29140/jaltcall.v16n2.273]
  • Eslami-Rasekh, Z. 2005. Raising the pragmatic awareness of language learners. ELT Journal 59(3), 199-208. [https://doi.org/10.1093/elt/cci039]
  • Eslami-Rasekh, Z., A. Mirzaei and S. Dini. 2015. The role of asynchronous computer mediated communication in the instruction and development of EFL learners’ pragmatic competence. System 48, 99-111. [https://doi.org/10.1016/j.system.2014.09.008]
  • Félix-Brasdefer, J. C. and R. Shively. 2021. New Directions in Second Language Pragmatics (Vol. 356). Berlin: De Gruyter Mouton. [https://doi.org/10.1515/9783110721775]
  • Fraser, B. 1990. Perspectives on politeness. Journal of Pragmatics 14(2), 219-236. [https://doi.org/10.1016/0378-2166(90)90081-N]
  • Fryer, L. and R. Carpenter. 2006. Bots as language learning tools. Language Learning & Technology 10(3), 8-14.
  • García-Fuentes, C. and K. McDonough. 2018. The effect of explicit instruction and task repetition on Colombian EFL students’ use of politeness strategies during disagreements. The Language Learning Journal 46(4), 470-482. [https://doi.org/10.1080/09571736.2016.1167232]
  • González-Lloret, M. 2022. Technology-mediated tasks for the development of L2 pragmatics. Language Teaching Research 26(2), 173-189. [https://doi.org/10.1177/13621688211064930]
  • Hassall, T. 2008. Pragmatic performance: What are learners thinking? In E. A. Soler and A. M. Flor, eds., Investigating Pragmatics in Foreign Language Learning, Teaching, and Testing, 72-93. Buffalo: Multilingual Matters. [https://doi.org/10.21832/9781847690869-006]
  • Hsu, M. H., P. S. Chen and C. S. Yu. 2023. Proposing a task-oriented chatbot system for EFL learners speaking practice. Interactive Learning Environments 31(7), 4297-4308. [https://doi.org/10.1080/10494820.2021.1960864]
  • Huang, W., K. Hew and L. Fryer. 2021. Chatbots for language learning—Are they really useful? A systematic review of chatbot‐supported language learning. Journal of Computer Assisted Learning 38(1), 237-257. [https://doi.org/10.1111/jcal.12610]
  • Huth, T. and C. Taleghani-Nikazm. 2006. How can insights from conversation analysis be directly applied to teaching L2 pragmatics? Language Teaching Research 10(1), 53-79. [https://doi.org/10.1191/1362168806lr184oa]
  • Jeon, J. 2023. Chatbot-assisted dynamic assessment (CA-DA) for L2 vocabulary learning and diagnosis. Computer Assisted Language Learning 36(7), 1338-1364. [https://doi.org/10.1080/09588221.2021.1987272]
  • Kang, S. 2023. Korean Middle School English Learners’ Development of Pragmatic Competence and Metapragmatic Awareness Through CA-Informed Pragmatic Instruction: Focusing on Requests and Refusals to Requests. Doctoral dissertation, Seoul National University, Seoul, Republic of Korea.
  • Kang, S. and M. Sung. In Press. EFL students’ self-directed learning of conversation skills with AI chatbots. Language Learning & Technology.
  • Kuhail, M. A., N. Alturki., S. Alramlawi and K. Alhejori. 2023. Interacting with educational chatbots: A systematic review. Education and Information Technologies 28(1), 973-1018. [https://doi.org/10.1007/s10639-022-11177-3]
  • Kim, N-Y. 2018. Chatbots and Korean EFL students’ English vocabulary learning. Journal of Digital Convergence 16(2), 1-7.
  • Kim, N-Y. 2019. A study on the use of artificial intelligence chatbots for improving English grammar skills. Journal of Digital Convergence 17(8), 37-46.
  • Kim, Y. and N. Taguchi. 2015. Promoting task‐based pragmatics instruction in EFL classroom contexts: The role of task complexity. The Modern Language Journal 99(4), 656-677. [https://doi.org/10.1111/modl.12273]
  • Leech, G. 1983. Principles of Pragmatics. London: Longman.
  • Li, Q. 2019. L2 Chinese learners’ pragmatic developmental patterns in data-driven instruction and computer-mediated communication (CMC): A case of Chinese sentence final particle ne. Applied Pragmatics 1(2), 154-183. [https://doi.org/10.1075/ap.19006.li]
  • OpenAI. 2023. ChatGPT can now see, hear, and speak. [Blog post]. Available online at https://openai.com/blog/chatgpt-can-now-see-hear-and-speak
  • Park, Y. L. and S-Y. Oh. 2019. Korean EFL learners’ refusals to requests and their perceptions. English Teaching 74(4), 75-103. [https://doi.org/10.15858/engtea.74.4.201912.75]
  • Pinsky, Y. 2023. Bard can now connect to your Google apps and services. [Blog post]. Available online at https://blog.google/products/bard/google-bard-new-features-update-sept-2023
  • Pintrich, P. and E. de Groot. 1990. Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology 82(1), 33-40. [https://doi.org/10.1037//0022-0663.82.1.33]
  • Plonsky, L. and J. Zhuang. 2019. A meta-analysis of L2 pragmatics instruction. In N. Taguchi, ed., The Routledge Handbook of Second Language Acquisition and Pragmatics, 287-307. London: Routledge. [https://doi.org/10.4324/9781351164085-19]
  • Roever, C. 2021. Teaching and Testing Second Language Pragmatics and Interaction: A Practical Guide. New York: Routledge. [https://doi.org/10.4324/9780429260766]
  • Ruan, S., A. Willis., Q. Xu., G. M. Davis., L. Jiang., E. Brunskill and J. Landay. 2019. Bookbuddy: Turning digital materials into interactive foreign language lessons through a voice chatbot. In Proceedings of the Sixth ACM Conference on Learning@ Scale, 1-4. [https://doi.org/10.1145/3330430.3333643]
  • Schegloff, E. A. 2007. Sequence Organization in Interaction. Cambridge: Cambridge University Press. [https://doi.org/10.1017/CBO9780511791208]
  • Sung, M. 2021. Development of negotiation chatbots for primary English learners. Primary English Education 27(1), 55-78. [https://doi.org/10.25231/pee.2021.27.1.55]
  • Sydorenko, T. 2015. The use of computer-delivered structured tasks in pragmatic instruction: An exploratory study. Intercultural Pragmatics 12(3), 333-362. [https://doi.org/10.1515/ip-2015-0017]
  • Sydorenko, T., P. Daurio and S. L. Thorne. 2018. Refining pragmatically-appropriate oral communication via computer-simulated conversations. Computer Assisted Language Learning 31(1-2), 157-180. [https://doi.org/10.1080/09588221.2017.1394326]
  • Sykes, J. M. 2018. Interlanguage pragmatics, curricular innovation, and digital technologies. CALICO Journal 35(2), 120-141. [https://doi.org/10.1558/cj.36175]
  • Taguchi, N. 2015. Instructed pragmatics at a glance: Where instructional studies were, are, and should be going. Language Teaching 48(1), 1-50. [https://doi.org/10.1017/S0261444814000263]
  • Taguchi, N. 2019. Second language acquisition and pragmatics. In N. Taguchi, ed., The Routledge Handbook of Second Language Acquisition and Pragmatics, 1-14. London: Routledge. [https://doi.org/10.4324/9781351164085-1]
  • Taguchi, N. 2024. Technology-enhanced language learning and pragmatics: Insights from digital game-based pragmatics instruction. Language Teaching 57(1), 1-11. [https://doi.org/10.1017/S0261444823000101]
  • Taguchi, N. and Y. J. Kim. 2016. Learner-learner interaction during collaborative pragmatic tasks: The role of cognitive and pragmatic task demands. Foreign Language Annals 49(1), 42-57. [https://doi.org/10.1111/flan.12180]
  • Taguchi, N. and C. Roever. 2017. Second Language Pragmatics. Oxford: Oxford University Press.
  • Tang, X. and N. Taguchi. 2020. Designing and using a scenario-based digital game to teach Chinese formulaic expressions. CALICO Journal 37(1), 1-2. [https://doi.org/10.1558/cj.38574]
  • Tang, X. and N. Taguchi. 2021. Digital game-based learning of formulaic expressions in L2 Chinese. Modern Language Journal 105(3), 740-759. [https://doi.org/10.1111/modl.12725]
  • Thomas, J. 1983. Cross-cultural pragmatic failure. Applied Linguistics 4(2), 91-112. [https://doi.org/10.1093/applin/4.2.91]
  • Timpe-Laughlin, V. and J. Dombi. 2020. Exploring L2 learners’ request behavior in a multi-turn conversation with a fully automated agent. Intercultural Pragmatics 17(2), 221-257. [https://doi.org/10.1515/ip-2020-0010]
  • UNESCO. 2023. Education in the age of artificial intelligence. The UNESCO Courier, 4. Available online at https://unesdoc.unesco.org/ark:/48223/pf0000387029_eng [https://doi.org/10.18356/22202293-2023-4-1]
  • Wong, J. and H. Z. Waring. 2010. Conversation Analysis and Second Language Pedagogy: A Guide for ESL/EFL Teachers. New York: Routledge. [https://doi.org/10.4324/9780203852347]
  • Yang, H., H. Kim., J. Lee and D. Shin. 2022. Implementation of AI chatbot as an English conversation partner in EFL speaking classes. ReCALL 34(3), 327-343. [https://doi.org/10.1017/S0958344022000039]