Theorizing the Role of Machine Translation in L2 Reading Comprehension: Validating the Theory and Exploring the Learning Potential through MT Use
© 2024 KASELL All rights reserved
This is an open-access article distributed under the terms of the Creative Commons License, which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract
This study investigates the theoretical dimensions of how machine translation (MT) plays a role in relation to L1 reading competence in L2 reading comprehension. Leveraging Kintsch’s Construction-Integration (CI) model for L2 reading proposed by Oh (2014), our research posits that MT mediation enhances the textbase by alleviating constraints related to L2 proficiency. This, in turn, facilitates a more effective utilization of L1 reading resources, contributing to an enriched situation model. To explore this hypothesis, we conducted an empirical study with 89 college students enrolled in a general English course at a South Korean university. Participants engaged in reading activities under two conditions: a pre-MT (reading without MT) and a post-MT (reading with MT). The comprehensive model, incorporating a textbase indicated by L2 vocabulary, grammar, and sentence parsing, and a situation model represented by L1 reading competence, was examined through structural equation modelling across these conditions. Additionally, we analyzed learning potential scores (LPS)—reflecting the difference between the two conditions—using hierarchical multiple regression to identify significant predictors of enhanced comprehension with MT use. Our findings confirm the validity of the models, demonstrating the textbase as a key mechanism through which MT influences reading comprehension. The results also underscore the significance of L1 reading competence and L2 parsing ability as key predictors for LPS. These findings are discussed within the context of the changing multiliteracies landscape, contributing to the broader discourse on language education and technology integration.
Keywords:
machine translation, CI model, L2 reading, L1 reading, learning potential, translanguagingAcknowledgments
This work was supported by the 2023 research fund of Korean Bible University.
References
- Bandalos, D. J. and S. J. Finney. 2001. Item parcelling issues in structural equation modelling. In G. A. Marcoulides and R. E. Schumacker, eds., New Developments and Techniques in Structural Equation Modelling, 269-296. Mahwah, NJ: Lawrence Erlbaum.
- Bernhardt, E. B. and M. L. Kamil. 1995. Interpreting relationships between L1 and L2 reading: Consolidating the linguistic threshold and the linguistic interdependence hypotheses. Applied Linguistics 16, 15-34. [https://doi.org/10.1093/applin/16.1.15]
- Bollen, K.A. 1989. Structural Equations with Latent Variables. New York: John Wiley and Sons. [https://doi.org/10.1002/9781118619179]
- Cho, E., P. Capin, G. Roberts, G. J. Roberts. and S. Vaughn. 2019. Examining sources and mechanisms of reading comprehension difficulties: Comparing English learners and non-English learners within the simple view of reading. Journal of Educational Psychology 111(6), 982-1000. [https://doi.org/10.1037/edu0000332]
- Chung, E. S. 2020. The effect of L2 proficiency on post-editing machine translated texts. Journal of Asia TEFL 17(1), 182-193. [https://doi.org/10.18823/asiatefl.2020.17.1.11.182]
- Chung, E. S. and S. Ahn. 2022. The effect of using machine translation on linguistic features in L2 writing across proficiency levels and text genres.Computer Assisted Language Learning 35(9), 2239-2264. [https://doi.org/10.1080/09588221.2020.1871029]
- Cohen, A. D. 2011. Strategies in Learning and Using a Second Language. New York: Routledge.
- Conteh, J. and G. Meier. 2014. The Multilingual Turn in Languages Education: Opportunities and Challenges. Bristol: Multilingual Matters. [https://doi.org/10.21832/9781783092246]
- Coyle, D. and O. Meyer. 2021. Beyond CLIL: Pluriliteracies Teaching for Deeper Learning. Cambridge: Cambridge University Press. [https://doi.org/10.1017/9781108914505]
- Davis, J. N. and L. Bistodeau. 1993. How do L1 and L2 reading differ? Evidence from think aloud protocols. The Modern Language Journal 77(4), 459-472. [https://doi.org/10.1111/j.1540-4781.1993.tb01993.x]
- Elgort, I. and P. Warren. 2014. L2 vocabulary learning from reading: Explicit and tacit lexical knowledge and the role of learner and item variables. Language Learning 64(2), 365-414. [https://doi.org/10.1111/lang.12052]
- Fillmore, C. and P. Kay. 1983. Text semantic analysis of reading comprehension tests. Final report to National Institute of Education. Berkeley, CA: Institute of Human Learning, University of California.
- Fisk, C. and B. Hurst. 2003. Paraphrasing for comprehension. The Reading Teacher 57(2), 182-185.
- García, O. and L. Wei. 2014. Translanguaging: Language, Bilingualism and Education. Basingstoke: Palgrave Macmillan. [https://doi.org/10.1057/9781137385765_4]
- García, O., N. Flores and M. Spotti. 2017. Language and society: A critical poststructuralist perspective. In O. García, N. Flores and M. Spotti, eds., The Oxford Handbook of Language and Society, 1-16. Oxford: Oxford University Press. [https://doi.org/10.1093/oxfordhb/9780190212896.001.0001]
- Hawras, S. 1996. Towards describing bilingual and multilingual behavior: Implications for SEL instruction. Unpublished thesis, University of Minnesota.
- Horiba, Y. 1990. Narrative comprehension processes: A study of native and non-native readers of Japanese. The Modern Language Journal 74(2), 188-202. [https://doi.org/10.1111/j.1540-4781.1990.tb02566.x]
- Hungwe, V. 2019. Using a translanguaging approach in teaching paraphrasing to enhance reading comprehension in first-year students. Reading and Writing-Journal of the Reading Association of South Africa 10(1), 1-9. [https://doi.org/10.4102/rw.v10i1.216]
- Kern, R. G. 1994. The role of mental translation in second language reading. Studies in second language acquisition 16(4), 441-461. [https://doi.org/10.1017/S0272263100013450]
- Kim, E. Y. and E. J. Oh. 2023. Machine translation use as translanguaging in content and language integrated learning: A case study in a general English course for global citizenship. English Teaching 78(4), 59-82. [https://doi.org/10.15858/engtea.78.4.202312.59]
- Kim, R. 2023. Effects of ChatGPT on the cognitive processing of K-CSAT English reading tasks by Korean high school learners: A preliminary study. Secondary English Education 16(2), 179-205. [https://doi.org/10.20487/kasee.16.2.202305.179]
- Kintsch, W. 1998. Comprehension: A Paradigm for Cognition. New York: Cambridge University Press.
- Kintsch, W. 2019. Revisiting the construction-integration model of text comprehension and its implications for instruction. In D. E. Alvermann, N. J. Unrau and R. B. Ruddell, eds., Theoretical Models and Processes of Reading, 178-203. New York: Routledge. [https://doi.org/10.4324/9781315110592-12]
- Kline, R. B. 2005. Principles and Practice of Structural Equation Modelling. New York: The Guildford Press.
- Koda, K., 2005. Insights into Second Language Reading: A Cross-Linguistic Approach. Cambridge University Press. [https://doi.org/10.1017/CBO9781139524841]
- Koda, K. 2007. Reading and language learning: Crosslinguistic constraints on second language reading development. Language Learning 57, 1-44. [https://doi.org/10.1111/0023-8333.101997010-i1]
- Kwon, H. J. and D. L. Schallert. 2016. Understanding translanguaging practices through a biliteracy continua framework: Adult biliterates reading academic texts in their two languages. Bilingual Research Journal 39(2), 138-151. [https://doi.org/10.1080/15235882.2016.1167139]
- Lantolf, J. P. 2000. Introducing sociocultural theory. Sociocultural theory and second language learning 1, 1-26. [https://doi.org/10.4324/9781315624747-1]
- Lee, S. M. 2020. The impact of using machine translation on EFL students’ writing. Computer Assisted Language Learning 33(3), 157-175. [https://doi.org/10.1080/09588221.2018.1553186]
- Lee, S. M. and N. Briggs. 2021. Effects of using machine translation to mediate the revision process of Korean university students’ academic writing. ReCALL 33(1), 18-33. [https://doi.org/10.1017/S0958344020000191]
- Lee, Y. J. 2021. Still taboo? Using machine translation for low-level EFL writers. ELT Journal 75(4), 432-441. [https://doi.org/10.1093/elt/ccab018]
- Lewis, G., B. Jones and C. Baker. 2012. Translanguaging: Origins and development from school to street and beyond. Educational research and evaluation 18(7), 641-654. [https://doi.org/10.1080/13803611.2012.718488]
- Li, P. and R. B. Clariana. 2019. Reading comprehension in L1 and L2: An integrative approach. Journal of Neurolinguistics 50, 94-105. [https://doi.org/10.1016/j.jneuroling.2018.03.005]
- Little, T. D., W. A. Cunningham, G. Shahar and K. F. Widaman. 2002. To parcel or not to parcel: Exploring the question, weighing the merits. Structural equation modelling 9(2), 151-173. [https://doi.org/10.1207/S15328007SEM0902_1]
- McCauley, S. M. and M. H. Christiansen. 2015. Individual differences in chunking ability predict on-line sentence processing individual differences in chunking ability predict on-line sentence processing. In Proceedings of the 37th Annual Conference of the Cognitive Science Society, 1553-1558.
- McCauley, S. M., E. S. Isbilen and M. H. Christiansen. 2017. Chunking ability shapes sentence processing at multiple levels of abstraction. In Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition, 2681-2686.
- McLeod, B. and B. McLaughlin. 1986. Restructuring or automaticity? Reading in a second language. Language learning 36(2), 109-123. [https://doi.org/10.1111/j.1467-1770.1986.tb00374.x]
- Meng, Y. and H. Fu. 2023. Modelling mediation in the dynamic assessment of listening ability from the cognitive diagnostic perspective. The Modern Language Journal 107(S1), 137-160. [https://doi.org/10.1111/modl.12820]
- Muthén, L. K. and B. O. Muthén. 1998-2017. Mplus User’s Guide. Eighth Edition. Los Angeles, CA: Muthén & Muthén.
- Nassaji, H. 2007. Schema theory and knowledge‐based processes in second language reading comprehension: A need for alternative perspectives. Language Learning 57, 79-113. [https://doi.org/10.1111/j.1467-9922.2007.00413.x]
- New London Group. 1996. A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66(1), 60-93. [https://doi.org/10.17763/haer.66.1.17370n67v22j160u]
- Oh, E. J. 2014. Exploring a theory-based model of L2 reading comprehension: CI model for L2 reading comprehension. Korean Journal of Applied Linguistics 30(3), 151-177. [https://doi.org/10.17154/kjal.2014.09.30.3.151]
- Oh, E. J. 2022a. Integrating global citizenship and global competence into a general English course: A case study. Journal of Education for International Understanding 17(1), 93-156. [https://doi.org/10.35179/jeiu.2022.17.1.93]
- Oh, E. J. 2022b. Exploratory study on the use of machine translation for reading in college English classes. Multimedia-Assisted Language Learning 25(4), 66-92.
- Oh, E. J. In press. A case study of an AI-assisted CLIL approach: A college English course for global citizenship and global competence in an EFL setting. In S. L. Ju, H. Reinders and J. K. Park, eds., Innovation in Language Learning and Teaching: The Case of South Korea. Palgrave Macmillan.
- Pacheco, M. B., S. M. Daniel, L. C. Pray and R. T. Jiménez. 2019. Translingual practice, strategic participation, and meaning-making. Journal of Literacy Research 51(1), 75-99. [https://doi.org/10.1177/1086296X18820642]
- Peng, P., Z. Zhang, W. Wang, K. Lee, T. Wang, C. Wang, J. Luo and J. Lin. 2022. A meta-analytic review of cognition and reading difficulties: Individual differences, moderation, and language mediation mechanisms. Psychological Bulletin 148(3-4), 227. [https://doi.org/10.1037/bul0000361]
- Poehner, M. E. and J. P. Lantolf, 2013. Bringing the ZPD into the equation: Capturing L2 development during computerized dynamic assessment (C-DA). Language Teaching Research 17(3), 323-342. [https://doi.org/10.1177/1362168813482935]
- Pulido, M. F. and P. López‐Beltrán. 2023. When native speakers are not “native‐like:” Chunking ability predicts (lack of) sensitivity to gender agreement during online processing. Cognitive Science 47(10), e13366. [https://doi.org/10.1111/cogs.13366]
- Suzuki, Y. 2024. Practice and Automatization in Second Language Research: Perspectives from Skill Acquisition Theory and Cognitive Psychology. New York: Routledge. [https://doi.org/10.4324/9781003414643]
- Tsai, S. C. 2019. Using Google Translate in EFL drafts: A preliminary investigation. Computer Assisted Language Learning 32(5-6), 510-526. [https://doi.org/10.1080/09588221.2018.1527361]
- Turner, A. and E. Greene. 1977. The Construction of a Propositional Text Base (Tech. Rep. No. 63). Boulder: University of Colorado Press.
- Unrau, N. J., D. E. Alvermann and M. Sailors. 2019. Literacies and their investigation through theories and models. In E. Alvermann, N. J. Unrau, M. Sailtors and R. B. Ruddel, eds., Theoretical models and processes of literacy, 3-34. New York: Routledge. [https://doi.org/10.4324/9781315110592-2]
- Upton, T. A. and L. C. Lee-Thompson. 2001. The role of the first language in second language reading. Studies in Second Language Acquisition 23(4), 469-495. [https://doi.org/10.1017/S0272263101004028]
- Vaish, V. and A. Subhan. 2015. Translanguaging in a reading class. International Journal of Multilingualism 12(3), 338-357. [https://doi.org/10.1080/14790718.2014.948447]
- Vieira, L. N., C. O’Sullivan, X. Zhang and M. O’Hagan. 2023. Machine translation in society: insights from UK users. Language Resources and Evaluation 57(2), 893-914. [https://doi.org/10.1007/s10579-022-09589-1]
- Vygotsky, L. S. 1962. Thought and Language. Cambridge: MIT Press. [https://doi.org/10.1037/11193-000]
- Vygotsky, L. S. 1978. Mind in Society: The Development of Higher Psychological Processes. Harvard University Press.
- Vygotsky, L. S. 1987. The Collected Works of L. S. Vygotsky. Vol. 1: Problems of General Psychology. New York: Plenum Press.
- Yang, Y. and D. D. Qian. 2020. Promoting L2 English learners’ reading proficiency through computerized dynamic assessment. Computer Assisted Language Learning 33(5-6), 628-652. [https://doi.org/10.1080/09588221.2019.1585882]
- Yang, Y. and D. D. Qian. 2023. Enhancing EFL learners’ reading proficiency through dynamic assessment. Language Assessment Quarterly 20(1), 20-43. [https://doi.org/10.1080/15434303.2022.2132160]