Your browser does not support the PubReader view.
Go to this page to see a list of supporting browsers.
The Korean Association for the Study of English Language and Linguistics
[ Article ]
Korea Journal of English Language and Linguistics - Vol. 25, No. 0, pp.982-1008
ISSN: 1598-1398 (Print) 2586-7474 (Online)
Print publication date 31 Jan 2025
Received 10 Feb 2025 Revised 08 Mar 2025 Accepted 11 Jul 2025
DOI: https://doi.org/10.15738/kjell.25..202507.982

복합양식 리터러시를 실천하기 위한 복합양식 의사소통(MCC) 모형 개발: 학습자 중심의 메타포 분석과 디지털 스토리텔링의 융합 기반

Kwang-Soon Lee
Research Professor, The Centre for European Cultural Studies, Mokpo National University leesue67@yahoo.com
Development of a Multimodal Communication Competence (MCC) model for practicing multimodal literacy: A learner-centered integration of metaphor analysis and digital storytelling


© 2025 KASELL All rights reserved
This is an open-access article distributed under the terms of the Creative Commons License, which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

This study aimed to develop an MCC model to enhance the multimodal literacy of Korean undergraduates in an EFL environment. To this end, classroom instruction combined learner-centered metaphor analysis and digital storytelling production. Participants (n = 50) explored metaphorical language, uncovering implicit meanings and analyzing idiom-based expressions under the guidance of an instructor. After acquiring foundational knowledge and experience, they selected and analyzed their favorite films to produce learner-centered digital storytelling content. They experienced five stages: (a) knowledge acquisition, (b) resource and information collection, (c) organization, (d) reorganization, and (e) presentation of digital storytelling content. In this process, they developed their MCC {R² = .971: Integration of verbal-nonverbal nodes (β = .416), Sound & music (β = .295), Metaphor interpretation (β = .290), Visual resource (β = .246)}. Correlation and regression analysis show that MCC accounts for 53.7% of idiom usage with a strong correlation. A one-way ANOVA revealed statistically significant linguistic development across three proficiency levels (low, intermediate, and high / r = .881, F = 36.836, p = .000). These findings suggest that the MCC model holds considerable potential for enhancing learning effectiveness, promoting self-reflection, and stimulating creativity as learners engage in multimodal literacy practices.

Keywords:

multimodal communicative competence(MCC), metaphor, digital storytelling, crical thinking, socio-cultural awareness, student-directed learning

Acknowledgments

This research was supported by the Ministry of Education of the Republic of Korea and the National Research Foundation of Korea (NRF-No. 2020S1A5A8046652).

References

  • 강영훈(Kang, Y.). 2022. 스포츠와 미디어 리터러시: 미디어에 나타난 은유적 함의(Sports and media literacy: Metaphorical implications in media). ⟪인문사회과학연구⟫(Studies in Humanities and Social Sciences) 65(2), 51-80.
  • 고명재(Ko, M.-J.). 2023. 현대시의 은유적 형식을 활용한 창의적 글쓰기 수업 모듈－비동일성에 주목하여 살아있는 은유를 활성화하기(Creative writing class module using the metaphorical form of modern poetry－Focusing on non-identity and activating a living metaphor). ⟪교양교육연구⟫(Korean Journal of General Education) 17(2), 97-114.
  • 김성우(Kim, S.). 2015. (영어)교사를 위한 인지 언어학 7: 과학적 언어와 메타포의 관계((Yeongeo)gyosareul wihan inji eoneohak 7: Gwahakjeok eoneowa metapoui gwangye). Slow News. Available online at https://slownews.kr/36672
  • 서수현‧옥현진(Seo, S.-H. and H. Ok). 2014. 디지털 문식성 교육을 위한 학습자 프로파일 구성 요소 탐색(Exploring literacy learner profile for digital literacy education). ≪청람어문교육≫(Journal of CheongRam Korean Language Education) 52, 87-114.
  • 유홍식(Ryu, H.). 2017. 청소년 미디어 리터러시 교육을 통해 시민 역량을 키워야(Cheongsonyeon midieo riteoreosi gyoyugeul tonghae simin yeokryangeul kiwoya). 신문과 방송(Sinmungwa bangsong). [Blog post] Available online at https://blog.naver.com/kpfjra_/220969786891
  • 이창동(Lee, C.-D.). 2018. Burning [Film]. FINEHOUSEFILM, NHK, NOWFILM.
  • 정현선(Jeong, H.-S.). 2021. 디지털 교육 시대의 교육, 맥락 읽는 눈을 길러주자(Dijiteol gyoyuk sidaeui gyoyuk, maekrak ilkneun nuneul gilleojuja). Next Literacy Review. Available online at https://www.nextliteracy.co.kr/news/articleView.html?idxno=259
  • 정혜승(Jeong, H.). 2008. 문식성 개념 변화와 교육 과정적 함의(munsikseong gaenyeom byeonhwawa gyoyuk gwajeongjeok hamui). In 노명완, 박영목 (편)(M., No, and Y. Park, eds.), 『문식성 교육 연구』(Literacy Education), 169-191, 한국문화사.
  • 차윤경‧안성호‧주미경‧함승환(Cha, Y.-K., S.-H. Ahn, M.-K. Ju and S.-H. Ham). 2016. 융복합 교육의 확장적 재개념화 가능성 탐색(Yungbokhap education: Toward an expansive (re)conceptualization). ≪다문화 교육 연구≫(Multicultural Education Review) 9(1), 153-183.
  • 최홍원(Choi, H.). 2015. 문화적 문식성의 교육적 실현에 대한 방법적 회의(Methodical doubt pertaining to the educational realization of cultural literacy). ⟪국어 교육 연구⟫(Korean Language Education Research) 36, 595-632.
  • Bachman, L. 1990. Fundamental considerations in language testing. Oxford University Press.
  • Bong, J. H. (Director). 2019. Parasite [Film]. Barunson E & A.
  • Buchanan, R. 2011. Paradox, promise and public pedagogy: Implications of the federal government’s digital education revolution. Australian Journal of Teacher Education 36(2), 66-78. [https://doi.org/10.14221/ajte.2011v36n2.6]
  • Cakir, I. 2011. How do learners perceive idioms in EFL classes? EKEV AKADEMI DERGISI YII 15(47), 1-13.
  • Canale, M. and M. Swain. 1980. Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics 1, 1-47. [https://doi.org/10.1093/applin/I.1.1]
  • Carrington, V. 2005. New Textual Landscapes, Information and Early Literacy. In J. Marsh, ed., Popular Culture, New Media and Digital Literacy in Early Childhood. Routledge Falmer.
  • Cazden, C. 1996. A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66(1), 60–92. [https://doi.org/10.17763/haer.66.1.17370n67v22j160u]
  • Cook, V., F. Maine and A. Cˇermáková. 2022. Enacting cultural literacy as a dialogic social practice: The role of provisional language in classroom talk. London Review of Education 20(1), 1-13. [https://doi.org/10.14324/LRE.20.1.02]
  • Cope, B. and M. Kalantzis. 2000. “Multiliteracies”: New literacies, new learning, Pedagogies, 4(3), 164-195. [https://doi.org/10.1080/15544800903076044]
  • Council of Europe. 2024. The CEFR Levels - Common European Framework of Reference for Languages (CEFR)
  • Dawkins, R. 1976. The Selfish Gene. Oxford University Press.
  • Deardorff, D. K. 2020. “Manual for Developing Intercultural Competencies: Story Circles.” UNESCO Publishing. [https://doi.org/10.4324/9780429244612]
  • Gregori-Signes, C. 2014. Digital storytelling and multimodal literacy in education. Porta Linguarum 22, 237-250. [https://doi.org/10.30827/Digibug.53745]
  • Hafner, C. A. 2014. Embedding digital literacies in English language teaching: Students’ digital video projects as multimodal ensembles. TESOL Quarterly 48(4), 655-685. [https://doi.org/10.1002/tesq.138]
  • Jewitt, C. 2009. The Routledge handbook of multimodal analysis. Routledge.
  • Jewitt, C. 2012. Technology, Literacy and Learning: A Multimodal Approach. Routledge. [https://doi.org/10.4324/9780203964101]
  • K-CESA. 2017. 대학생 핵심역량 진단(K-CESA) 지원과 활용(A Study on Support and Utilization of Korea Collegiate Essential Skills Assessment(K-CESA). 한국직업능력연구원
  • Kim, H. H. and J. K. Kim. 2015. A study on metaphor with its effects which give influence on ideas - Mainly with the case study of visual communication design. KDDA 15(2), 997-1006. [https://doi.org/10.17280/jdd.2015.15.2.092]
  • Kress, G. 2010. Multimodality: A Social Semiotic Approach to Contemporary Communication. Routledge.
  • Kress, G. and T. Van Leeuwen. 2001. Multimodal discourse: The Modes and Media of Contemporary Communication. Arnold Publishers.
  • Lankshear, C. 1997, Changing Literacies, Open University Press.
  • Lee, S. Y., Y. H. Lo and T. C. Chin. 2019. Practicing multiliteracies to enhance EFL learners’ meaning making process and language development: A multimodal problem-based approach. Computer Assisted Language Learning 34(1–2), 66–91. [https://doi.org/10.1080/09588221.2019.1614959]
  • Lotherington, H. and J. Jenson. 2011. Teaching multimodal and digital literacy in L2 settings: New literacies in an electronic age. Annual Review of Applied Linguistics 31, 226-246. [https://doi.org/10.1017/S0267190511000110]
  • Luke, A. 2018. Critical Literacy, Schooling, and Social Justice: The Collected Works of Allan Luke. Routledge. [https://doi.org/10.4324/9781315100951]
  • Marron, M., M. Taylor and B. Mueller. 2018. Digital storytelling and visual metaphor in lectures: A study of student engagement. Accounting Education 27(6), 552-567. [https://doi.org/10.1080/09639284.2017.1361848]
  • Mills, K. A. 2010. A review of the “Digital turn” in the new literacy studies. Review of Educational Research 80(2), 246–271. [https://doi.org/10.3102/0034654310364401]
  • Ministry of Education (MOE), Singapore. 2020. English language teaching and learning syllabus 2020.
  • Miyazaki, H. (Director). 2001. The Spiriting Away of Sen and Chihiro. [Film]. Studio GHBLI.
  • Muhammad, M., N. Wallerstein, A. L. Sussman, M. Avila, L. Belone and B. Duran. 2015. “Reflections on researcher identity and power: The impact of positionality on community-based participatory research (CBPR) processes and outcomes.” Critical Sociology 41(7–8), 1045–1063. [https://doi.org/10.1177/0896920513516025]
  • Neimand, A., N. Asorey, A. Christiano and Z. Wallace. 2021. Why intersectional stories are key to helping the communities we serve. Stanford Social Innovation Review.
  • New London Group. 1996. A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66, 60-92. [https://doi.org/10.17763/haer.66.1.17370n67v22j160u]
  • Nolan, C. (Director). 2010. Inception. Thomas, E., and Nolan, C. (Producers).
  • Nordquist, R. 2019. The different types of metaphors. ThoughtCo. Available at https://www.thoughtco.com/ways-of-looking-at-a-metaphor-1691815
  • Paivio, A. 1991. Dual coding theory: Retrospect and current status. Canadian Journal of Psychology 45(3), 255–287. [https://doi.org/10.1037/h0084295]
  • Park. H.-J. 2021. A study on the information visualization with visual metaphors: Focused on Nigel Holmes’ infographics. The Korean Society of Illustration Research 22(69), 5-16. [https://doi.org/10.37379/JKSIR.2021.69.01]
  • Peele, J. (Director). 2017. Get Out [Film]. Hal Roach.
  • Peters, E. and S. Webb, 2018. Incidental vocabulary acquisition through viewing L2 television and factors that affect learning. Studies in Second Language Acquisition 40(3), 1-27. [https://doi.org/10.1017/S0272263117000407]
  • Philips, T. (Director). 2019. Joker [Film]. Warner Bros.; Village Roadshow Pictures; BRON Studios.
  • Puentedura, R. R. 2013. Ruben R. Puentedura’s Weblog: SAMR: SAMR: Methods for transforming the classroom, 1-24.
  • Ranker, J. 2007. A case of “multiple literacies”: Traveling on the new literacy landscape. Journal of adolescent & adult Literacy 50(6), 500–509.
  • Rowsell, J. and M. Walsh. 2011. Rethinking literacy education in new times: Multimodality, multiliteracies, & new literacies. Brook Education 21(1), 53-62. [https://doi.org/10.26522/brocked.v21i1.236]
  • Royce, T. 2002. Multimodality in the TESOL classroom: Exploring visual-Verbal synergy. TESOL Quarterly 36(2), 191-205. [https://doi.org/10.2307/3588330]
  • Royce, T. 2007. Multimodal Communicative Competence in Second Language Contexts; New Directions in the Analysis of Multimodal Discourse. Routledge
  • Serafini, F. 2014. Expanding perspectives for comprehending visual images in multimodal texts. Journal of Adolescent & Adult Literacy 54(5), 342-350 [https://doi.org/10.1598/JAAL.54.5.4]
  • Si, Q., T. S. Hodges and J. M. Coleman. 2022. Multimodal literacies classroom instruction for K-12 students: A review of research. Literacy Research and Instruction 61(3), 276-297. [https://doi.org/10.1080/19388071.2021.2008555]
  • Smilan, C. 2017. Visual immersion for cultural understanding and multimodal literacy. Arts Education Policy Review 118(4), 220-227. [https://doi.org/10.1080/10632913.2017.1287805]
  • Smith, A. 2011. The Theory of Moral Sentiment. (Reprint of 1970). Gutenberg Publishers.
  • Smith, S. 2021. Ron’s gone wrong [Film]. Julie Lockhart.
  • The New London Group. 1996. A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66(1), 60-93. [https://doi.org/10.17763/haer.66.1.17370n67v22j160u]
  • Thomas, E. E. and A. Stornaiuolo. 2016. “Restorying the self: Bending toward textual justice.” Harvard Educational Review 86(3), 313–338. [https://doi.org/10.17763/1943-5045-86.3.313]
  • Toffler, A. 1980. The Third Wave. William Morrow and Company.
  • Van Leeuwen, T. 2017. Multimodal literacy. Journal of Metaphor 4, 17-23.
  • Walsh, M. 2010. Multimodal literacy: What does it mean for classroom practice? Australian Journal of Language and Literacy 34(3), 211-239. [https://doi.org/10.1007/BF03651836]
  • Yi, Y. 2014. Possibilities and challenges of multimodal literacy practices in teaching and learning English as an additional language. Language and Linguistics Compass 8(4), 158–16 [https://doi.org/10.1111/lnc3.12076]
  • 21st Century Literacy Summit. 2002. White paper: 21st century literacy in a convergence media world. Bertelsmann Foundation & AOL Time Warner Foundation.