Your browser does not support the PubReader view.
Go to this page to see a list of supporting browsers.
The Korean Association for the Study of English Language and Linguistics
[ Article ]
Korea Journal of English Language and Linguistics - Vol. 20, No. 1, pp.363-383
ISSN: 1598-1398 (Print)
Print publication date 31 Mar 2020
Received 03 Aug 2020 Revised 21 Aug 2020 Accepted 31 Aug 2020
DOI: https://doi.org/10.15738/kjell.20..202008.363

Coh-Metrix 시스템을 이용한 고등학교 영어교과서의 듣기대본 복잡도 분석

류지수 ; 전문기
제1저자, 건국대학교
교신저자, 건국대학교
An analysis of the text complexity of listening scripts of high school English textbooks using Coh-Metrix
Jisu Ryu ; Moongee Jeon


Copyright 2020 KASELL
This is an open access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

This study aims to examine the text complexity of listening scripts of high school English textbooks applying Coh-Metrix, a language corpus analysis tool designed to analyze various types of corpora including textbooks, texts, essays, and articles with various linguistic and psycholinguistic indices on cohesion, readability, and language. In the study, a total of 1,322 listening scripts were analyzed to investigate the text complexity among three grades. The measures used for this study consisted of count measures (the number of words, the number of sentences, the average sentence length, the average word length), word frequency (word frequency for contents words, word frequency for all words), word features (imageability score, concreteness score, age of acquisition score), lexical diversity (type-token ration for content words), personal pronouns (the first person pronouns, the second person pronouns, the third person pronouns, all pronouns), conjunctions (causal conjunctions, additive conjunctions, temporal conjunctions, all conjunctions), readability (Flesch Reading Ease score, Flesch-Kincaid Grade Level), syntactic complexity (the number of modifiers, words in front of main verbs), reference cohesion (argument repetition score between sentences, argument repetition score for all sentences), and semantic cohesion (LSA cosine between sentences, LSA cosine for all sentences). The result indicated that the complexity of listening scripts was well organized for the basic counts, the imageability, the age of acquisition, the first person pronouns, the second person pronouns, the additive connectives, and the readability scores. The findings of the current study have several pedagogical implications for the design of English textbooks for English teachers and language learners.

Keywords:

Coh-Metrix, corpus, high school English textbooks, listening scripts

References

  • 고광윤⋅박정준(Goh, G. and J. Park). 2007. 중학교 영어 교과서의 어휘적 연계성에 대한 코퍼스 바탕 연구(A corpus-based study of continuity in Korean middle school English textbooks). ≪영어학연구≫(English Language and Linguistics) 24, 27-45. [https://doi.org/10.17960/ell.2007..24.002]
  • 권인숙(Kwon, I.). 2002. 중학교 영어 교과서의 코퍼스 언어학적 어휘 비교 분석(A corpus-based lexical analysis of middle school English textbooks). ≪영어교육≫(English Teaching) 57-4, 409-444.
  • 김정렬⋅천윤희(Kim, J. and Y. Chun). 2008. 코퍼스 언어학적 분석을 통한 초⋅중등 영어 교과서의 연계성 연구(A study on the continuity of elementary and middle school English textbooks through a corpus-based analysis: the 6th grade elementary school English textbook and the 1st grade middle school English textbook). ≪영어교육≫(English Teaching) 63-2, 361-394. [https://doi.org/10.15858/engtea.63.2.200806.361]
  • 김지은⋅전문기(Kim, J. and M. Jeon). 2013. 중학교 영어교과서 듣기자료의 Coh-Metrix 측정치에 대한 연계성 분석(A corpus-based analysis of the continuity of the listening materials in middle school English textbooks for Coh-Metrix measures). Journal of the Korean Data Analysis Society 15-4, 1987-2000.
  • 류지수⋅전문기(Ryu, J. and M. Jeon). 2020. Coh-Metrix 프로그램을 활용한 2015년 개정 교육과정 중학교 1학년 영어 교과서 비교 분석(A Coh-Metrix analysis of the first grade middle school English textbooks revised by the 2015 National Curriculum). ≪영어학≫(Korean Journal of English Langauge and Linguistics) 20, 89-121.
  • 배지영(Bae, J.). 2019. 2015 개정 교육과정이 적용된 초⋅중등 영어교과서의 읽기 지문 연계성 분석(A continuity analysis of the reading passages in elementary and middle school English textbooks with 2015 revised national curriculum). ≪현대영어영문학≫(Modern Studies in English Language & Literature) 63-2, 81-107. [https://doi.org/10.17754/MESK.63.2.81]
  • 손미영⋅이재근(Son, M. and J. Lee). 2005. 중학교 1학년 영어교과서의 쓰기 활동 자료 분석(An analysis of writing activity materials in the middle school English textbooks). ≪영어어문교육≫(English Language & Literature Teaching) 11-3, 139-164.
  • 송해성(Sohng, H.). 2013. 고등학교 영어 교과서 듣기 과업의 학년별 연계성 연구(Exploring the connectedness of listening tasks according to grades in high school English textbooks). ≪영어어문교육≫(English Language & Literature Teaching) 19-4, 279-305.
  • 유세진⋅김효영(Yu, S. and H. Kim). 2015. 고등학교 영어교과서 읽기 자료에 나타난 시제와 상 분포(Distributions of tense and aspect in readings from Korean high school textbooks). ≪외국학연구≫(The Journal of Foreign Studies) 34, 77-98. [https://doi.org/10.15755/jfs.2015..34.77]
  • 이소영⋅이현우(Lee, S. and H. Lee). 2019. 2015 개정 영어과 교육과정에 따른 중2 영어 교과서 어휘 분포 분석(An analysis of the distribution of vocabulary in middle school English 2 textbooks based on 2015 revised English national curriculum). ≪중등영어교육≫(Secondary English Education) 12-3, 71-93. [https://doi.org/10.20487/kasee.12.3.201908.71]
  • 이승환(Lee, S.). 2013. 코메트릭스(Coh-Metrix)를 이용한 고등학교 영어1과 영어2 교과서 문어 텍스트의 코퍼스 언어학적 난이도 분석(A corpus-based analysis of the difficulty of the reading materials in high school English 1 and 2 textbooks using Coh-Metrix). ≪외국어교육연구≫(Studies in Foreign Language Education) 27-2, 131-148. [https://doi.org/10.16933/sfle.2013.27.2.131]
  • 이정민⋅현태덕(Lee, J. and T. Hyun). 2013. 중학교 3학년 영어 교과서 읽기 자료 비교 분석(A comparative analysis of the reading materials in the middle school English textbooks for the 3rd year students). ≪현대영어교육≫(Modern English Education) 14-4, 263-286.
  • 임영진⋅조윤경⋅정영경(Im, Y., Y. Cho and Y. Jong). 2015. 초등학교 6학년과 중학교 1학년 영어 교과서 읽기 지문 연계성 분석(A continuity analysis of the reading passages of elementary school 6th grade and middle school 1st grade English textbooks). ≪외국어교육≫(Foreign Languages Education) 22-1, 125-148. [https://doi.org/10.15334/FLE.2015.22.1.125]
  • 임인재⋅전문기(Lim, I. and M. Jeon). 2009. 코메트릭스(Coh-Metrix)를 이용한 중학교 1학년 개정 영어 교과서의 코퍼스 언어학적 비교 분석(A corpus-based analysis of middle school English 1 textbooks with Coh-Metrix). ≪영어교육연구≫(English Language Teaching) 21-4, 265-292. [https://doi.org/10.17936/pkelt.2009.21.4.012]
  • 임인재⋅전문기(Lim, I. and M. Jeon). 2013. 코퍼스에 기반한 중학교 1학년 개정 영어교과서 듣기자료 비교 분석(A corpus-based analysis of the listening materials in middle school English 1 textbooks). ≪영어학≫(Korean Journal of English Language and Linguistics) 13-1, 105-134. [https://doi.org/10.15738/kjell.13.1.201303.105]
  • 전문기(Jeon, M.). 2011. Coh-Metrix를 이용한 중학교 1학년과 2학년 개정 영어교과서 읽기 자료의 코퍼스 언어학적 연계성 분석(A corpus-based analysis of the continuity of the reading materials in middle school English 1 and 2 textbooks with Coh-Metrix). ≪언어과학연구≫(The Journal of Linguistic Science) 56, 201-218.
  • 전문기(Jeon, M.). 2014. 고등학교 개정 영어교과서 읽기 자료의 연계성 분석(An analysis of the continuity of the reading materials in high school English textbooks). Journal of the Korean Data Analysis Society 16-2, 925-938.
  • 전문기(Jeon, M.). 2015. 자동화된 언어분석 프로그램을 활용한 중학교 영어교과서의 학년 간 연계성 분석(An analysis of the continuity among middle school English textbooks with an automated language analysis program). ≪현대영어교육≫(Modern English Education) 16-1, 195-218.
  • 전문기⋅최윤희(Jeon, M. and Y. Choe). 2019. 코메트릭스를 활용한 한국 대학생들의 영어 논설문과 설명문 요약문 비교 분석(A Coh-Metrix analysis of Korean EFL learners’ summary writings in the English argumentative and expository texts). ≪영어학≫(Korean Journal of English Language and Linguistics) 19-3, 539-559.
  • 허은선⋅김혜정(Heo, E. and H. Kim). 2015. 초등학교 6학년 영어 교과서 문화내용 분석(Analysis of cultural contents in the 6th grade’s elementary school English textbooks). ≪영어영문학≫(The Mirae Journal of English Language and Literature) 20-2, 247-267.
  • Baayen, R. H., R. Piepenbrock and L. Gulikers. 1995. The CELEX Lexical Database (CD-ROM). Philadelphia: Linguistic Data Consortium, University of Pennsylvania.
  • Berendes, K., S. Vajjala., D. Meurers., D. Bryant., W. Wagner. M., M. Chinkina. and U. Trautwein. 2018. Reading demands in secondary school: Does the linguistic complexity of textbooks increase with grade level and the academic orientation of the school track? Journal of Educational Psychology 110(2), 518-543. [https://doi.org/10.1037/edu0000225]
  • Brill, E. 1995. The CELEX Lexical Database (CD-ROM). Philadelphia: Linguistic Data Consortium, University of Pennsylvania.
  • Coltheart, M. 1981. The MRC psycholinguistic database. Quarterly Journal of Experimental Psychology 33, 497-505. [https://doi.org/10.1080/14640748108400805]
  • Dubin, F. 1995. The craft of materials writing. In P. Byrd, ed., Materials Writer’s Guide, 13-22. New York, NY: Heinle & Heinle Publishers.
  • Feng, S., S. D’Mello. and A. C. Graesser. 2013. Mind wandering while reading easy and difficult texts. Psychonomic Bulletin & Review 20(3), 586-592. [https://doi.org/10.3758/s13423-012-0367-y]
  • Graesser, A. C., M. Jeon, Z. Cai and D. S. McNamara. 2008. Automatic analyses of language, discourse, and situation models. In J. Auracher and W. van Peer, eds., New Beginnings in Literary Studies, 72-88. Cambridge: Cambridge Scholars Publishing.
  • Graesser, A. C., M. Jeon, Y. Yan and Z. Cai. 2007. Discourse cohesion in text and tutorial dialogue. Information Design Journal 15(3), 199-213. [https://doi.org/10.1075/idj.15.3.02gra]
  • Graesser, A. C., D. S. McNamara, M. M. Louwerse and Z. Cai. 2004. Coh-Metrix: Analysis of text on cohesion and language. Behavioral Research Methods, Instruments, and Computers 36(2), 193-202. [https://doi.org/10.3758/BF03195564]
  • Gupta, R. 2013. The readability of English language texts in the primary grades. Language in India 13(5), 534-544.
  • Jurafsky, D. and J. H. Martin. 2008. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, Upper Saddle River, NJ: Prentice-Hall.
  • Krashen, S. D. 1985. The Input Hypothesis: Issues and Implications. Addison-Wesley Longman Ltd.
  • Landauer, T. K. 2007. LSA as a theory of meaning, In T. K. Landauer, D. S. McNamara and W. Kintsch, eds., Handbook of Latent Semantic Analysis, 3-34. Mahwah, NJ: Erlbaum. [https://doi.org/10.4324/9780203936399]
  • Meyer, C. F. 2002. English Corpus Linguistics: An Introduction. Cambridge: Cambridge University Press. [https://doi.org/10.1017/CBO9780511606311]
  • Miller, G. A., R. Beckworth., C. Feldbaum., D. Gross. and K. Miller. 1990. Five papers on WordNet. (Tech Rep.) Princeton University, Cognitive Science Laboratory.
  • Millis, K. and M. Just. (1994). The influence of connectives on sentence comprehension. Journal of Memory and Language 33, 128-147. [https://doi.org/10.1006/jmla.1994.1007]

류지수(Ryu, Jisu), 초빙연구원(Visiting scholar)다언어다문화연구소(Institute of Multilingualism and Mutliculturalism)건국대학교(Konkuk University)서울시(Seoul 05029, Korea)광진구 능동로 120(120 Neungdong-ro, Gwangjin-gu)Tel: 02) 450-3335E-mail: jsryu0508@konkuk.ac.kr

전문기(Jeon, Moongee), 교수(Professor)영어영문학과(Dept. of English), 건국대학교(Konkuk University)서울시(Seoul 05029, Korea)광진구 능동로 120(120 Neungdong-ro, Gwangjin-gu)Tel: 02) 450-3356E-mail: mjeon1@konkuk.ac.kr