Your browser does not support the PubReader view.
Go to this page to see a list of supporting browsers.
The Korean Association for the Study of English Language and Linguistics
[ Article ]
Korea Journal of English Language and Linguistics - Vol. 18, No. 3, pp.328-348
ISSN: 1598-1398 (Print) 2586-7474 (Online)
Print publication date 30 Sep 2018
Received 15 Aug 2018 Revised 12 Sep 2018 Accepted 18 Sep 2018
DOI: https://doi.org/10.15738/kjell.18.3.201809.328

Efficiency of Online Grammar Checker in English Writing Performance and Students’ Perceptions

Hyejin Yang
Lecturer, Sookmyung Women’s University Graduate School of TESOL Cheongpa-ro 47, Na-gil 36, Yongsan-gu, Seoul, Korea, 140-132. hjyang1112@gmail.com

Correspondence to: Yang, Hyejin Lecturer, Sookmyung Women’s University Graduate School of TESOL Cheongpa-ro 47, Na-gil 36, Yongsan-gu, Seoul, Korea, 140-132. E-mail: hjyang1112@gmail.com

Abstract

Yang, Hyejin. 2018. Efficiency of online grammar checker in English writing performance and students’ perceptions. Korean Journal of English Language and Linguistics, 18-3, 328-348. This study investigated efficiency of feedback from an online grammar checker, SpellCheckPlus, by examining (1) efficiency of feedback from the grammar checker in improvement of grammar accuracy in L2 students’ writing and (2) students’ perceptions towards the grammar checker as a language learning tool. A mixed-methods approach was employed to collect data by using multiple instruments, such as linguistic analysis of three major assignments and students’ responses to the pre- and post-treatment questionnaires. The findings determined grammatical error rates significantly decreased between the first and second drafts for Assignments 2 and 3. No significant differences in error rates were noted between the first and second drafts for Assignment 1. Students’ perceptions towards feedback from the grammar checker found incorrect writing feedback and students’ lack of proficiency influenced error correction. Questionnaire responses determined students displayed relatively positive attitudes toward the grammar checker, while incorrect feedback hindered the level of the trustworthiness toward this feedback. This study implied the grammar checker could serve as a useful pedagogical tool to help grammar uses for low-proficient L2 learners’ writing.

Keywords:

feedback, grammar checker, writing classes, grammar accuracy

References

  • Beatty, K. 2003. Teaching and Researching Computer-assisted Language Learning. London: Pearson Education.
  • Burston, J. 2001. Exploiting the potential of a computer-based grammar checker in conjunction with self-monitoring strategies with advanced level students of French. CALICO Journal 18(3), 499-516. [https://doi.org/10.1558/cj.v18i3.499-515]
  • Chapelle, C. 2001. Computer Applications in Second Language Acquisition: Foundations for Teaching, Testing and Research, Cambridge: Cambridge University Press. [https://doi.org/10.1017/CBO9781139524681]
  • Chapelle, C. 2003. English Language Learning and Technology. Amsterdam/Philadelphia: John Benjamins Publishing. [https://doi.org/10.1075/lllt.7]
  • Chapelle, C., and J. Jamieson. 2008. Tips for Teaching with CALL: Practical Approaches to Computer-assisted Language Learning. New York: Pearson Education.
  • Chen, C. F. and W. Y. Cheng. 2008. Beyond the design of automated writing evaluation: Pedagogical practices and perceived learning effectiveness in EFL writing classes. Language Learning and Technology 12(2), 94-112.
  • Cohen, J. 1960. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20, 37-46. [https://doi.org/10.1177/001316446002000104]
  • Cotos, E. 2011. Potential of automated writing evaluation feedback. CALICO Journal 28(2), 420-459. [https://doi.org/10.11139/cj.28.2.420-459]
  • Ellis, R. 1994. The Study of Second Language Acquisition. Oxford: Oxford University Press.
  • Domeij, R., O. Knutsson and K. S. Eklundh. 2002. May. Different ways of evaluating a Swedish grammar checker. Paper presented at Association for Computational Linguistics, Spain.
  • Ferris, D. 2003. Response to Writing: Implications for Second Language Students. NJ: Lawrence Erlbaum.
  • Ferris, D. 2004. The “grammar correction” debate in L2 writing: Where are we, and where do we go from here? (and what do we do in the meantime…?). Journal of Second Language Writing 13(1), 49-62. [https://doi.org/10.1016/j.jslw.2004.04.005]
  • Ferris, D. and B. Roberts. 2001. Error feedback in L2 writing classes: How explicit does it need to be? Journal of Second Language Writing 10(3), 161-184. [https://doi.org/10.1016/S1060-3743(01)00039-X]
  • Fischer, R. and E. K. Grusin. 1993. Grammar Checkers: Programs that may not enhance learning. Journalism Educator 47(4), 20-27. [https://doi.org/10.1177/107769589304700403]
  • Hartshorn, K., N. Evans, W. Merrill., R. Sudweeks., D. Strong-Krause and N. Anderson (2010). Effects of dynamic corrective feedback on ESL writing accuracy. TESOL Quarterly 44(1), 84-109. [https://doi.org/10.5054/tq.2010.213781]
  • Hawisher, G. E. and M. F. Sweany. 1996. Computers and the Teaching of Writing in American Higher Education, 1979-1994: A History. NJ: Ablex Publishing.
  • Hegelheimer, V. and D. Fisher. 2006. Grammar, writing, and technology: A sample technology-supported approach to teaching grammar and improving writing for ESL learners. CALICO Journal 23(2), 257-279. [https://doi.org/10.1558/cj.v23i2.257-279]
  • Hinkel, E. 2004. Teaching Academic ESL Writing: Practical Techniques in Vocabulary and Grammar. New York: Routledge.
  • Hyland, K. and F. Hyland. 2006. Feedback in Second Language Writing. Cambridge: Cambridge University Press. [https://doi.org/10.1017/CBO9781139524742]
  • Isaacs, D. and Y. Zhang. 2009. Do language-checking tools improve the document quality of non-native speakers?. Unpublished manuscript.
  • Kim, J. 2014. The effectiveness of automated essay scoring in an EFL college classroom, Multimedia-Assisted Language Learning 17(3), 11-36.
  • Kepner, C. G. 1991. An experiment in the relationship of types of written feedback to the development of second-language writing skills. The Modern Language Journal 75(3), 305-313. [https://doi.org/10.1111/j.1540-4781.1991.tb05359.x]
  • Lee, K. 2005. Investigation of the importance of grammar instruction in FL programs. Korean Journal of English Language and Linguistics 5(2), 279-303.
  • Levy, M. and G. Stockwell. 2006. CALL Dimensions: Options and Issues in Computer-assisted Language Learning. New York: Routledge.
  • Polio, C., C. Fleck and N. Leder. 1998. “If I only had more time”: ESL learners' changes in linguistic accuracy on essay revisions. Journal of Second Language Writing 7(1), 43-68. [https://doi.org/10.1016/S1060-3743(98)90005-4]
  • Robb, T., S. Ross and I. Shortreed. 1986. Salience of feedback on error and its effect on EFL writing quality. TESOL Quarterly 20(1), 83-96. [https://doi.org/10.2307/3586390]
  • Woo, J. 2015. Effects of grammar instruction in context with writing practice on students’ manuscript writing in an EAP course. Korean Journal of English Language and Linguistics 15(2), 149-180. [https://doi.org/10.15738/kjell.15.2.201506.149]
  • Vernon, A. 2000. Computerized grammar checkers 2000: Capabilities, limitations, and pedagogical possibilities. Computers and Composition 17(3), 329-349. [https://doi.org/10.1016/S8755-4615(00)00038-4]
  • Vygotsky, L. S. 1962. Thought and Language (E. Hanfmann, G. Vakar, Eds and Trans.): Cambridge, MA: MIT Press. [https://doi.org/10.1037/11193-000]
  • Warschauer, M., and P. Ware. 2006. Automated writing evaluation: Defining the classroom research agenda. Language Teaching Research 10(2), 157-180. [https://doi.org/10.1191/1362168806lr190oa]

Appendix

Appendix A. Pre-treatment Questionnaire

1. Which country are you from?

2. What is your mother tongue (Native Language)?

3. What is your major?

4. How long have you been in USA?

Less than 1 year1 year 2 years2 – year – 3 years

3 year – 4 yearsMore than 4 years

5. Have you ever used language checking tools like grammar checker (e.g., Microsoft word checker, Other word processing software, Spellchecker, AbiWord, Language Tool, Grammar Slammer, etc.)?

YesNo

6. If you said ‘yes’, what grammar checkers have you used before? Please specify the types of the checker that you have used.

7. If you have, how often do you use them when you write / revise essays?

Every time when I write an essayOnce a week

2 – 4 times per weekOnce a month

2 -3 times a month4 times a month

Seldom useNever

No answer

8. If you have ‘never’ used grammar checker, what makes you not to use the checkers? Please express your thought briefly.

I prefer to revise it by myself

prefer to check the grammar errors with people’s (e.g. teachers, colleagues) help rather than using computer-based grammar checkers

I just do not have many chances to use the checkers

I do not quite believe the computer-based grammar checker due to its limitation of checking grammar

Other reasons

9. When do you usually use language-checking tools?

Writing essaysEmailsInstant Messages

OthersNothing

10. Please indicate your level of trustworthiness on language (grammar) checking tools.

12345

I don’t truststrongly trust

11. What do you think of grammar-checking tools? If you have never used it, what is your expectation toward grammar-checking tool?

Appendix B. Post-treatment Questionnaire

1. How easy is it to use the grammar checker?

12345

strongly difficultstrongly easy

2. After using the grammar checker, do you think ‘language checker’ is helpful for you to revise the errors in your essay?

12345

not helpfulstrongly helpful

3. After using the grammar checker, how much do you trust the language-checking tool regarding checking grammar errors?

12345

I don’t truststrongly trust

4. Overall, do you think using the grammar / spelling checker helps you improve grammar accuracy in your essays?

YesNo

5. Which part of the grammar do you think you improve the most while using the grammar checker?

Tense

Subject-verb agreement

Punctuation (e.g., comma, period, etc.)

Word order

Word choice

Word form (e.g., noun, adjective, adverbs, etc.)

Verb form (e.g., to infinitives or gerunds)

6. Please briefly describe the merits (that you can benefit from) of the grammar checker.

7. Please briefly describe the weaknesses of the grammar checker.

8. To what extent did the experience in using the grammar checker affect your attitudes towards checking grammar errors in your essays?

12345

Did not affectDid affect

9. Will you continuously use other grammar/spelling checkers to revise your essay?

YesNo

10. Please write short opinions about using grammar checker based on your experiences.

11. Do you have any suggestions for the future use of the grammar checker in English writing classes?

12. Do you have any suggestions for further improvement on language-checking tools?