The Korean Association for the Study of English Language and Linguistics

Korean Journal of English Language and Linguistics - Vol. 19 , No. 4

[ Article ]
Korea Journal of English Language and Linguistics - Vol. 19, No. 4, pp. 688-712
Abbreviation: KASELL
ISSN: 1598-1398 (Print)
Print publication date 31 Dec 2019
Received 10 Nov 2019 Revised 12 Dec 2019 Accepted 23 Dec 2019
DOI: https://doi.org/10.15738/kjell.19.4.201912.688

Using Virtual Reality to Test Academic Listening Proficiency
Areum Lee
Ewha Womans University


Abstract

This study examines the validity of a virtual reality (VR) listening test in an English as a foreign language (EFL) context. While a VR listening test has the possibility of being a more valid listening test than other listening test formats, its effectiveness has not yet been tested. This study compared test-takers’ performance from the VR test against that of an audio test and a video test. A total of 54 Korean EFL university students participated. Due to the small number of participants, the test scores of the three different test modes were analyzed using a nonparametric Friedman test and a Wilcoxon signed-rank test. Differences in test-takers’ performance were not statistically significant between the VR and the video groups, but were statistically significant between these two groups and the audio group. Specifically, the VR group demonstrated a better ability to search for detailed information than the audio group. In general, participants in the VR listening test responded positively to the test, situating VR as useful for listening assessments.


Keywords: English listening test, head mounted display (HMD), L2 listening assessment, semi-immersive, virtual reality listening test

References
1. Alderson, J., C. Clapham. and D. Wall. 1995. Language Test Construction and Evaluation. Cambridge: Cambridge University Press.
2. Anderson, A. and T. Lynch. 1998. Listening. Oxford: Oxford University Press.
3. Baltova, I. 1994. The impact of video on the comprehension skills of core French students. Canadian Modern Language Review 50, 507-531.
4. Batty, A. O. 2015. A comparison of video and audio mediated listening tests with many-facet Rasch modeling and differential distractor functioning. Language Testing 32, 3-20.
5. Brett, P. 1997. A comparative study of the effects of the use of multimedia on listening comprehension. The system 25, 39–53.
6. Brindley, G. 1998. Assessing listening abilities. Annual Review of Applied Linguistics 18, 171-191.
7. Buck, G. 2001. Assessing Listening. Cambridge: Cambridge University Press.
8. Burgoon, J. K. 1994. Nonverbal signals. In M. L. Knapp and G. R. Miller, eds., Handbook of Interpersonal Communication, 229-285. CA: SAGE Publications.
9. Chen, C. J. and C. S. Teh. 2013. Enhancing an instructional design model for virtual reality-based learning. Australian Journal of Educational Technology 29, 699-716.
10. Chung, B. 2016. VR market trends and prospect, Dong Hyang 28, 7-13.
11. Chung, U. K. 1994. The Effect of Audio, a Single Picture, Multiple Pictures, or Video on Second Language Listening Comprehension. Doctoral dissertation, University of Illinois, Urbana-Champaign, IL, USA.
12. Coniam, D. 2001. The use of audio or video comprehension as an assessment instrument in the certification of English language teachers: A case study. System 29, 1-14.
13. Dalgarno, B. and M. Lee. 2010. What are the learning affordances of 3D virtual environments? British Journal of Educational Technology 41(1), 10–32.
14. De Lucia, A., R. Francese., I. Passero and G. Tortora. 2009. Development and evaluation of a virtual campus on Second Life: The case of Second DMI. Computers & Education 52, 220-233.
15. Dolgunsöz, E., G. Yıldırım and S. Yıldırım. 2018. The effect of virtual reality on EFL writing performance. Journal of Language and Linguistic Studies 14, 278-292.
16. Dunkel, P. and S. Davy. 1989. The heuristics of lecture notetaking: Perceptions of American & international students regarding the value & practice of notetaking. English for Specific Purposes 8, 33-50.
17. Elbder, C., N. Iwashita and T. McNamara. 2002. Estimating the difficulty of oral proficiency tasks: What does the test-taker have to offer? Language Testing 19, 347-368.
18. Field, J. 2004. An insight into listeners’ problems: Too much bottom-up or too much top-down. System 32, 363-377.
19. Field, J. 2008. Listening in the Language Classroom. Cambridge: Cambridge University Press.
20. Ginther, A. 2002. Context and content visuals and performance on listening comprehension stimuli. Language Testing 19, 133-167.
21. Grabowski, A. and J. Jankowski. 2015. Virtual reality based pilot training for underground coal miners, Safety Science 72, 310-314.
22. Gruba, P. 1993. A comparison study of audio and video in language testing. JALT Journal 15, 85-88.
23. Gruba, P. 1994. Design and development of a video-mediated test of communicative proficiency. JALT Journal 16, 25–40.
24. Gruba, P. 1997. The role of video media in listening assessment. System 25, 335–345.
25. Hadar, U. 1989. Speech production: Role of head movements. Language and Communication 9, 245-257.
26. Hale, G. and R. Courtney. 1994. The effect of note taking on listening comprehension in the TOEFL. Language Testing 11, 29-47.
27. Harris, T. 2008. Listening with your eyes: The importance of speech-related gestures in the language. Foreign Language Annals 36, 80-187.
28. Hughes, A. 2003. Testing for Language Teachers. Cambridge: Cambridge University Press.
29. Janusik, L. A. 2004. Researching Listening from the Inside Out: The Relationship Between Conversational Listening Span and Perceived Communicative Competence. Doctoral dissertation, University of Maryland, MD, USA.
30. Jennett, C. A., L. Cox., P. Cairns., S. Dhoparee., A. Epps., T. Tijs and A. Walton. 2008. Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies 66, 641-661.
31. Kim, J. 2004. Second Language English Listening Comprehension Using Different Presentations of Pictures and Video Cues. Doctoral dissertation, University of New South Wales, Sydney, NSW, Australia.
32. Kintsch, W. 1998. Comprehension: A Paradigm for Cognition. Cambridge: Cambridge University Press.
33. Lawrence, J. H. and E. R. Gary. 1992. Visually induced motion sickness in virtual environment. Presence: Virtual and Augmented Reality 1, 306-310.
34. Lynch, T. 1998. Theoretical perspectives on listening. Annual Review of Applied Linguistics 18, 3–19.
35. Magaki, T. 2017. Measuring reduction methods for VR sickness in virtual environments. International Journal of Virtual and Personal Learning Environment 7, 27-43.
36. McGurk, H. and Y. Macdonald. 1976. Hearing lips and seeing voices. Nature 264, 746-748.
37. McNeill, D. 1985. So you think gestures are non-verbal? Psychological review 92, 350-371.
38. Morley, J. 1991. Aural comprehension instruction: Principles and practices. In M. Celce-Murcia, ed., Teaching English as a second or foreign language, 69-85. MA: New bury House.
39. Ockey, G. J. 2007. Construct implications of including still image or video in computer-based listening tests. Language Testing 24, 517-537.
40. Ornberg, T. 2003. Linguistic Presence on the Internet: Communication, World View and Presence in Online Virtual Environments. Master’s thesis, University of Umea, Sweden.
41. Peterson, P. W. 1991. Skills and strategies for proficient listening. In M. Celce-Murcia, ed., Teaching English as a Second or Foreign Language, 87-100. MA: New bury House.
42. Progosh, D. 1996. Using video for listening assessment: Opinions of test-takers. TESL Canada Journal 14, 34-44.
43. Richards, J. C. 1983. Listening comprehension: Approach, design, and procedure. TESOL Quarterly 17, 219-240.
44. Riseborough, M. 1981. Physiographic gestures as decoding facilitators: Three experiments exploring a neglected facet of communication. Journal of Non-verbal Behavior 5, 172-183.
45. Riva, G. 2003. Applications of virtual environments in medicine. Methods Inf Med 42, 524-534.
46. Rost, M. 2011. Teaching and Researching Listening. UK: Pearson.
47. Sheflen, A. 1964. The significance of posture in communication systems. Psychiatry 27, 316-331.
48. Shin, D. 1998. Using videotaped lectures for testing academic listening proficiency, International Journal of Listening 12, 57-80.
49. Shin, Y. C. 2015. A virtual walk through London: Culture learning through a cultural immersion experience. Computer Assisted Language Learning 28, 407-428.
50. Shih, Y. C. and M. T. Yang. 2008. A Collaborative virtual environment for situated language learning using VEC3D. Educational Technology & Society 11, 56-68.
51. Sueyoshi, A. and D. Hardison. 2005. The role of gestures and facial cues in second language listening comprehension. Language Learning 55, 661-699.
52. Song, J. 2014. A Study of ESL Students’ Performance and Perceptions in Face-to-face and Virtual-world Group Oral Tests. Doctoral dissertation, The University of Texas at Austin, TX, USA.
53. Suvorov, R. 2009. Context visuals in L2 listening tests: The effects of photographs and video vs. audio-only format. In C. A. Chapelle., H. G. Jun and I. Katz, eds., Developing and Evaluating Language Learning Materials, 53-68. IA: Iowa State University.
54. Underwood, M. 1997. Teaching Listening. New York: Longman.
55. von Raffler-Engel, W. 1980. Kinesics and paralinguistic: A neglected factor in second-language research and teaching. Canadian Modern Language Review 36, 225–237.
56. Wagler, A. and M. D. Hanus. 2018. Comparing virtual reality tourism to real-life experience: Effects of presence and engagement on attitude and enjoyment, Communication Research Reports 35, 456-464.
57. Wagner, E. 2007. Are they watching? Test taker viewing behavior during an L2 video listening test. Language Learning & Technology 11, 67-86.
58. Wagner, E. 2008. Video listening tests: What are they measuring? Language Assessment Quarterly 5, 218-243.
59. Wagner, E. 2010. The effect of the use of video texts on ESL listening test-taker performance. Language Testing 27, 493-513.
60. Wang, C. X., H. Song., F. Xia and Q. Yan. 2009. Integrating Second Life into an EFL program in China: Research Collaboration across the continents. TechTrends 53, 14-19.
61. Weir, C. J. 2005. Language Testing and Validation: An Evidence-based Approach. Basingstoke, UK: Palgrave Macmillan.
62. White, G. 1998. Listening. Oxford: Oxford English.
63. Witmer, B. G. and M. J. Singer. 1998. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments 7, 225-240.
64. Zhang, H., X. He., B. Nie and H. S. Mitri. 2016. A new virtual reality training system for cool underground mines. Paper presented at the 3rd International Symposium on Mine Safety Science and Engineering. Montreal, Canada.

Lee, Areum (Ph.D. Candidate)Ewha Womans UniversityDepartment of English Education52, Ewhayeondae-gil, Seodaemun-guSeoul, KoreaTel: 02-3277-2647E-mail: areum0504@gmail.com