Teaching English Language

Teaching English Language

Toward Multimodal Pragmatics: Are Video-based Pragmatic Tests (VPTs) the Answer?

Document Type : Original Article

Authors
1 University of Sistan and Balouchestan
2 University of Sistan and Baluchestan
10.22132/tel.2023.338714.1358
Abstract
Using the multimodal approach, the present study aimed to investigate the effect of video-based pragmatic tests on EFL learners’ pragmatic awareness and pragmalinguistic learning. It further tried to find out the washback effect of video-based pragmatic tests on learners’ speaking ability. Participants of this study were 38 males and females who studied English. The participants were randomly divided into two control and experimental groups. They were pre-tested by Cambridge Placement Test. In the experimental group, video-based pragmatic tests were used along with the usual instructional materials; while in the control group the material was taught in the conventional method, without using video-based pragmatic tests. The students were pre/post-tested by the means of two Multiple-choice Discourse Completion Tests (MDCTs), taking pragmatic awareness and pragmalinguistic learning into account. The results of the study indicated a high level of pragmatic awareness and pragmalinguistic learning improvement in the experimental group. Further, the findings demonstrated positive washback on learners’ speaking proficiency resulting from using video-based pragmatic tests. The qualitative data also demonstrated a positive impact on the speaking ability of the experimental group, confirmed quantitatively. The findings of the study will have theoretical and pedagogical implications.
Keywords

Allan, K. (1998). Speech act classification and definition. In J. L. Mey (Ed.), Concise Encyclopedia of Pragmatics (pp. 922-926). New York: Elsevier.
Alderson, J. C., & Wall, D. (1993). Does washback exist? Applied linguistics, 14 (2), 115-129.
Aufa, F. (2016). Explicit pragmatic instruction in teaching English as a foreign language. JEE, Journal of English and Education, 5(1), 37-44.
Bach, K., & Harnish, R. M. (1979). Linguistic communication and speech acts (p. 3). Cambridge, Mass.: MIT Press.
Bardovi-Harlig, K. & Mahan-Taylor, R. (2003). Teaching pragmatics. Washington D.C.: US Department of State Office of English Language Programs.
Bardovi-Harlig, K. (1996). Pragmatics and language teaching: Bringing pragmatics and pedagogy together. In L. F. Boutan (Ed.), Pragmatics and language learning (pp. 21-39). Urbana: University of Illinois.
Bardovi‐Harlig, K. (1999). Exploring the interlanguage of interlanguage pragmatics: A research agenda for acquisitional pragmatics. Language learning, 49(4), 677-713.
Başak, H. (2019). Self-assessment of students' speaking skills (Master's thesis, Middle East Technical University).
Beebe, L. M., & Cummings, M. C. (1996). Natural speech act data vs. written questionnaire data: How data collection method affects speech act performance. In S. M. Gass, & J. Neu (Eds.), Speech Acts Across Cultures (pp. 65-86). Berlin: Mouton de Gruyter.
Birjandi, P., & Rezaei, S. (2010). Developing a multiple-choice discourse completion test of interlanguage pragmatics for Iranian EFL learners. In ILI Language Teaching Journal (Special issue: Proceedings of the first conference on ELT in the Islamic world) (Vol. 6, No. 1, p. 2).
Brown, J. D. (2008). Raters, functions, item types and the dependability of L2 pragmatics tests. Investigating pragmatics in foreign language learning, teaching and testing30, 224-48.
Canale, M., & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied linguistics, 1(1), 1-47.
Çetinavci, U. R., & Öztürk, I. (2017). The Development of an Online Test to Measure the Interpretation of Implied Meanings as a Major Constituent of Pragmatic Competence. Online Submission.
  Chapman, D. W., & Snyder, C. W. J. (2000). Can high stakes national testing improve instruction: Reexamining conventional wisdom. International Journal of Educational Development, 20(6), 457-474.
Cheng, L. (1997). How does washback influence teaching? Implications for Hong Kong. Language and Education, 11(1), 38-54.
Cheng, L. (2005). Changing language teaching through language testing. Cambridge: CUP.
Clennell, C. (1999). Promoting pragmatic awareness and spoken discourse skills with EAP classes. ELT Journal, 53/2(April), 83-91. doi:https://doi.org/10.1093/elt/53.2.83
Cohen, A. D. (2008). Teaching and assessing L2 pragmatics: What can we expect from learners? Language Teaching, 41(2), 213-235.
Cohen, A. D. (2010). Approaches to assessing pragmatic ability. Teaching and learning pragmatics: Where language and culture meet, 264-285.
Cole, J. S., & Osterlind, S. J. (2008). Investigating differences between low-and high-stakes test performance on a general education exam. The Journal of General Education, 57(2), 119-130.
Communicative Language Ability. (1990). In L. F. Bachman, Fundamental Considerations in Language Testing . Oxford: Oxford University Press.
Eslami-Rasekh, Z. (2005). Raising the pragmatic awareness of language learners. ELT Journal, 59(3), 199-208.
Fukuya, Y. J., & Zhang, Y. (2002). Effects of recasts of EFL learners' acquisition of pragmalinguistic conventions of request. University of Hawai'I Second Langauge Studies Paper 21 (1).
Garita, C. O., & Elizondo, L. B. (2016). Pragmatics in EFL Teaching: Building Meaning beyond Words through the Use of Videos. Revista de Lenguas Modernas, 223-236. doi:https://doi.org/10.15517/rlm.v0i25.27697
Gharibeh, S. G.-N. (2016). The role of instruction in the development of EFL learners’ pragmatic competence. The Asian Journal of Applied Linguistics, 3(2), 173-184.
Hinkel, E. (1997). Appropriateness of advice: DCT and multiple choice data1. Applied linguistics, 18(1), 1-26.
Holmes, J. (2013). An introduction to sociolinguistics. NY: Routledge.
Hymes, D. (1972). On communicative competence. sociolinguistics269293, 269-293.
Ishihara, N. (2010). Assessment of pragmatics in the classroom. In N. Ishihara, & A. D. Cohen (Eds.), Teaching and learning pragmatics (pp. 286-317). Pearson Education.
Ishihara, N., & Cohen, A. D. (2014). Teaching and learning pragmatics: Where language and culture meet. Routledge.
Ishihara, N. (2011). Co-Constructing Pragmatic Awareness: Instructional Pragmatics in EFL Teacher Development in Japan. Tesl-Ej, 15(2), n2.
Karatepe, Ç. (2001). Pragmalinguistic awareness in EFL teacher training. Language Awareness, 10(2-3), 178-188.
 Kasper, G., & Roever, C. (2005). Pragmatics in second language learning. Handbook of research in second language teaching and learning1, 317-334.
Leech, G. N. (1983). Principles of Pragmatics Text. London, NY: Longman.
Mirzaei, A., Domakani, M. R., & Rezaei, M. S. (2014). L2 pragmatics underrepresentation as a washback mechanism in EFL contexts: Linking test-design features to high-stakes test use. TELL, 8(1), 1-29.
Moradkhan, D., & Jalayer, B. (2010). The Impact of Using Authentic Audio-Taped and Video-Taped Materials on the Level of EFL Learners’ Pragmatic Competence. JELS, 1 (3), 33-52.
Norbekova, G. (2020). Perceptions about Classroom-based Speaking Tests and their Washback. Журнал иностранных языков и лингвистики1(1), 80-84.
Nurani, L. M. (2009). Methodological issue in pragmatic research: Is discourse completion test a reliable data collection instrument? Jurnal Sosioteknologi, 8(17), 667-678.
O'Keeffe, A., Clancy, B., & Adolphs, S. (2011). Introducing pragmatics in use. Routledge.
Özyıldırım,, İ. (2010). The level of directness in Turkish apology forms in relation to the level of education. Hacettepe Üniversitesi Edebiyat Fakültesi Dergisi27(1).
Popham, W. J. (2001). Teaching to the Test? Educational leadership, 58(6), 16-21.
Povolná, R. (2012). Pragmatic awareness in teacher education. Acta academica karviniensia12(1), 148-158.
Eslami-Rasekh, Z. E. (2005). Raising the pragmatic awareness of language learners. ELT journal, 59(3), 199-208.
Razavipour, K., Hoseini, F., & Validi, M. (2020). Washback to Classroom Climate: The Case of an IELTS Speaking Preparation Course. Journal of Research in Applied Linguistics, 11(1), 21-43.
Reddy, S. D. (2011). Raising pragmatic awareness of students through classroom activities. Arab World English Journal, 2(4), 171-193.
Richards, C., & Bohlke, D. (2012). Four corners, student’s book 1. New York: Cambridge University Press.
Richards, C., & Bohlke, D. (2012). Four corners, student’s book 2. New York: Cambridge University Press.
Richards, C., & Bohlke, D. (2012). Four corners, student’s book 3. New York: Cambridge University Press
Richards, C., & Bohlke, D. (2012). Four corners, student’s book 4. New York: Cambridge University Press.
Richards, J. C., Hull, J., & Proctor, S. (2004). Interchange student's book 1 with audio CD. Cambridge University Press.
 
Richards, J. C., Hull, J., & Proctor, S. (2005). Interchange student's book 2 with audio CD. Cambridge University Press.
Richards, J. C., Hull, J., & Proctor, S. (2005). Interchange student's book 3 with audio CD. Cambridge University Press.
Richards, J. C., Hull, J., & Proctor, S. (2005). Interchange student's book 4 with audio CD. Cambridge University Press.
Richards, J. C., & Rodgers, T. S. (2014). Approaches and methods in language teaching. Cambridge university press.
Roever, C. (2001). Web-based language testing. Language Learning & Technology, 5(2), 84-94.
Roever, C. (2006). Validation of a web-based test of ESL pragmalinguistics. Language Testing, 23(2), 229-256.
Rosales, V. P., & Barragan, J. A.(2015). Raising EFL Pragmatic Awareness in situations which require the speech act: requests. Quintero Mextesol journal. URL: http://www. mextesol. net/journal/index. php.
Rose, K. R. (2005). On the effects of instruction in second language pragmatics. System, 33(3), 385-399.
Sachtleben, A. & Denny, H.G., (2012). Making the implicit explicit: raising pragmatic awareness in trainee interpreters, using semi-authentic spontaneous discourse samples. TESOL Journal, 3(1), 126 – 137.
Saslow, J. & Ascher, A. (2006). Top Notch series: English for today’s world. Pearson Education
Schauer, G. A. (2006). Pragmatic awareness in ESL and EFL contexts: Contrast and development. Language learning56(2), 269-318.
Searle, J. (1969). Speech acts. Cambridge: Cambridge University Press.
Shohamy, E. (2001). The power of tests: A critical perspective on the uses of language tests. Longman.
Siegel, J. (2016). Pragmatic Activities for the Speaking Classroom. In English teaching forum (Vol. 54, No. 1, pp. 12-19). US Department of State. Bureau of Educational and Cultural Affairs, Office of English Language Programs, SA-5, 2200 C Street NW 4th Floor, Washington, DC 20037.
Soler, E. A., & Pitarch, J. G. (2010). The Effect of Instruction on Learners’ Pragmatic Awareness: a Focus on Refusals. International Journal of English Studies, 10(1), 65-80.
Tada, M. (2005). Assessment of EFL pragmatic production and perception using video prompts. Temple University.
Tajeddin, Z., & Dabbagh, A. (2015). Interlanguage Pragmatic Test Tasks: Does a Low-Stakes Test Have Washback to L2 Teachers and Learners? The Journal of Asia TEFL, 12 (4), 129-158. doi.org/10.18823/asiatefl.2015.12.4.5.129.
Takahashi, S. (2015). The effects of learner profiles on pragmalinguistic awareness and learning. System, 48, 48-61.
Thomas, J. (1983). Cross-cultural pragmatic failure. Applied Linguistics 4(2), 91 - 112.
Vasquez, C., & Sharpless, D. (2009). The role of pragmatics in the master's TESOL curriculum: Findings from a nationwide survey. TESOL Quarterly, 43(1), 5-28.
Wall, D. (2005). The impact of high-stakes examinations on classroom teaching: A case study using insights from testing and innovation theory (Vol. 22). Cambridge University Press.
Watanabe, Y. (2004). Methodology in washback studies. In Washback in language testing (pp. 41-58). Routledge.
Wiggins, G. (2011). A true test: Toward more authentic and equitable assessment. Phi Delta Kappan92(7), 81-93.
Yates, L. (2004). The secret rules of language. Prospect, 19(1), 3-21.
Volume 19, Issue 1
January 2025
Pages 159-183

  • Receive Date 22 April 2022
  • Accept Date 03 March 2023