Washback Effects of an Interactional Competence Checklist

Authors

Department of Foreign Languages and Linguistics, Shiraz University

Abstract

The concept of interactional competence and its assessment as a complex language ability has long been a concern for research. A more recent approach to testing this construct has called for an investigation into the commonly-used concept of washback which refers to the effect of testing on teaching and learning.  This study aimed to investigate the washback effect of an interactional competence checklist on EFL teaching and learning. The study combined qualitative and quantitative research methods within a comparative design between an experimental and a control group of 27 advanced English learners. Data was collected through students’ oral performance, teacher and student surveys, the IC checklist, and classroom observations. The data were analyzed using mixed ANOVA and content analysis using coding schemes and themes to compare the scores obtained before and after the treatment. The study revealed a statistically significant difference in learners’ interactive oral performance before and after the implementation of the checklist. Results indicated positive washback in aspects including familiarity with the checklist, test quality, interpretation and use, motivation, professional development, and learners’ studying habits. The implications for the classroom are that language program administrators and curriculum designers can introduce modifications in developing materials that foreground a focus on interactional competence.

Keywords


Ahmadi, H., Behnam, B., & Seifoori, Z. (2021). The reciprocal questioning as a formative assessment strategy: EFL learners' reading comprehension and vocabulary learning. Teaching English Language, 15(2), 61–93.
Alderson, J.C. & Wall, D. (1993). Does washback exist? Applied Linguistics, 14(2), 115–129.
Ary, D., Jacobs, L. C., Irvine, C. K. S., & Walker, D. (2018). Introduction to research in education. U.S.: Cengage Learning.
Azadi, G., & Gholami, R. (2013). Feedback on washback of EFL tests on ELT in L2 classroom. Theory & Practice in Language Studies3(8), 35–41.
Bachman, L. & Palmer, A. (1996). Language testing in practice. Oxford: Oxford University Press.
Bailey K (1999). Washback in language testing. TOEFL monograph series. Princeton, NJ: Educational Testing Service.
Bokiev, U., & Abd Samad, A. (2021). Washback of an English language assessment system in a Malaysian University foundation program. The Qualitative Report, 26(2), 555–587.
Burrows, C. (2004). Washback in classroom-based assessment: A study of the washback effect in the Australian adult migrant English program. In L. Cheng & Y. Watanabe (Eds.), Washback in language testing (pp. 113–128). Mahwah, NJ: Lawrence Erlbaum.
Chalhoub-Deville, M., & Deville, C. (2005). A look back at and forward to what language testers measure. In Handbook of research in second language teaching and learning (pp. 839–856). Routledge.
Cheng, L. (1997). How does washback influence teaching? Implications for Hong Kong. Language and Education, 11(1), 38–54.
Cheng, L. (2005). Changing language teaching through language testing: A washback study. Cambridge University Press.
Cheng, L., Sun, Y., & Ma, J. (2015). Review of washback research literature within Kane’s argument-based validation framework. Language Teaching, 48(4), 436–470.
Dong, M. (2020). Structural relationship between learners’ perceptions of a test, learning practices, and learning outcomes: A study on the washback mechanism of a high-stakes test. Studies in Educational Evaluation64, 100824.
Ducasse, A. & Brown, A. (2009). Assessing paired orals: Rater’s orientation to interaction. Language Testing, 26, 423–443.
Estaji, M., & Alikhani, H. (2020). The first certificate in English textbook washback Effect: A comparison of teachers' and learners' perceptions. Teaching English Language, 14(1), 119-152.
Galaczi, E.D. (2014). Interactional competence across proficiency levels: How do learners manage interaction in paired tests? Applied Linguistics, 35(5), 553–574.
Galaczi, E. D., & Taylor, L. (2018). Interactional competence: Conceptualisations, operationalisations, and outstanding questions. Language Assessment Quarterly, 15(3), 219–236.
Green, A. (2020). Washback in language assessment. International Journal of English Studies, 13(2), 39–51.
Gu, X. (2007). Positive or negative—an empirical study of CET washback. Chongqing: Chongqing University Press.
Hawkey, R. (2006). Impact theory and practice. Cambridge University Press.
Hirai, A. & Koizumi, R. (2009). Development of a practical speaking test with a positive impact on learning using a story retelling technique. Language Assessment Quarterly, 6, 151–167.
Hughes, A. (1989). Testing for language teachers. Cambridge: Cambridge University Press.
Hughes, L. (2021). Washback and the assessment practices of ESL instructors at Japanese university. Language Literacy: Journal of Linguistics, Literature, and Language Teaching, 5(1), 1–9.
Kilickaya, F. (2016). Washback effects of a high-stakes exam on lower secondary school English teachers’ practices in the classroom. Lublin Studies in Modern Languages and Literature40(1), 116–134.
Kramsch, C. (1986). From language proficiency to interactional competence, The Modern Language Journal, 70(4), 366–372.
Kutlu, M. O., & Demiroglari, G. (2020). Washback effect of higher education institution exam--foreign language test on University candidates' attitudes. African Educational Research Journal, 8, 121–130.
Larsson, M. & Olin-Scheller, C. (2020). Adaptation and resistance: Washback effects of the national test on upper secondary Swedish teaching. The Curriculum Journal, 31(4), 687–703.
Li, X. (2018). Self-assessment as ‘assessment as learning’ in translator and interpreter education: validity and washback. The Interpreter and Translator Trainer12(1), 48–67.
Liu, X., & Yu, J. (2021). Relationships between learning motivations and practices as influenced by a high-stakes language test: The mechanism of washback on learning. Studies in Educational Evaluation68, 96–107.
Lynch, B. K. (2003). Language assessment and programme evaluation. Minnesota: Capstone.
May, L. (2011). Interaction in a paired speaking test. Frankfurt am Main: Peter Lang.
May, L., Nakatsuhara, F., Lam, D., & Galaczi, E. (2020). Developing tools for learning-oriented assessment of interactional competence: Bridging theory and practice. Language Testing, 37(2), 165–188.
Muñoz, A. P. & Álvarez, M. E. (2010). Washback of an oral assessment system in the EFL classroom. Language Testing, 27(1), 33–49.
Nakatsuhara, F. (2013). The co-construction of conversation in group oral tests. Frankfurt am Main: Peter Lang.
Nakatsuhara, F., May, L., Lam, D., & Galaczi, E. (2018). Learning-oriented feedback and interactional competence. United Kingdom: Cambridge Assessment English.
Qi, L. (2004). Has a high-stakes test produced the intended changes? In L. Cheng & Y. Watanabe (Eds), Washback in language testing (pp. 171–190). Mahwah, NJ: Lawrence Erlbaum.
Robb, T. & Ercanbrack, J. (1999). A study of the effect of direct test preparation on the TOEIC scores of Japanese university students. TESL-EJ, 3(4), 1–22.
Sato, T. (2019). An investigation of factors involved in Japanese students’ English learning behavior during test preparation. Papers in Language Testing and Assessment8(1), 69–95.
Shackleton, C. (2020). Planning for positive washback: The case of a listening proficiency test. In Perspectives on Language Assessment Literacy (pp. 220-240). Routledge.
Shirzadi, D. & Amerian, M. (2020). Washback effects of multiple-choice, cloze and metalinguistic tests on EFL students writing. Indonesian Journal of Applied Linguistics9(3), 536-–544.
Shohamy E, Donitsa-Schmidt S. & Ferman, I. (1996). Test impact revisited: washback effect over time. Language Testing, 13, 298–317.
Taylor, L. (2005). Washback and impact. ELT Journal, 59(2), 154-155.
Trinity College London (2015). Integrated Skills in English (ISE) Guide for Teachers—ISE II (B2).
Tsagari, D., & Cheng, L. (2017). Washback, impact, and consequences revisited. In E. Shohamy, I.G. Or, & S. May (Eds.), Language testing and assessment (pp. 359–372). Springer International Publishing AG.
Umashankar, S. (2017). Washback effects of speaking assessment of teaching English in Sri Lankan schools [Unpublished doctoral dissertation]. The University of Bedfordshire.
Wall D (1996). Introducing new tests into traditional systems: Insights from general education and innovation theory. Language Testing, 13, 231–354.
Wall, D. (2005). The impact of high-stakes examinations on classroom teaching. Cambridge University Press.
Wall, D., & Alderson, J. C. (1993). Examining washback: The Sri Lankan impact study. Language Testing, 10(1), 41-69.
Watanabe, Y. (2003). Methodology in washback studies. In L. Cheng, Y. Watanabe, & A. Curtis (Eds.), Washback in Language Testing: Research Contexts and Methods (pp.16–36). Mahwah, New Jersey: Lawrence Erlbaum.
Zhan, Y., & Andrews, S. (2014). Washback effects from a high-stakes examination on out-of-class English learning: Insights from possible self-theories. Assessment in Education: Principles, Policy & Practice21(1), 71–89.