On the Predictive Validity (Generalizability) of IELTS Academic Tests

Authors

1 Department of Humanities, College of English language, Ahvaz Azad University Branch, Islamic Azad University, Ahvaz, Iran

2 Farhangian Teacher Education University, Iran

Abstract

Predictive validity of high-stake tests has attracted the attention of applied linguists since a couple of decades ago. Despite the existence of a plethora of studies on reliability and validity issues of high stake tests, it seems that predictive validity of International English Language Testing System (IELTS), as a high stake test should be measured appropriately. This study set out to investigate the predictive validity of IELTS academic tests practiced in Iran. The participants included 70Iranian IELTS test takers who took IELTS academic test in 2014 to 2015. To carry out the study, Construct and Validation Self-Assessment Inventory for Learners of English for Academic Purposes was used to collect data. The questionnaire included 48items on a five-point Likert scale. Coronbach's alpha coefficient of this questionnaire indicated the reliability of the instrument. The test-takers' scores on the four skills of academic IELTS were also used as another portion of data in this study. The collected data were subjected to a series of statistical analyses in relation to the proposed questions in this study. The data were analyzed using Regression and Analysis of Variance. The results of the study revealed that IELTS four modules significantly predict the test takers' performance in academic settings. The findings can be used by IELTS centers to make a change in test format, rubrics, as well as uses.

Keywords

References

Abbiati, M., Severac, M., Baroffio, A.,& Pelaccia, T.(2019).Construct and predictive validity of thestrength of motivation for medical school-revised (SMMS-R) questionnaire: A French validation study. Canadian Medical Education Journal, 10(3), 32-48.
Akbari, R.,& Abedni, A. (2010). Second language teachers' sense of self-efficacy: A construct validation. Journal of Teaching English Language,4(1),69-101.
Alderson, J. C. (2005).Diagnosing foreign language proficiency. London: Continuum.
Alderson, J. C., Clapham, C., & Wall, D. (1995). Language test construction and evaluation. Cambridge: Cambridge University Press.
Alibakhshi, G. (2013). Construction and validation self-assessment inventory for learners of English for academic purposes. Journal of Research in Applied Linguistics,4(2), 93-106.
Bachman, L. F. (1990). Fundamental considerations in language. Oxford: Oxford University Press.
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Oxford: Oxford University Press.
Chapelle, C. A. (2012). Conceptions of validity. In G. Fulcher & F. Davidson. (Eds.). The Routledge handbook of language testing (pp.21-33). Oxon: Routledge.
Cotton, F., & Conrow, F. (1998). An investigation of the predictive validity of IELTS amongst a group of international students studying at the University of Tasmania. IELTS Research Reports, 1, 72-115.
Council of Europe. (2001). Common European framework of reference for languages: Learning teaching, assessment. Cambridge: Cambridge University Press.
Douglas, D. (1997). Language for specific purposes testing. Language testing and assessment, 7, 111-119.
Douglas, D. (2001). Language for specific purposes assessment criteria: Where do they come from? Language Testing, 18(2), 171-85.
Elder, C. (1993). Language proficiency as a predictor of performance in teacher education. Melbourne Papers in Language Testing, 2(1), 68-89.
Gagen, T. (2019). The predictive validity of IELTS scores: A meta-analysis. The University of Western: Canada.
Gebril, A. (2006). Independent and integrated academic writing tasks: A study in generalizability and test method. The University of Loma.
Teaching English Language, Vol. 13, No. 2 317 Shakibaei & Memari
Gebril, A. (2009). Score generalizability of academic writing tasks: Does one test method fit it all? Language Testing, 26,507–531.
Hartwell, J., Johnson, D., & Posthuma, A. (2019). Are we asking the right questions? Predictive validity comparison of four structured interview question types. Journal Business Research, 100, 122-129.
Ingram, D., & Bayliss, A. (2007). IELTS as a predictor of academic language performance, part1. IELTS Research Reports, 7, 137-204.
Moore, T., & Morton, J. (1999). Authenticity in the IELTS academic module writing test: A comparative study of Task 2 items and university assignments (IELTS Research Reports no. 2.). Canberra: IELTS Australia.
Paul, A. (2007). IELTS as a predictor of academic language performance, Part 2. IELTS Research Reports, 7, 205-271.
Pearson (2010). PT E Academic score guide. Retrieved from http://pearsonpte.com/PTEAcademic/scores/Documents/PTEA_Score_Guide.pdf.
Polit, D., & Hungler, B. (1991). Nursing research: Principles and methods. New York: JB Lippincott.
Rezaei, O., Barati1, H., & Youhanaee, M. (2016). Evaluation of IELTS Preparatory Courses in Iran: Teaching practices and strategies in focus. Journal of Teaching English Language, 10(2), 47-71.
Rumsey, L. (2013). Shedding light on the predictive validity of English proficiency tests in predicting academic success (Doctoral dissertation). ETHOS.
Shuttleworth, M. (2009). Peer review process. Retrieved from http:// experiment-resources.com/peer-review-process.html.
Spolsky, B. (1995). Measured words: The development of objective language testing. Oxford: Oxford University Press.
Uysal, H. H. (2010). A critical review of the IELTS writing test. ELT Journal, 64(3), 314-320.
Vafaee, P., & Yaghmaeyan, B. (2015). Providing evidence for the generalizability of a speaking placement test scores. Iranian Journal of Language Testing 5(2), 78-95.
Zheng, Y., & De Jong, J. (2011). Research note: Establishing construct and concurrent validity of Pearson Test of English Academic (PTE Academic). Retrieved from http://pearsonpte.com/research/Pages/ResearchSummaries.aspx.
Teaching English Language
Volume 13, Issue 2
August 2019
Pages 299-317

Files

History

  • Receive Date: 01 May 2020
  • Accept Date: 01 May 2020

Share

How to cite

Statistics