Evaluating the impact of technological tools on the academic performance of English language learners at tertiary level: A pilot investigation





Declarative-accelerated blended learning, English language learners, online learning platforms, tertiary level, Transparent Language Online


The current investigation aimed to explore how and to what extent technology tools and web-delivered language learning platforms impact the academic performance of English language learners (ELLs) at the tertiary level. The study used a quantitative experimental research method employing a single-group pre-test and post-test design. A total of N=525 undergraduate computer science students partook in this research. The participants enrolled in their first semester at the Faculty of Information Technology in a private sector university in Lahore, Pakistan, were selected using a simple random sampling technique. The data were gathered in two phases: a pre-test was administered in the first week, and a post-test was conducted in the sixteenth week. The Reading Comprehension and Use of English assessments adapted from ETS TOEIC – a credible instrument in terms of validity and reliability – were used for this purpose. The investigators applied frequency analysis in the form of percentages to get various descriptive statistics. They utilised Spearman’s rank-ordered correlation and Kruskal-Wallis H tests to verify the findings of the descriptive statistics, address the research question and respond to the statistical hypotheses. Despite diverse linguistic and technological barriers, the results revealed a positive impact of technology tools on ELLs’ academic performance. The study proposed that taking undergraduates from other disciplines and exploring other variables affecting ELLs’ performance and confidence need further consideration. 


Download data is not yet available.

Author Biographies

Muhammad Asif , International Islamic University, Islamabad

Muhammad Asif received his M.Phil. in English, Master of Education, Master of Arts in Pashto and Cambridge CELTA. He is a PhD Candidate at the Department of English, International Islamic University Islamabad, Pakistan. He has served at reputed national and international universities in Pakistan, Afghanistan and the United States. His research interests include learning technologies, quantitative research methods, second language acquisition and web-delivered language learning platforms.

Muhammad Sheeraz, International Islamic University, Islamabad, Pakistan

Muhammad Sheeraz received his PhD from the International Islamic University (IIU), Islamabad, in 2014. He has taught at the University of Colorado at Boulder in the USA, the QAU, Islamabad, the Air University, and the IIU. From January to June 2016, he was a postdoctoral researcher at the University of North Carolina in Wilmington. He is the co-editor of two academic journals, Me’yar and Journal of Contemporary Poetics. His publications include his Urdu novel, Sasa, and three books of literary and academic translation.

Steven Sacco, San Diego State University, California, United States

Steven J. Sacco is Professor Emeritus of French & Italian from San Diego State University. At SDSU, he directed the Center for International Business Education & Research (CIBER) and the nationally ranked International Business Program.  His research combines language acquisition and international business in a unique combination to study workplace language use and the impact of languages on multinational corporations.  


Baran, E., & Correia, A. P. (2014). A professional development framework for online teaching. TechTrends, 58(5), 95–101.

Baran, E., Canbazoglu Bilici, S., Albayrak Sari, A., & Tondeur, J. (2019). Investigating the impact of teacher education strategies on preservice teachers’ TPACK. British Journal of Educational Technology, 50(1), 357–370. https://doi.org/10.1111/bjet.12565

Bonk, C. J., & Graham, C. R. (2006). The handbook of blended learning: Global perspectives, local designs. John Wiley & Sons.

Bonk, C. J., & Wiley, D. A. (2020). Preface: Reflections on the waves of emerging learning technologies. Educational Technology Research and Development, 68(4), 1595–1612. https://doi.org/10.1007/s11423-020-09809-x

Bonner, E., & Reinders, H. (2018). Augmented and virtual reality in the language classroom: Practical ideas. Teaching English with Technology, 18(3), 33–53.

Chaiklin, S., Navarro, K., & Pedraza, P. (1990). The horse before the cart: A theory-based approach to using computers in education. Theory Into Practice, 29(4), 270–275. https://doi.org/10.1080/00405849009543465

Cope, B., & Kalantzis, M. (2009). Ubiquitous learning. University of Illinois Press.

Corder, G. W., & Foreman, D. I. (2009). Non-parametric statistics for non-statisticians: A step-by-step approach. Wiley Publishing, Inc.

Dabbagh, N. (2007). The online learner: Characteristics and pedagogical implications. Contemporary Issues in Technology and Teacher Education, 7(3), 217–226.

DeMillo, R. A. (2019). Blended learning in practice: A guide for practitioners and researchers. In Bearbeitet von (pp. XVII–XX).

Dörnyei, Z. (2009). Individual differences: Interplay of learner characteristics and learning environment. Language Learning, 59, 230–248.

Dörnyei, Z. (2017). Conceptualizing learner characteristics in a complex, dynamic world. Complexity Theory and Language Development: In Celebration of Diane Larsen-Freeman, 79–96.

Dziuban, C., Graham, C. R., Moskal, P. D., Norberg, A., & Sicilia, N. (2018). Blended learning: the new normal and emerging technologies. International Journal of Educational Technology in Higher Education, 15(1), 1–16. https://doi.org/10.1186/s41239-017-0087-5

Ellis, R. (2008). Learner beliefs and language learning. Asian EFL Journal, 10(4), 7–25.

Field, A., Miles, J., & Field, Z. (2012). Discovering statistics using R. SAGE Publications Ltd, London.

Gacs, A., Goertler, S., & Spasova, S. (2020). Planned online language education versus crisis‐prompted online language teaching: Lessons for the future. Foreign Language Annals, 53(2), 380-392.

Garrison, D. R., & Kanuka, H. (2004). Blended learning: Uncovering its transformative potential in higher education. Internet and Higher Education, 7(2), 95–105. https://doi.org/10.1016/j.iheduc.2004.02.001

Garrison, D. R., & Vaughan, N. D. (2008). Blended learning in higher education: Framework, principles, and guidelines. John Wiley & Sons.

Godwin-Jones, R. (2017). Emerging technologies: Smartphones and language learning. Language Learning & Technology, 21(2), 3–17.

Golonka, E. M., Bowles, A. R., Frank, V. M., Richardson, D. L., & Freynik, S. (2014). Technologies for foreign language learning: A review of technology types and their effectiveness. Computer Assisted Language Learning, 27(1), 70–105. https://doi.org/10.1080/09588221.2012.700315

Graham, C. R., & Bonk, C. J. (2004). Handbook of blended learning: Blended learning systems: Definition, Current Trends, and Future Directions. San Francisco, CA: Pfeiffer Publishing.

Habibi, A., Razak, R. A., Yusop, F. D., & Mukminin, A. (2019). Preparing future EFL teachers for effective technology integration: What do teacher educators say? Asian EFL Journal, 21(2), 9–30.

Horn, M. B., & Staker, H. (2015). Blended: Using disruptive innovation to improve schools. John Wiley & Sons.

Horwitz, E. K. (2010). Foreign and second language anxiety. Language Teaching, 43(2), 154.

Huma Quraishi, N., Asif, M., Sheeraz, M., & Amer, K. (2020). Novel coronavirus (COVID-19) and its impact on education at tertiary level: Challenges and solutions for Pakistani universities. Journal of Education & Social Sciences, 8(2), 40–54. https://doi.org/10.20547/jess0822008204

Jamil, M. (2012). Perceptions of university students regarding computer assisted assessment. Turkish Online Journal of Educational Technology, 11(3), 267–277.

Johnson, C., & Wiechers, E. (2003). Intra-psychic effects of a group intervention programme on adolescents of divorce. South African Journal of Education, 22(3), 177–183.

Jordan, K. (2014). Initial trends in enrolment and completion of massive open online courses. International Review of Research in Open and Distributed Learning, 15(1), 133–160.

Kessler, G. (2018). Technology and the future of language teaching. Foreign Language Annals, 51(1), 205–218. https://doi.org/10.1111/flan.12318

Ketenci, T., Calandra, B., Margulieux, L., & Cohen, J. (2019). The relationship between learner characteristics and student outcomes in a middle school computing course: An exploratory analysis using structural equation modeling. Journal of Research on Technology in Education, 51(1), 63–76.

Ko, M. H. (2017). Learner perspectives regarding device type in technology-assisted language learning. Computer Assisted Language Learning, 30(8), 844–863. https://doi.org/10.1080/09588221.2017.1367310

Koehler, M. J., Mishra, P., & Cain, W. (2013). What is technological pedagogical content knowledge (TPACK)? Journal of Education, 193(3), 13–19. https://doi.org/10.1177/002205741319300303

Lai, C., Zhu, W., & Gong, G. (2015). Understanding the quality of out‐of‐class English learning. TESOL Quarterly, 49(2), 278–308.

Larson-Hall, J. (2015). A guide to doing statistics in second language research using SPSS and R. Routledge.

Laurillard, D. (2013). Rethinking university teaching: A conversational framework for the effective use of learning technologies. Routledge.

Levy, M. (2009). Technologies in use for second language learning. The Modern Language Journal, 93(769–782).

Lin, J. J., & Lin, H. (2019). Mobile-assisted ESL/EFL vocabulary learning: a systematic review and meta-analysis. Computer Assisted Language Learning, 32(8), 878–919. https://doi.org/10.1080/09588221.2018.1541359

Loewen, S., Crowther, D., Isbell, D. R., Kim, K. M., Maloney, J., Miller, Z. F., & Rawal, H. (2019). Mobile-assisted language learning: A Duolingo case study. ReCALL, 31(3), 293-311. https://doi.org/10.1017/S0958344019000065

Loewen, S., Isbell, D. R., & Sporn, Z. (2020). The effectiveness of app-based language instruction for developing receptive linguistic knowledge and oral communicative ability. Foreign Language Annals, 53(2), 209–233. https://doi.org/10.1111/flan.12454

Loewen, S., & Plonsky, L. (2015). An A–Z of applied linguistics research methods. Macmillan International Higher Education. https://doi.org/10.1007/978-1-137-40322-3_1

Lupton, D., Mewburn, I., & Thomson, P. (2018). The digital academic: Critical perspectives on digital technologies in higher education. Routledge.

Madden, A. G., Margulieux, L., Kadel, R. S., & Goel, A. K. (2019). Blended learning in practice: a guide for practitioners and researchers. Massachusetts: The MIT Press Cambridge.

McCarthy, M. (2016). The Cambridge guide to blended learning for language teaching. Cambridge, MA: Cambridge University Press.

Means, B., Toyama, Y., Murphy, R., & Baki, M. (2013). The effectiveness of online and blended learning: A meta-analysis of the empirical literature. Teachers College Record, 115(3), 1–47.

Mishra, P., & Koehler, M. J. (2006). Technological pedagogical content knowledge: A framework for teacher knowledge. Teachers College Record, 108(6), 1017–1054.

Ng, W. (2015). New digital technology in education. Springer International Publishing. https://doi.org/10.1007/s10758-015-9267-3

Norberg, A., Dziuban, C. D., & Moskal, P. D. (2011). A time-based blended learning model. On the Horizon, 19(3), 207–216. https://doi.org/10.1108/10748121111163913

O’Byrne, W. I., & Pytash, K. E. (2015). Hybrid and blended learning: Modifying pedagogy across path, pace, time, and place. Journal of Adolescent and Adult Literacy, 59(2), 137–140. https://doi.org/10.1002/jaal.463

Olapiriyakul, K., & Scher, J. M. (2006). A guide to establishing hybrid learning courses: Employing information technology to create a new learning experience, and a case study. Internet and Higher Education, 9(4), 287–301. https://doi.org/10.1016/j.iheduc.2006.08.001

Oliver, M., & Trigwell, K. (2005). Can ‘blended learning’ be redeemed ? E-Learning, 2(1), 17–26.

Ortega, L. (2017). New CALL-SLA research interfaces for the 21st century: Towards equitable multilingualism. CALICO Journal, 34(3), 285–316. https://doi.org/10.1558/cj.33855

Parmaxi, A. (2020). Virtual reality in language learning: a systematic review and implications for research and practice. Interactive Learning Environments, 1–13. https://doi.org/10.1080/10494820.2020.1765392

Plonsky, L. (2015). Advancing quantitative methods in second language research. Routledge.

Rogers, D. L. (2000). A paradigm shift: Technology integration for higher education in the new millennium. AACE Review (Formerly AACE Journal), 1(13), 19–33.

Rosenberg, J. M., & Koehler, M. J. (2015). Context and technological pedagogical content knowledge (TPACK): A systematic review. Journal of Research on Technology in Education, 47(3), 186–210. https://doi.org/10.1080/15391523.2015.1052663

Selwyn, N. (2013). Education in a digital world: Global perspectives on technology and education. Routledge.

Slabakova, R. (2016). Second language acquisition. Oxford University Press.

Steel, C. H., & Levy, M. (2013). Language students and their technologies: Charting the evolution 2006–2011. ReCALL, 25(3), 306–320. https://doi.org/10.1017/S0958344013000128

Stein, J., & Graham, C. R. (2020). Essentials for blended learning: A standards-based guide. Routledge. https://doi.org/10.4324/9781351043991

Ullman, M. T. (2001). The neural basis of lexicon and grammar in first and second language: The declaratice/procedural model Bilingualism: Language and Cognition, 4(2), 105–122. https://doi.org/10.1017/s1366728901000220

Uz, R., & Uzun, A. (2018). The influence of blended learning environment on self-regulated and self-directed learning skills of learners. European Journal of Educational Research, 7(4), 877-886. https://doi.org/10.12973/eu-jer.7.4.877

Vesselinov, R., Grego, J., Sacco, S. J., & Tasseva-Kurktchieva, M. (2019). The 2019 Rosetta Stone efficacy study Final report research team. http://comparelanguageapps.com/documentation/The2019_RS_FinalReport.pdf

Wang, Y., & Baker, R. (2015). Content or platform: Why do students complete MOOCs. MERLOT Journal of Online Learning and Teaching, 11(1), 17–30.

Warschauer, M. (2003). Technology and social inclusion: Rethinking the digital divide. The MIT Press.

Watson, J. (2008). Blended learning: The convergence of online and face-to-face education. In North American Council for Online Learning.

Weller, M. (2011). The digital scholar: How technology is transforming scholarly practice. 36 Soho Square, London, UK: Bloomsbury Academic.

Yang, Y. F., & Kuo, N. C. (2020). New teaching strategies from student teachers’ pedagogical conceptual change in CALL. System, 90(123), 102218. https://doi.org/10.1016/j.system.2020.102218

Yasuda, S. (2014). Issues in teaching and learning EFL writing in East Asian contexts: The case of Japan. Asian EFL Journal, 16(4), 150-187.

You, C. J., & Dörnyei, Z. (2016). Language learning motivation in China: Results of a large-scale stratified survey. Applied Linguistics, 37(4), 495–519.

Zar, J. H. (2014). Spearman rank correlation: Overview. Encyclopedia of Biostatistics, 1–9. https://doi.org/10.1002/9781118445112.stat05964




How to Cite

Asif, M., Sheeraz, M. ., & J. Sacco, S. (2022). Evaluating the impact of technological tools on the academic performance of English language learners at tertiary level: A pilot investigation. Pegem Journal of Education and Instruction, 12(1), 272–282. https://doi.org/10.47750/pegegog.12.01.28