How Do Large-Scale Assessments Affect Mother Tongue Lessons?
DOI:
https://doi.org/10.47750/pegegog.14.01.02Keywords:
large asessment, mother tongue education, PISA, cultural affectAbstract
The concept of large-scale assessment has long been on the concern of the education system worldwide. PISA, which is one of the large-scale international assessment, has been administered in a number of countries worldwide since 2000. When PISA was first launched, there was an "unconditional acceptance" of this new application worldwide, whereas studies conducted in recent years show that all positive and negative effects of PISA are open to discussion and these discussions are increasing in number. Taking these as a starting point, the present research aimed to determine mother tongue teachers' views on PISA tests. Aiming to reveal how the changes created by the universal effect of PISA in language education are perceived and handled by teachers, this study was carried out with the relational survey method. The obtained categorical data were analyzed by frequency analysis and logistic regression. The study group consists of 98 teachers teaching mother tongue. In this research conducted to determine mother tongue teachers' views on PISA tests, teachers stated that PISA was effective in developing higher-order thinking skills in mother tongue lessons. In addition, according to teachers' opinions, PISA affects the assessment and evaluation process the most among the learning and teaching processes. According to the other findings, teachers stated that the question types in national tests changed based on PISA and they partially approved of this change. Also, they thought that PISA reading questions were incompatible with Turkey's education system, and they found Turkey's rise in the latest PISA reading skills ranking significant.
Downloads
References
Journal Article
Altun, M., & Akkaya, R. (2014). Mathematics teachers’ comments on PISA math questions and our country’s students’ low achievement levels. Hacettepe University Journal of Education, 29(1), 19-34.
Anders, J., Has, S., Jerrim, J. et al. (2021). Is Canada really an education superpower? The impact of non-participation on results from PISA 2015. Educ Asse Eval Acc 33, 229–249 https://doi.org/10.1007/s11092-020-09329-5
Aşıcı, M., Baysal, Z. & Şahenk Erkan, S. (2014). "A Proposal for the Preparation of PISA Exam Reading Literacy Teacher Guide. Eğitim ve Öğretim Araştırmaları Dergisi, 3(4).
Avvisati, F., Le Donne, N., & Paccagnella, M. (2019). A meeting report: Cross-cultural comparability of questionnaire measures in large-scale international surveys. Measurement Instruments for the Social Sciences, 1(8), 1–10.
Bağdu Söyler, P., Aydın, B., & Atılgan, H. (2021). PISA 2015 reading test item parameters across language groups: A measurement invariance study with binary variables. Journal of Measurement and Evaluation in Education and Psychology, 12(2), 112-128.
Białecki, I., Jakubowski, M., & Wiśniewski, J. (2017). Education policy in Poland: The impact of PISA (and other international studies). European Journal of Education, 52(2), 167-174.
Bieber, T., & Martens, K. (2011). The OECD PISA study as a soft power in education? Lessons from Switzerland and the US. European Journal of Education, 46, 101-116.
Bray, M., Kobakhidze, M. N., & Suter, L. E. (2020). The challenges of measuring outside-school-time educational activities: Experiences and lessons from the Programme for International Student Assessment (PISA). Comparative Education Review, 64(1), 87–106.
Carvalho L.M., & Costa E. (2015) Seeing education with one'sown eyes and through PISA lenses: Considerations of the reception of PISA in European countries, Discourse: Studies in the Cultural Politics of Education, 36(5), 638-646.
Erden, B. (2020). Teachers' Views Related to Skill-Based Questions in Turkish, Mathematics and Science Lessons. Academia Eğitim Araştırmaları Dergisi, 5(2), 81-103.
Filiz, S. B., & Yıldırım, N. (2019). Analysis of secondary-school Turkish course curriculum objectives according to Revised Bloom Taxonomy. Ilkogretim Online, 18(4).
Hopfenbeck, T. N., Lenkeit, J., El Masri, Y., Cantrell, K., Ryan, J., & Baird, J.-A. (2018). Lessons learned from PISA: A systematic review of peer-reviewed articles on the programme for international student assessment. Scandinavian Journal of Educational Research, 62(3), 333–353. https ://doi. org/10.1080/00313 831.2016.12587 26.
Hopfenbeck,T. N., & Görgen, K. (2017). The politics of PISA: The media, policy and public responses in Norway and England. European Journal of Education, 52(2), 192–205. https://doi.org/10.1111/ejed.12219
Hubert E. (2006) Educational standards and the changing discourse on education: the reception and consequences of the PISA study in Germany. Oxford Review of Education, 32(5), 619-634.
Ioannidou, O., Georgiou, D., Obersteiner, A., Bas, N. D., & Mieslinger, C. (2017). Do prospective teachers care about PISA studies? A pilot study among university students in Germany. International Education Studies, 10(5), 26-35.
Jacqueline P. Leighton , Rebecca J. Gokiert , M. Ken Cor & Colleen Heffernan. (2010). Teacher beliefs about the cognitive diagnostic information of classroom‐ versus large‐scale tests: implications for assessment literacy. Assessment in Education: Principles, Policy & Practice, 17(1), 7-21. https://doi.org/10.1080/09695940903565362
Kankaraš, M., & Moors, G. (2014). Analysis of cross-cultural comparability of PISA 2009 scores. Journal of Cross-Cultural Psychology, 45(3), 381–399.
Lafontaine, D., & Monseur, C. (2009). Gender gap in comparative studies of reading comprehension: To what extent do the test characteristics make a difference? European Educational Research Journal, 8(1), 69–79.
Leighton J.P., Gokiert R. , Cor M. & Heffernan, C. (2010). Teacher beliefs about the cognitive diagnostic information of classroom‐ versus large‐scaletests: implications for assessment literacy. Assessment in Education: Principles, Policy & Practice, 17(1), 7-21.
Masri, Y., Baird, J., & Graesser, A. (2016). Language effects in international testing: the case of PISA 2006 science items. Assessment in Education: Principles, Policy & Practice, 23(4), 427–455.
Nic Spaull (2019) Who makes it into PISA? Understanding the impact of PISA sample eligibility using Turkey as a case study (PISA2003–PISA2012). Assessment in Education: Principles, Policy & Practice, 26(4), 397-421.
Oz, E. (2021). Comparability of teachers’ educational background items in TIMSS: A case from Turkey. Large-scale Assessments in Education, 9(1), 1-18.
Özcan, H., & Arık, S. (2018). The opinions of secondary school teachers about PISA researches: A case study. Necatibey Faculty of Education Electronic Journal of Science & Mathematics Education, 12(2).
Pizmony-Levy, O., & Bjorklund, P. (2017). International assessments of student achievement and public confidence in education: Evidence from a cross-national study. Oxford Review of Education, 44(2), 239–257. https://doi.org/10.1080/03054985.2017.1389714.
Ringarp, J., & Rothland, M. (2010). Is the grass always greener? The effect of the PISA results on education debates in Sweden and Germany. European Educational Research Journal, 9(3), 422-430.
Rutkowski, L., & Rutkowski, D. (2016). A call for a more measured approach to reporting and interpreting PISA results. Educational Researcher, 45(4), 252–257.
Sellar S. & Lingard, B. (2013). Looking East: Shanghai, PISA 2009 and the reconstitution of reference societies in the global education policy field, Comparative Education, 49(4), 464-485.
Smith, M. (1991). Put to the test: The effects of external testing on teachers. Educational Researcher, 20(5), 8-11.
Spruyt, B., Van Droogenbroeck, F., Van Den Borre, L., Emery, L., Keppens, G., & Siongers, J. (2021). Teachers’ perceived societal appreciation: PISA outcomes predict whether teachers feel valued in society. International Journal of Educational Research, 109, 101833.
Takayama, K.(2008).The politics of international league tables: PISA in Japan’s achievement crisis debate. Comparative Education, 44(4), 387-407, https://doi.org/10.1080/03050060802481413
Yildiz. D. (2021). Turkish and Turkish language and literature teachers’ views’ on the reading skills and Turkey's performance in PISA: A focus group interview. Journal of Qualitative Research in Education, 27, 208-231.
Zhao, Y. (2020). “Two Decades of Havoc: A Synthesis of Criticism against PISA.” Journal of Educational Change, 21(2), 245–266.
Book
Breakspear, S. (2012). The Policy Impact of PISA: An Exploration of the Normative Effects of International Benchmarking in School System Performance. OECD Education Working Papers, No. 71. OECD Publishing (NJ1).
Creswell, J. W., & Creswell, J. D. (2017). Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications.
Dolton, P., Marcenaro, O., De Vries, R., & She, P. W. (2018). Global teacher status index 2018. London: Varkey Foundation.
Fraenkel, J. R., & Wallen, N. E. (2006). How to design and evaluate research in education (6th ed.). New York, NY: McGraw-Hill.
Hopkins, D., Pennock, D., Ritzen, J., Ahtaridou, E., & Zimmer, K. (2008). External Evaluation of the Policy Impact of PISA.
Mohamed, D. S. M. P. H., Sahminan, S. H., Len, G. A., & Shahrill, M. (2019). Teachers’ awareness, understanding and challenges regarding the PISA implementation. In AIP Conference Proceedings (Vol. 2194, No. 1, p. 020066). AIP Publishing LLC.
Piro, J. M. (2019). The primacy of PISA. How the world’s most important test is changing education globally. New York: Lexington Books.
Piro, J. M. (2019). The primacy of PISA: How the world’s most important test is changing education globally. Rowman & Littlefield.
Stiggins, R.J. 1991. Assessment literacy. Phi Delta Kappan.
Books with Multiple Editors and Chapters
Gruber, K.-H. (2006) The German ‘PISA-Shock’: some aspects of the extraordinary impact of the OECD’s PISA study on the German education system, in H. Ertl (Eds.) Cross-National Attraction in Education: accounts from England and Germany. Oxford: Symposium Books.
Masemann, V.L. (2013). Culture and Education. Arnova, R. F., Torres, C. A. & Franz, S. (Eds.). Comparative Education: The Dialectic of the Global and Local Comparative Education: The Dialectic of the Global and Local. (pp.113-133). Rowman and Littlefield Puhlishers. United Kingdom.
Tillmann KJ., Dedering K., Kneuper D., Kuhlmann C., Nessel I. (2008) PISA als bildungspolitisches Ereignis. Oder: Wie weit trägt das Konzept der „evaluationsbasierten Steuerung“?. In: Brüsemeister T., Eubel KD. (eds) Evaluation, Wissen und Nichtwissen. VS Verlag für Sozialwissenschaften. https://doi.org/10.1007/978-3-531-90818-2_6
Master’s Thesis
Hyökki, R. (2018). International Solutions to National Problems: German teachers’ perceptions of the PISA 2000 study. Master Disseratation University Of Helsinki.
Doctoral Dissertation
Berger, A. (2006). High-stakes testing and its relationship to stress between rural and urban elementary school teachers. Doctoral Dissertation, Walden University.
Christian, S. C. (2010). High-stakes testing and its relationship to stress levels of secondary teachers. Doctoral Dissertation, University of Southern Mississippi. https://aquila.usm.edu/dissertations/932
Sources from Web sites
PISA 2022 Turkey Report. http://pisa.meb.gov.tr
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Pegem Journal of Education and Instruction
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial — You may not use the material for commercial purposes.
No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
