Development of Higher-Order Thinking Skills test instrument on Quadratic Equation (HOTS-QE) for secondary school students
DOI:
https://doi.org/10.47750/pegegog.13.01.41Keywords:
Test instrument, Higher-Order Thinking Skills (HOTS), quadratic equations, validity, reliabilityAbstract
The Higher-Order Thinking Skill Test Instrument on Quadratic Equations (HOTS-QE) was developed to measure the level of HOTS on the topic of quadratic equations among secondary school students. The HOTS-QE instrument consists of 17 structured subjective items divided into two smaller questions according to the three levels of HOTS, namely applying, analysing, and evaluating. The development of the HOTS-QE instrument comprised seven stages, namely source analysis, theory, development, content validity, validation of the HOTS domain accuracy, language validity, and pilot study. The content validity of the instrument was evaluated by five mathematics education experts. The results showed that the item content validity index (I-CVI) value of each item was above 0.70 while the content validation per scale (S-CVI) value was 0.98. Results from the interrater evaluation also showed that the HOTS level accuracy of the instrument items had achieved the Cohen’s Kappa coefficient value of 0.63. In addition, findings from the pilot study also showed that the Cronbach’s alpha coefficient value was 0.79, the discrimination index value of each item was between 31.11% to 66.67%, and the difficulty index values were between 40.74% to 70.00%. These results suggest that the HOTS-QE instrument has an acceptable level of validity. The development of this instrument provides a more varied learning assessment that can foster students’ interests in learning, help them to improve HOTS, and provide opportunities for students to directly apply the knowledge of quadratic equations learned at school in their daily life.
Downloads
References
Abdullah, W. A. A. W., Zhaffar, N. M., & Tamuri, A. H. (2020). Aplikasi Kemahiran Berfikir Aras Tinggi (KBAT) dalam pendidikan Islam mengikut bidang: Higher Order Thinking Skills (HOTS) application in Islamic education by field. Jurnal Sains Insani, 5(1), 14-21. https://doi.org/10.33102/sainsinsani.vol5no1.123
Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom’s taxonomy. Longman Publishing.
Australian Mathematical Science Institute. (2011). The improving mathematics education in school (TIMES) project: Quadratic equations. The University of Melbourne, International Centre of Excellence for Education in Mathematics.
Bakar, Z. A. (2014). Psikologi pendidikan. Partridge Publishing.
Beyera, G. K., O’Brien, J., & Campbell, S. (2020). The development and validation of a measurement instrument to investigate determinants of health care utilisation for low back pain in Ethiopia. PloS one, 15(1), e0227801. https://doi.org/10.1371/journal.pone.0227801
Brookhart, S. M. (2010). How to Assess Higher Order Thinking Skills in Your Classroom. ASCD.
Chua, Y. P. (2006). Kaedah dan statistik penyelidikan buku 2. McGraw-Hill.
Creswell, J. W. (2007). Qualitative inquiry and research design: Choosing among five approaches. Sage Publications.
Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative. Pearson.
Curriculum Development Division. (2018). KSSM Dokumen Standard Kurikulum dan Pentaksiran Tingkatan 4 dan 5: Matematik [KSSM Form 4 and 5 Curriculum and Assessment Standard Document: Mathematics]. Ministry of Education Malaysia.
Curriculum Development Division. (2018). Elemen KBAT dalam pentaksiran [HOTS Element in Assesment]. Ministry of Education Malaysia.
Didis, M. G., & Erbas, A. K. (2015). Performance and difficulties of students in formulating and solving quadratic equations with one unknown. Educational Sciences: Theory & Practice, 15(4), 1137-1150. https://doi.org/10.12738/estp.2015.4.2743
Dubinsky, E., Czarnocha, B., Prabhu, V., & Vidakovic, D. (1999). One theoretical perspective in undergraduate mathematics education research. Proceedings of the 23rd Conference of the International Group for the Psychology of Mathematics Education, 4, 65-73.
Ebel, R. L., & Frisbie, D. A. (1986). Essentials of educational measurement. Prentice-Hall.
Examination Board. (2020). Sijil Pelajaran Malaysia format pentaksiran mulai tahun 2021 Matematik [Malaysian education certificate mathematics assessment format from 2021]. Malaysia Ministry of Education.
Fives, H., & DiDonato-Barnes, N. (2013). Classroom test construction: The power of a table of specifications. Practical Assessment, Research, and Evaluation, 18(1), 3. https://doi.org/10.7275/cztt-7109
Foody, G. M. (2020). Explaining the unsuitability of the kappa coefficient in the assessment and comparison of the accuracy of thematic maps obtained by image classification. Remote Sensing of Environment, 239, 111630. https://doi.org/10.1016/j.rse.2019.111630
Güner, P. (2017). High school students' achievement of solving quadratic equations. Bartin University Journal of Faculty of Education, 6(2), 447–467. https://doi.org/10.14686/buefad.277494
Hendel, R. J. (2018). Are we meeting pedagogic requirements?-The quadratic equation. Systemics, Cybernetics And Informatics, 16(1), 1-7.
Herawaty, D., Widada, W., Gede, W., Lusiana, D., Pusvita, Y., Widiarti, Y., & Anggoro, A. F. D. (2021). The cognitive process of students understanding quadratic equations. Journal of Physics: Conference Series, 1731(1), 012053. https://doi.org/10.1088/1742-6596/1731/1/012053
Hu, Q., Son, J. W., & Hodge, L. (2021). Algebra teachers’ interpretation and responses to student errors in solving quadratic equations. International Journal of Science and Mathematics Education, 20, 637–657. https://doi.org/10.1007/s10763-021-10166-1
Landis, J., & Kosh, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
Listiawati, E., & Juniati, D. (2021). An APOS analysis of student’s understanding of quadratic function graph. Journal of Physics: Conference Series, 1747(1), 012028. https://doi.org/10.1088/1742-6596/1747/1/012028
López, J., Robles, I., & Martínez-Planell, R. (2016). Students' understanding of quadratic equations. International Journal of Mathematical Education in Science and Technology, 47(4), 552-572. https://doi.org/10.1080/0020739X.2015.1119895
Low, K. S., & Teh, A. H. (2016). Penggunaan Outbox Inbox dalam membantu murid mengembangkan kemahiran berfikir aras tinggi. Jurnal Penyelidikan Kent, 1, 51-59.
Madaus, G. F. (2013). The courts, validity, and minimum competency testing. Springer Science & Business Media.
Malaysian Examination Board. (2013). Pentaksiran kemahiran berfikir aras tinggi [Assessment of high order thinking skills]. Malaysia Ministry of Education.
Ministry of Education Malaysia. (2018). Laporan tahunan 2017 PPPM 2013-2025 [2013-2025 Malaysia Education Blueprint Annual Report]. Ministry of Education Malaysia.
Md Zahir, Z. M., Saper, M. N., & Bistamam, M. N. (2019). Kesahan dan Kebolehpercayaan Modul Kelompok Bimbingan Integrasi REBT-Tazkiyah An-Nafs. Journal of Research, Policy & Practice of Teachers & Teacher Education, 9(1), 58-69. https://doi.org/10.37134/jrpptte.vol9.no1.6.2019
Momsen, J. L., Long, T. M., Wyse, S. A., & Ebert-May, D. (2010). Just the facts? Introductory undergraduate biology courses focus on low-level cognitive skills. CBE—Life Sciences Education, 9(4), 435-440. https://doi.org/10.1187/cbe.10-01-0001
Nasser, S. N. A. M., & Lian, L. H. (2021). Development and validation of year five geometrical measurement skills instrument. International Journal of Evaluation and Research in Education, 10(3), 956-965. https://doi.org/10.11591/ijere.v10i3.21439
Newman, I., Lim, J., & Pineda, F. (2013). Content validity using a mixed methods approach: Its application and development through the use of a table of specifications methodology. Journal of Mixed Methods Research, 7(3), 243-260. https://doi.org/10.1177/1558689813476922
Othman, M. S., & Kassim, A. Y. (2018). Kesahan dan kebolehpercayaan instrumen komposisi pengajaran guru pendidikan Islam sekolah rendah yang mengintegrasikan Kemahiran Berfikir Aras Tinggi (KBAT) menerusi pengajaran Akidah. Sains Humanika, 10(3). 1-8. https://doi.org/10.11113/sh.v10n3.1297
Ousby, J., Cross. R., & Bowman, R. (2008). Cambridge Queensland Mathematics B Year 11. Cambridge University Press.
Ping, I. L. L., & Osman, K. (2019). Laboratory-modified argument driven inquiry (lab-madi) module: content validity process. Jurnal Pendidikan IPA Indonesia, 8(1), 129-140. https://doi.org/10.15294/jpii.v8i1.16867
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489-497. https://doi.org/10.1002/nur.20147
Razali, K., Rzkiey, A. & Tegoh, M. S. (2019). Analisis Patern & Trend Matematik SPM 2019. Penerbit Exam Quality.
Richland, L. E., & Simms, N. (2015). Analogy, higher order thinking, and education. Wiley Interdisciplinary Reviews: Cognitive Science, 6(2), 177-192. https://doi.org/10.1002/wcs.1336
Sahin, M. G. (2017). Comparison of objective and subjective methods on determination of differential item functioning. Universal Journal of Educational Research, 5(9), 1435-1446. https://doi.org/10.13189/ujer.2017.050901
Setiawan, J., Sudrajat, A. A., Aman, A., & Kumalasari, D. (2021). Development of higher order thinking skill assessment instruments in learning Indonesian history. International Journal of Evaluation and Research in Education, 10(2), 545-552. https://doi.org/10.11591/ijere.v10j2.20796
Shaban, A. M. S. (2014). A comparison between objective and subjective tests. Journal of the College of Languages, 30, 44-52.
Shiel, G., Perkins, R., Close, S., & Oldham, E. (2007). PISA mathematics: A teacher's guide. Stationery Office.
Shrotryia, V. K., & Dhanda, U. (2019). Content validity of assessment instrument for employee engagement. SAGE Open, 9(1), 1-7. https://doi.org/10.1177/2158244018821751
Singh, C. K. S., & Marappan, P. (2020). A review of research on the importance of Higher Order Thinking Skills (HOTS) in teaching English language. Journal of Critical Reviews, 7(8), 740-747. https://doi.org/10.31838/jcr.07.08.161
Sulaiman, T., Muniyan, V., Madhvan, D., Hasan, R., & Rahim, S. S, A. (2017). Implementation of higher order thinking skills in teaching of science: A case study in Malaysia. International Research Journal of Education and Sciences, 1(1), 2550-2158.
Tan S. Y., & Halili, S. H. (2015). Effective teaching of Higher-Order Thinking (HOT) in education. The Online Journal of Distance Education and E-Learning, 3(2), 41–47.
Teh, A. H. (2015). Kaedah pemfaktoran ajaib ungkapan kuadratik (P.A.U.K). Jurnal Pendidikan Kent, 14, 122–131.
TES (2018). GCSE 9-1 Exam Question Practice (Quadratic Equations). The Times Educational Supplement. Retrieved 10 April, 2021, from https://www.tes.com/teaching-resource/gcse-9-1-exam-question-practice-quadratic-equations-11917730
Thomas, A., & Thorne, G. (2010). How to Increase Higher-Order Thinking. Center for Development and Learning, Metairie, Louisiana.
Thomas, D. S., & Mahmud, M. S. (2021). Analysis of students’ error in solving quadratic equations using Newman’s procedure. International Journal of Academic Research in Business and Social Sciences, 11(12), 222–237. http://dx.doi.org/10.6007/IJARBSS/v11-i12/11760
Thomson, S., Hillman, K., & De Bortoli, L. (2013). A teacher's guide to PISA mathematical literacy. Australian Council for Educational Research.
Tilden, V. P., Nelson, C. A., & May, B. A. (1990). Use of qualitative methods to enhance content validity. Nursing Research, 39(3), 172–175. https://doi.org/10.1097/00006199-199005000-00015
Utami, N. S., & Jupri, A. (2021). Students’ structure sense ability in solving quadratic equation problems. Journal of Physics: Conference Series, 1806(1), 012061. https://doi.org/10.1088/1742-6596/1806/1/012061
Vaiyavutjamai, P., Ellerton, N. F., & Clements, M. A. (2005). Students' attempts to solve two elementary quadratic equations: A study in three nations. In P. Clarkson, A. Downton, & D. Gronn (Eds.), Building connections: Theory, research and practice: Proceedings of the 28th annual conference of the Mathematics Education Research Group of Australasia (pp. 735-742). MERGA.
Wahid, N. T. A. (2019). Development of a problem-posing multimedia module and its effectiveness to enhance student performance in form four biology [Doctoral dissertation, Universiti Putra Malaysia]. Perpustakaan Sultan Abdul Ahmad, University Putra Malaysia, Malaysia.
Watt, H. (2005). Exploring adolescent motivations for pursuing maths-related careers. Australian Journal of Educational & Developmental Psychology, 5, 107-116.
Yazdanmehr, E., & Akbari, R. (2015). An Expert EFL Teacher's Class Management. Iranian Journal of Language Teaching Research, 3(2), 1-13.
Yeow P. C., Thavamani, R., Kamalah, R., Wong J. W., & Santhanasamy, V. D. (2019). Buku teks matematik tingkatan empat. Pustaka Yakin Pelajar Sdn. Bhd.
Zulnaidi, H. (2013). Pembangunan dan keberkesanan modul pengajaran geogebra ke atas pengetahuan konseptual dan prosedural matematik fungsi dan had fungsi [Doctoral Dissertation, Universiti Kebangsaan Malaysia]. Malaysian Education Research Repository. http://merr.utm.my/id/eprint/14006
Zulnaidi, H., Oktavika, E., & Hidayat, R. (2020). Effect of use of GeoGebra on achievement of high school mathematics students. Education and Information Technologies, 25(1), 51-72. https://doi.org/10.1007/s10639-019-09899-y
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Pegem Journal of Education and Instruction
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial — You may not use the material for commercial purposes.
No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
