Content Validity by Experts Judgment Thermal and Transport Concept Inventory (TTCI) Assessment Integrated STEM to Measure Student’s Problem-Solving Skills
DOI:
https://doi.org/10.47750/pegegog.14.02.36Keywords:
Content Validation, Assessment, Concept Inventory, STEM, Problem SolvingAbstract
The study aimed to analyze the content validation of the STEM-integrated thermal and transport concept inventory instrument used to measure the problem-solving abilities of high school students. The instrument questions developed amounted to nine description questions. This type of study is development research. The steps in this research are to define design, developed, and dissemination. However, in this study, it was limited to the design stage (expert validation). Furthermore, the instrument was assessed qualitatively and quantitatively by a validator consisting of three experts and five users. Assessment aspects include material, language, and construction. The qualitative data collected was analyzed qualitatively, and the quantitative data were analyzed using the Content Validity Ratio (CVR). The results showed that nine items had a CVR value exceeding 0.75, which meant that all items had valid criteria for content validity. The CVR value obtained is between 0.88 and 0.96, which means that the instrument has high criterion validity.
Downloads
References
Adeleke dan Joshua. (2015). Development and Validation of Scientific Literacy Achievement Test to Assess Senior Secondary School Students’ Literacy Acquisition in Physics. Journal of Education and Practice. 7(6): 28-42.
Azizah,D.N., Sutopo., Zulaikah,S. (2018). Students' Problem-Solving Ability through Conceptual Problem-Solving Approach on Thermodynamics Material. Journal of Education: Theory, Research, and Development. Vol.3 No.11. 1458-1462. http://journal.um.ac.id/index.php/jptpp/
Bashoori, Khoirul dan Supahar. (2018). Validity and Reliability of STEM-Based Science Literacy Performance Assessment Instruments. Journal of Educational Research and Evaluation. 22 (2). 222.
Basin, K., Mądrala, M., Wąsik, M., & Małoszewski, P. (2017). Interpretation of environmental tracer data for conceptual understanding of groundwater flow: an application for fractured aquifer systems in the Kłodzko Basin, Sudetes, Poland. Isotopes in Environmental and Health Studies. 2(1), 1–19. https://doi.org/10.1080/10256016.2017.1330268
Batlolona, J. R., Baskar, C., Kurnaz, M. A., & Leasa, M. (2018). The Improvement of Problem-Solving Skills and Physics Concept Mastery on Temperature And Heat Topic. Jurnal Pendidikan IPA Indonesia, 7(3), 273–279. https://doi.org/10.15294/jpii.v7i3.12432
Budiyono. (2015). Pengantar Penilaian Hasl Belajar. Surakarta: UNS Press.
Burkholder, E., Walsh, C., & Holmes, N. G. (2020). Examination of Quantitative Methods for Analyzing Data from Concept Inventories. Physical Review Physics Education Research, 16(1), 10141. https://doi.org/10.1103/PhysRevPhysEducRes.16.010141
Capriconia J, Mufit Fatni. (2022). Analysis of Concept Understanding and Students' Attitudes towards Learning Physics in Material of Straight Motion. Journal of Research in Science Education. Volume 8, Issue 3, 1453-1461. http://jppipa.unram.ac.id/index.php/jppipa/index. DOI: 10.29303/jppipa.v8i3.1381
Dewi, S. K., & Sudaryanto, A. (2020). Knowledge, Attitude, and Behavior Questionnaire Validity and Reliability. Proceedings of the National Seminar on Nursing, University of Muhammadiyah Surakarta, 73-79.
Dulari. (2015). Pengembangan Media Tutorial Berbantuan Komputer untuk Meningkatkan Keterampilan Pemecahan Masalah Fisika Siswa SMA Negeri 1 malang. Prosiding Pertemuan Ilmiah XXIX HFI Jateng & DIY. http://hfi-diyjateng.or.id accessed 5 Januari 2023.
Gall, M. D., Gall, J. P., & Borg, W. R. (2003). Educational research an introduction, seventh edition. Pearson Education, Inc.
Goodwin, L.D., & Leech, N.L. (2003). The Meaning of Validity in The New Standards for Educational and Psychological Testing: Implications for Measurement Courses. Measurement and Evaluation in Counseling and Development, 36, p: 181-191
Hamid. (2017). Meningkatkan Kemampuan Guru dalam Menyusun Instrument Penilaian Bentuk Tes Tertulis Melalui Bimbingan Berbasis Lembar Kerja di SMP Negeri 7 Banjarmasin. Jurnal Ilmiah Kependidikan, 12, 1–12.
Husin. (2020). Peningkatan Kemampuan Guru Menyusun Instrumen Penilaian Melalui Workshop Berkala Di SMP Negeri 2 Belitang. Jurnal Ilmiah Pro Guru, 6(4), 461–471.
Jati, R. P., & Aprilia, N. (2019). Evaluasi proses penyusunan instrumen penilaian kognitif. Prosiding Symbion (Symposium on Biology Education), Prodi Pendidikan Biologi, FKIP, Universitas Ahmad Dahlan.
Jua, S. K., Sarwanto, dan Sukarmin. (2018). The profile of students’ problem-solving skills in physics across interest programs in secondary school. Journal of Physics: Conference Series 1022(1).
Kaleka, M. U. (2016). Evaluasi kemampuan guru fisika SMA dalam menyusun instrumen penilaian hasil belajar. Jurnal Pendidikan Matematika Dan Sains, 4(1), 12–19. http://journal.uny.ac.id/index.php/jpms
Kurniawan, B. R., Reyza, M., & Taqwa, A. (2018). Pengembangan Instrumen Tes Kemampuan Pemecahan Masalah Fisika pada Materi Listrik Dinamis. Jurnal Pendidikan: Teori, Penelitian, Dan Pengembangan, 3(11), 1451–1457.
Kurniawati, E., Hartanto, & Zamzaili. (2017). The effect of assurance, relevance, interest, assessment, satisfaction (ARIAS) integrative and early ability model in improving the understanding of the mathematical concept and troubleshooting the first middle school students in Kepahiang. Jurnal Pendidikan Matematika Raflesia, 2(2), 174–187
Laverty, J. T., & Caballero, M. D. (2018). Analysis of the Most Common Concept Inventories in Physics : What are We Assessing ? Physical Review Physics Education Research, 14(1), 10123. https://doi.org/10.1103/PhysRevPhysEducRes.14.010123
Lawshe, C. H. (1975). a Quantitative Approach To Content Validity. Personnel Psychology, 28(4), 563– 575. https://doi.org/10.1111/j.1744- 6570.1975.tb01393.x
Lee, M.-H, Chai, C.S., Hong, H,-Y., (2019). STEM Education in the Asia Pacific: challenges and development. Asia-Pacif. Educ. Res. 28 (1), 1-4
Le, L.T.B., Tran, T.T., Tran, N, H., (2021). Challenges to STEM education in Vietnamese high school contexts. Heliyon. https://doi.org/10.1016/j.heliyon.2021.e08649
Linawati, L., Haratua T.M.S., & Hamdani. (2018). Deskripsi Miskonsepsi Siswa Pada Materi Gerak Lurus Di Sma Negeri 1 Sungai Raya. Artikel Penelitian Fisika FKIP Untan Pontianak, pp. 1-10. http://dx.doi.org/10.26418/jppk.v7i11.29878
Lynn, M. (1986) Determination and Quantification of Content Validity Index. Nursing Research, 35, 382-386. https://doi.org/10.1097/00006199-198611000-00017
Madsen, A., Mckagan, S. B., & Sayre, E. C. (2017). Best Practices for Administering Concept Inventories. The Physics Teacher, 55, 1–8. https://doi.org/https://doi.org/10.1119/1.5011826
Mahirah. (2017). Evaluasi Belajar Peserta Didik. Jurnal Idarah.Vol 1, No 2, Hal: 258.
Margot, K.C., Kettler, T., & Margot, K.C. (2019). Teachers ’ perception of STEM integration and education: A systematic literature review. International Journal of STEM Education, 6, 1– 16.
Meiliani, M., Tanti, T., & Sulman, F. (2021). Student Resources On Newton’s Lawa Concepts Reviewing From Gender: Identification Using Open-Ended Question. Indonesia Journal of Science and Mathematics Education, 324–332. https://doi.org/10.24042/ijsme.v4i3.10177
Munadi. (2018) Prosiding Seminar Nasional Matematika dan Pendidikan Matematika: Integrasi Budaya, Psikologi, dan Teknologi dalam Membangun Pendidikan Karakter Melalui Matematika dan Pembelajarannya pp 559-571
Puspitasari, R., Mufi, F., & Asrizal. (2021). Conditions of learning physics and students’understanding of the concept of motion during the covid-19 pandemic. Journal of Physics: Conference Series. https://doi.org/10.1088/1742- 6596/1876/1/012045
Rozal, E., Ananda, R., Zb, A., Fauziddin, M., & Sulman, F. (2021). The Effect of Project-Based Learning through YouTube Presentations on English Learning Outcomes in Physics. AL-ISHLAH: Jurnal Pendidikan, 13(3), 1924–1933. https://doi.org/10.35445/alishlah.v13i3.1241
Ryu, M., Mentzer, N., Knobloch, N., (2019). Preservice teachers’ experiences of STEM integration: challenges and implications for integrated STEM teacher preparation. International Journal Technology.Des. Educ. 29 (3), 493-512.
Sihole, Marlon. (2015). Penerapan Model Pembelajaran Kontruktivisme Untuk Meningkatkan Kemampuan Mengidentifikasi Karakteristik Inti Atom Dan Radioaktivitas Pada Pelajaran Fisika Inti Di Kelas XII IPA 3 SMA Negeri 12 Medan T.A 2013/2014. Jurnal Inpafi, Vol. 3, No. 2
Sinaga, N. A. (2016). Pengembangan tes kemampuan pemecahan masalah dan penalaran matematika siswa SMP kelas VIII. PYTHAGORAS: Jurnal Pendidikan Matematika, 11(2), 169.
Subali. (2016) Pengembangan Tes beserta Penyelidikan Validitas dan Reliabilitas secara Empiris. Yogyakarta: UNY Press.
Sukarmin., Arifin,Z., Sarwanto., Sani D, M. (2021). The Development of Concept Inventory Assessment Integrated with STEM Literacy to Measure Students’ Creative Thinking Skills: A Need Analysis. Journal of Hunan University. Vol.48 No.10
Sukenti,D., Tambak S., Charlina. (2020). Developing Indonesian Language Learning Assessment: Strengthening the personal competence and Islamic psychosoaical of teachers. International Journal of Evaluation and research In education. Vol.9 No.4. 1079-1087. DOI: 10.11591/ijere.v9i4.20677
Sulman, F., Sutopo, S., & Kusairi, S. (2021). FMCE-PHQ-9 Assessment with Rasch Model in Detecting Concept Understanding , Cheating , and Depression amid the Covid-19 Pandemic. Tadris: Jurnal Keguruan Dan Ilmu Tarbiyah, 6(2), 297–309. https://doi.org/10.24042/tadris.v6i2.9273
Sulman, F., Taqwa, M. R. A., Aminah Zb, A. Z., Rafzan, R., & Fikri, A. (2020). The Effect of Mathematical Connections on the Mastery of Probability Material. Edumatika : Jurnal Riset Pendidikan Matematika, 3(2), 147–157. https://doi.org/10.32939/ejrpm.v3i2.645
Sutama, Sandy Ary Gilang, Fuadi Djalal. (2017). Pengelolaan penilaian autentik kurikulum 2013 mata pelajaran matematika di SMA. Jurnal Manajemen Pendidikan. Volume 12 No.1. 105-114
Thiagarajan, S. S. D. S., & Semmel, M. I. (1974). Instructional Development for Training Teachers of Exceptional Children. Leadership Training Institute/ Special.
Tong, D. H., Loc, N. P., Uyen, B. P., & Truc, C. Le. (2020). A case study of developing students’ problem solving skills through addressing real-world problems related to fractions in primary schools. International Journal of Scientific and Technology Research, 9(2), 2809–2818.
Yuniarti Herni S, Ali Muhammad R, S Ferli Irwansyah. (2018). Verification concept of Assessment for Physics Education Student Learning Ourcame, International Journal of Engineering & Technology. 7 (3.21) 321-332. http://digilib.uinsgd.ac.id/id/eprint/12830
Zb, A., Novalian, D., Ananda, R., Habibi, M., & Sulman, F. (2021). DISTANCE LEARNING WITH STEAM APPROACHES: Is Effect On The Cognitive Domain? 6(2), 129–140.
Zb, A., Setiawan, M. E., & Sulman, F. (2020). Pengaruh E-Learning Berbasis Schoology Berbantuan WhatsApp Group terhadap Hasil Belajar Ditengah Pandemi Covid-19. Al-Khidmah, 3(2), 55–60. https://doi.org/10.29406/al-khidmah.v3i2.2282
Zhang, Y., & Zhang, Z. (2018). ‘Kexue Wenhua’ in Chinese and ‘Scientific Culture’, ‘Science Culture’, ‘Culture of Science’ and ‘Science as Culture’ in English: The Meanings and the Structure. Cultures of Science, 1(1), 25–37.
Zheng, J., Huang, L., Li, S., Lajoie, S. P., Chen, Y., & Hmelo-Silver, C. E. (2021). Selfregulation and emotion matter: A case study of instructor interactions with a learning analytics dashboard. Computers and Education, 161, 104061. https://doi.org/10.1016/j.compedu.2020.104061
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Pegem Journal of Education and Instruction
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial — You may not use the material for commercial purposes.
No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
