Developing the Nature of Science (NOS) Test Using Covid-19 Theme
DOI:
https://doi.org/10.47750/pegegog.14.02.07Keywords:
NOS, Test, Covid 19, Rasch modelAbstract
This study aims to develop NOS measurement instrument for high school students in the Mathematics and Natural Sciences program using Covid19 cases that had occurred since the end of 2019. This study also attempts to validate test items with the Rasch model approach. The participants in this study are 194 high school students from the Mathematics and Natural Sciences program. Test participants consist of 132 female students and 62 male students. Their age range is 18-21 years old. NOS measurement instrument is presented in multiple choice form, which consists of 16 questions with narration or readings about Covid-19. Data analysis is conducted by dividing the validity into three types, those are content aspect validity, psychometric aspect validity, and construct validity using Rasch model. Content validity is conducted with an assessment involving three experts related to the test material and measured scientific literacy achievement. Psychometric aspects validity involves three psychometricians associated with the construction of the test. Meanwhile, for construct validity, which refers to the concept of construct validity of Messick. The results shows that there are 8 of 16 items in the NOS measurement that occupies all aspects of validity. Regarding to content of construct validity, there are two items do not appropriate with the model, while with substantive validity 94.4% of the test are consistent with the used Rasch model. Regarding to external aspect of construct validity shows that the test instrument can differentiate test participants into two categories, each of which has high and low NOS abilities.
Downloads
References
Abd-El-Khalick, F. (2013). Teaching with and about nature of science, and science teacher knowledge domains. Science & Education, 22(9), 2087-2107.350.
Akerson, V. L., Pongsanon, K., Rogers, M. A. P., Carter, I., & Galindo, E. (2017). Exploring the use of lesson study to develop elementary preservice teachers’ pedagogical content knowledge for teaching nature of science. International Journal of Science and Mathematics Education, 15(2), 293-312.
Ani, Y. (2013). Penilaian autentik dalam kurikulum 2013. In Seminar Nasional Implementasi Kurikulum (pp. 742-749).
Austin, E. W., Austin, B. W., Willoughby, J. F., Amram, O., & Domgaard, S. (2021). How media literacy and science media literacy predicted the adoption of protective behaviors amidst the COVID-19 PANDEMIC. Journal of Health Communication, 1-14.
Bridgman, A., Merkley, E., Loewen, P. J., Owen, T., Ruths, D., Teichmann, L., & Zhilin, O. (2020). The causes and consequences of COVID-19 misperceptions: Understanding the role of news and social media. Harvard Kennedy School Misinformation Review, 1(3).
Brunner, J. L., & Abd‐El‐Khalick, F. (2020). Improving nature of science instruction in elementary classes with modified science trade books and educative curriculum materials. Journal of Research in Science Teaching, 57(2), 154-183.
Bybee, R. W. (2012). Scientific literacy in environmental and health education. In Science| Environment| Health (pp. 49-67). Springer, Dordrecht
Čavojová, V., Šrol, J., & Ballová Mikušková, E. (2020). How scientific reasoning correlates with health-related beliefs and behaviors during the COVID-19 pandemic?. Journal of health psychology, 1359105320962266.
Cofré, H., Vergara, C., Lederman, N. G., Lederman, J. S., Santibánez, D., Jiménez, J., & Yancovic, M. (2014). Improving Chilean in-service elementary teachers’ understanding of nature of science using self-contained NOS and content-embedded mini-courses. Journal of Science Teacher Education, 25(7), 759-783.
Edgerly, H. S., Kruse, J. W., & Wilcox, J. L. (2022). Quantitatively investigating inservice elementary teachers’ nature of science views. Research in Science Education, 52(5), 1467-1480.
El Islami, R. A. Z., Sari, I. J., Sjaifuddin, S., Nurtanto, M., Ramli, M., & Siregar, A. (2019, February). An assessment of pre-service biology teachers on student worksheets based on scientific literacy. In Journal of Physics: Conference Series (Vol. 1155, No. 1, p. 012068). IOP Publishing.
Erduran, S., & Dagher, Z. R. (2014). Regaining focus in Irish junior cycle science: Potential new directions for curriculum and assessment on Nature of Science. Irish Educational Studies, 33(4), 335
Eysenbach, G. (2020). How to fight an infodemic: the four pillars of infodemic management. Journal of medical Internet research, 22(6), e21820.
Fakhriyah, F., Masfuah, S., & Mardapi, D. (2019). Developing Scientific Literacy-Based Teaching Materials to Improve Students’ Computational Thinking Skills. Jurnal Pendidikan IPA Indonesia, 8(4), 482-491.
Giancoli, D. C. (2014). PHYSICS Basic Principles with Applications. Functional Analysis (7th ed.). California: Pearson Education, Inc.
Hanifah, M., & Irambona, A. (2019). Authentic assessment: Evaluation and its application in science learning. Psychology, Evaluation, and Technology in Educational Research, 1(2), 81-94.
Hanson, S. T. (2016). The assessment of scientific reasoning skills of high school science students: A standardized assessment instrument. Illinois State University.
Hanushek, E. A., & Woessmann, L. (2016). Knowledge capital, growth, and the East Asian miracle. Science, 351(6271), 344-345
Jiang, F., & McComas, W. F. (2014). Analysis of nature of science included in recent popular writing using text mining techniques. Science & Education, 23(9), 1785-1809.
Kim, S. Y., & Hamdan Alghamdi, A. K. (2020). Saudi Arabian secondary students’ views of the nature of science within Islamic context. International Journal of Science Education, 42(13), 2266-2283.
Kim, S. Y., & Hamdan Alghamdi, A. K. (2021). Saudi Arabian secondary school students’ views of the nature of science and epistemological beliefs: gendered differences. Research in Science & Technological Education, 1-23.
Kunandar, K. (2013). Penilaian autentik (Penilaian hasil belajar peserta didik berdasarkan
Kurikulum 2013). Jakarta: Rajawali Pers.
Kwon, S., & Nam, I. (2020). Assessment of an Aesthetic Model of Science for NOS Teaching. Journal of Science Education, 44(2), 197-204.
Lederman, N. G., Lederman, J. S., & Antink, A. (2013). Nature of science and scientific inquiry as contexts for the learning of science and achievement of scientific literacy. International Journal of Education in Mathematics, Science and Technology, 1(3).
Lestari, H., & Widodo, A. (2021). Peranan Model Pembelajaran Nature of Sains Untuk Meningkatkan Pemahaman Sains Siswa Sekolah Dasar. Jurnal Cakrawala Pendas, 7(1), 1-9.
Lyu, X. (2019). Assessing in-Service Secondary Science Teachers' Views of Nature of Science and Competence in Understanding Scientific Argumentation about Socio-Scientific Issues. Columbia University.
Mair, P., Hatzinger, R., Maier, M. J., Rusch, T., & Mair, M. P. (2019). Package ‘eRm’. Version 0.14-0.
Malta, M., Vettore, M. V., da Silva, C. M. F. P., Silva, A. B., & Strathdee, S. A. (2021). Political neglect of COVID-19 and the public health consequences in Brazil: The high costs of science Denial. EClinicalMedicine, 35, 100878.
McComas, W. F., & Nouri, N. (2016). The nature of science and the next generation science standards: Analysis and critique. Journal of Science Teacher Education, 27(5), 555-576.
Miller, B. L. (2020). Science denial and COVID conspiracy theories: potential neurological mechanisms and possible responses. JAMA, 324(22), 2255-2256.
Mok, M. and Wright, B. (2004). Overview of Rasch Model Families. In Introduction to Rasch Measurement: Theory, Models and Applications (hal 1-24). Minnesota: Jam Press.
Motoki, K., Saito, T., & Takano, Y. (2021). Scientific literacy linked to attitudes toward COVID-19 vaccinations: A pre-registered study. Frontiers in Communication, 6, 145.
Moutinho, S., Torres, J., Fernandes, I., & Vasconcelos, C. (2015). Problem-based learning and nature of science: A study with science teachers. Procedia-Social and Behavioral Sciences, 191, 1871-1875.
Ratnawati, E., Rahayu, S., & Fajaroh, F. (2016). Pengaruh Learning Cycle–5E Berkonteks SSI Terhadap Pemahaman Hakikat Sains Pada Materi Larutan Penyangga Dan Hidrolisis Garam Siswa SMA. Jurnal Pendidikan Sains, 4(1), 25-35.
Rosário, R., Martins, M. R., Augusto, C., Silva, M. J., Martins, S., Duarte, A., ... & Dadaczynski, K. (2020). Associations between COVID-19-related digital health literacy and online information-seeking behavior among Portuguese university students. International journal of environmental research and public health, 17(23), 8987.
Roth, W. M., & Lee, S. (2016). Scientific literacy as collective praxis. Public understanding of Science.
Rudolph, J. L., & Horibe, S. (2016). What do we mean by science education for civic engagement?. Journal of Research in Science Teaching, 53(6), 805-820.
Rusilowati, A., Kurniawati, L., Nugroho, S. E., & Widiyatmoko, A. (2016). Developing an Instrument of Scientific Literacy Assessment on the Cycle Theme. International Journal of Environmental and Science Education, 11(12), 5718-5727.
Rutjens, B. T., van der Linden, S., & van der Lee, R. (2021). Science skepticism in times of COVID-19. Group Processes & Intergroup Relations, 24(2), 276-283.
Saefullah, A., Samanhudi, U., Nulhakim, L., Berlian, L., Rakhmawan, A., Rohimah, B., & El Islami, R. A. Z. (2017). Efforts to improve scientific literacy of students through guided inquiry learning based on local wisdom of Baduy’s society. Jurnal Penelitian dan Pembelajaran IPA, 3(2), 84-91.
Schultz, M., Young, K., Gunning, T. K., & Harvey, M. L. (2021). Defining and measuring authentic assessment: a case study in the context of tertiary science. Assessment & Evaluation in Higher Education, 1-18.
Settlage, J., & Southerland, S. (2012). Teaching science to every child: Using culture as a starting point. Routledge.
Sumintono, B., & Widhiarso, W. (2014). Aplikasi model Rasch untuk penelitian ilmu-ilmu sosial (edisi revisi). Trim Komunikata Publishing House
Sumranwanich, W., & Yuenyong, C. (2014). Graduate students’ concepts of nature of science (NOS) and attitudes toward teaching NOS. Procedia-Social and Behavioral Sciences, 116, 2443-2452.
Sumranwanich, W., Art-in, S., Maneechom, P., & Yuenyong, C. (2016). Existing Nature of Science Teaching of a Thai In-Service Biology Teacher. Chemistry: Bulgarian Journal of Science Education, 25(3), 394-405.
Temel, S., Şen, Ş., & Özcan, Ö. (2017). Validity and reliability analyses for the nature of science instrument secondary (NOSI-S). Journal of Baltic Science Education, 16(3), 429.
Toro, S. P. (2018). Secondary Science Teachers’ Understanding of the Nature of Science and Its Relationship to Evolution Theory (Doctoral dissertation).
Van Griethuijsen, R. A., van Eijck, M. W., Haste, H., Den Brok, P. J., Skinner, N. C., Mansour, N., ... & BouJaoude, S. (2015). Global patterns in students’ views of science and interest in science. Research in science education, 45(4), 581-603.
Wahyuni, S. (2015). Developing science learning instruments b ased on local wisdom to improve students’critical thinking skills.
Wenning, C. J., & Vieyra, R. E. (2015). Teaching High School Physics Volume III. Rebecca Vieyra.
Widowati, A., Widodo, E., & Anjarsari, P. (2017, November). The Development of Scientific Literacy through Nature of Science (NoS) within Inquiry Based Learning Approach. In Journal of Physics: Conference Series (Vol. 909, No. 1, p. 012067). IOP Publishing.
Wu, M., & Adams, R. (2007). Applying the Rasch model to psycho-social measurement: A practical approach. Melbourne: Educational Measurement Solutions.
Zlotnick, C., Dryjanska, L., & Suckerman, S. (2021). Health literacy, resilience and perceived stress of migrants in Israel during the COVID-19 pandemic. Psychology & Health, 1-17.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Pegem Journal of Education and Instruction
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial — You may not use the material for commercial purposes.
No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
