Developing an instrument to assess students’ problem-solving ability on hybrid learning model using Ethno-STEM Approach through quest program


  • Fine Reffiane
  • Sudarmin Sudarmin
  • Wiyanto Wiyanto
  • Sigit Saptono



Etno-STEM, Quest, Hybrid-Learning Model


This article explains the result of the instrument test of students’ problem-solving ability on hybrid learning model using Etno-STEM approach through Quest program. The study was conducted through validation of experts and revisions which was followed by field test on 143 students. Content validity was analysed using Aiken’s V index, while Partial Credit Model (PCM) with one-parameter logistic of Quest program was used for construct validity analysis. The finding revealed that the Aiken index gained 0.6 for the language clarity (valid) and 0.81 for the theory conformity, grouped into good validity. The value of IFNIT t for 21 items was ±2.0 and it is concluded that the instrument fits with the items and the testers completed the examination of 1 PL model. The reliability of the test was 0.44, so the instrument was good to be used to measure problem solving ability.


Download data is not yet available.


S. Gulec and H. Temel, “Body Language Using Skills of Teacher Candidates from Departments of Mathematics Education and Social Studies Education,” Procedia - Soc. Behav. Sci., vol. 186, pp. 161–168, 2015.

G. Kennedy, P. De Barba, C. Coffrin, and L. Corrin, “Predicting success: How learners’ prior knowledge, skills and activities predict MOOC performance,” ACM Int. Conf. Proceeding Ser., vol. 16-20-Marc, pp. 136–140, 2015.

M. Stevenson, J. Hedberg, K. Highfield, and M. Diao, “Visualizing solutions: Apps as cognitive stepping-stones in the learning process,” Electron. J. e-Learning, vol. 13, no. 5, pp. 366–379, 2015.

J. Dostál, “Theory of Problem Solving,” Procedia - Soc. Behav. Sci., vol. 174, pp. 2798–2805, 2015.

C. N. Herde, S. Wüstenberg, and S. Greiff, “Assessment of Complex Problem Solving: What We Know and What We Don’t Know,” Appl. Meas. Educ., vol. 29, no. 4, pp. 265–277, 2016.

S. A. Aiken-Wisniewski, A. Johnson, J. Larson, and J. Barkemeyer, “A Preliminary Report of Advisor Perceptions of Advising and of a Profession,” NACADA J., vol. 35, no. 2, pp. 60–70, 2015.

M. Tabatabaee-Yazdi, K. Motallebzadeh, H. Ashraf, and P. Baghaei, “Development and validation of a teacher success questionnaire using the rasch model,” Int. J. Instr., vol. 11, no. 2, pp. 129–144, 2018.

M. Melo, “The 4C/ID-model in physics education: Instructional design of a digital learning environment to teach electrical circuits,” Int. J. Instr., vol. 11, no. 1, pp. 103–122, 2018.

B. Subali, U. N. Yogyakarta, U. M. Surakarta, N. S. Aminah, and U. S. Maret, “Modern Test Theory,” vol. 14, no. 1, pp. 647–660, 2021.

F. Reffiane, M. Sudarmin, M. Wiyanto, and A. B. Prasetyo, “Blended Learning Analysis in Nature Basic Concept in Elementary School Teacher Education Study Program,” vol. 247, no. Iset, pp. 169–171, 2018.

W. Sumarni, Sudarmin, Wiyanto, and Supartono, “The reconstruction of society indigenous science into scientific knowledge in the production process of palm sugar,” J. Turkish Sci. Educ., vol. 13, no. 4, pp. 281–292, 2016.

M. Nerland, “Knowledge practices and relations in professional education,” Stud. Contin. Educ., vol. 40, no. 3, pp. 242–256, 2018.

V. J. Shute, L. Wang, S. Greiff, W. Zhao, and G. Moore, “Measuring problem solving skills via stealth assessment in an engaging video game,” Comput. Human Behav., vol. 63, pp. 106–117, 2016.

J. A. Marshall and J. R. Harron, “Making Learners : A Framework for Evaluating Making in STEM Education The Interdisciplinary Journal of Problem-based Learning Special Issue : Tinkering in Technology-Rich Design COntexts Making Learners : A Framework for Evaluating Making in STEM Educatio,” Interdiscip. J. Probl. Learn., vol. 12, no. 2, 2018.

A. Corbi and D. Burgos, “Open distribution of virtual containers as a key framework for open educational resources and STEAM subjects,” Electron. J. e-Learning, vol. 15, no. 2, pp. 126–136, 2017.

W. J. Smith, Thinking Skills, vol. 69, no. 480. 1985.

I. B. N. Sudria, I. W. Redhana, I. M. Kirna, and D. Aini, “Effect of Kolb’s learning styles under inductive guided-inquiry learning on learning outcomes,” Int. J. Instr., vol. 11, no. 1, pp. 89–102, 2018.

C. Cotta Natale, P. Seixas Mello, S. L. Frateschi Trivelato, P. Marzin-Janvier, and D. Manzoni-de-Almeida, “Evidence of Scientific Literacy Through Hybrid and Online Biology Inquiry-Based Learning Activities (Journal Pre-Proof),” High. Learn. Res. Commun., vol. 11, no. 0, pp. 33–49, 2020.

B. Azhari and I. Fajri, “Distance learning during the COVID-19 pandemic: School closure in Indonesia,” Int. J. Math. Educ. Sci. Technol., 2021.

A. P. Davis et al., “The Comparative Toxicogenomics Database: Update 2019,” Nucleic Acids Res., vol. 47, no. D1, pp. D948–D954, 2019.




How to Cite

Reffiane, F., Sudarmin, S., Wiyanto, W., & Saptono, S. (2021). Developing an instrument to assess students’ problem-solving ability on hybrid learning model using Ethno-STEM Approach through quest program. Pegem Journal of Education and Instruction, 11(4), 1–8.