Validation of undergraduate science process skills tests: Rasch model analysis
DOI:
https://doi.org/10.22219/raden.v3i1.24585Keywords:
higher education, instrument validation, Rasch, science process skillsAbstract
Science process skills are essential skills that students must possess. The science process skills test is needed to facilitate the measurement, so that test instruments are developed. The developed instrument needs to be validated before it is used. The purpose of this study was to validate the science process skills test instrument so that the developed instrument is valid and can be used to measure student abilities. The research was conducted using a quantitative descriptive method. The study population was all biology education students at UIN Walisongo Semarang-Indonesia, with a sample of 75 students selected using a purposive sampling technique. Data were analyzed using Rasch analysis which was divided into several categories, namely map analysis based on the items and research samples, analysis of the suitability of the items, analysis of separation and reliability, and items’ analysis. The results of Rasch's study show that the developed science process skills test for students proves valid. Participating students have fairly even abilities. The results of the validation of the items did not reveal any misconceptions, the questions were on the abilities of the students, and the questions had varying difficulty ranges. The validity of the science process skills test shows that the test instrument can be used to measure students' science process skills. Test instruments can be used as learning evaluation instruments as well as analysis of student problems related to science process skills.
Downloads
References
Bond, T. G., & Fox, M. C. (2015). Applying the Rasch model fundamental measurement in the human sciences third edition. Routledge.
Boone, W. J., Staver, R. J., & Yale, S. M. (2014). Rasch analysis in the human sciences. Springer International Publishing.
Cohen, M. R. (2018). Reason and nature. Routledge. https://doi.org/10.4324/9780429459344
Crisp, G. T. (2012). Integrative assessment: Reframing assessment practice for current and future learning. Assessment & Evaluation in Higher Education, 37(1), 33–43. https://doi.org/10.1080/02602938.2010.494234
Destin, M., Hanselman, P., Buontempo, J., Tipton, E., & Yeager, D. S. (2019). Do student mindsets differ by socioeconomic status and explain disparities in academic achievement in the United States? AERA Open, 5(3), 233285841985770. https://doi.org/10.1177/2332858419857706
Fisher, W. P. J. (2018). Rasch measurement: Transactions of the Rasch measurement SIG. American Educational Research Association., 21(1), 1087–1096.
Fitriani, L., Ramalis, T. R., & Efendi, R. (2019). Karakterisasi tes keterampilan proses sains materi fluida statis berdasarkan teori respon butir. Omega: Jurnal Fisika Dan Pendidikan Fisika, 5(2), 27-32. https://doi.org/10.31758/OmegaJPhysPhysEduc.v5i2.27
Gow, L., & Kember, D. (1990). Does higher education promote independent learning? Higher Education, 19(3), 307–322. https://doi.org/10.1007/BF00133895
Gravetter, F. J., & Forzano, L.-A. B. (2018). Research methods for the behavioral sciences. Cengage Learning.
Haertel, E. (2013). How is testing supposed to improve schooling? Measurement: Interdisciplinary Research & Perspective, 11(1–2), 1–18. https://doi.org/10.1080/15366367.2013.783752
Hamdu, G., Fuadi, F. N., Yulianto, A., & Akhirani, Y. S. (2020). Items quality analysis using Rasch model to measure elementary school students’ critical thinking skill on STEM learning. JPI (Jurnal Pendidikan Indonesia), 9(1), 61-74. https://doi.org/10.23887/jpi-undiksha.v9i1.20884
Handayani, S. L., & Iba, K. (2020). Karakteristik tes keterampilan proses sains: validitas, reliabilitas, tingkat kesukaran dan daya pembeda soal. Publikasi Pendidikan, 10(2), 100-106. https://doi.org/10.26858/publikan.v10i2.13051
Hockings, C., Thomas, L., Ottaway, J., & Jones, R. (2018). Independent learning – what we do when you’re not there. Teaching in Higher Education, 23(2), 145–161. https://doi.org/10.1080/13562517.2017.1332031
Kumandaş, B., Ateskan, A., & Lane, J. (2019). Misconceptions in biology: A meta-synthesis study of research, 2000–2014. Journal of Biological Education, 53(4), 350–364. https://doi.org/10.1080/00219266.2018.1490798
Lind, K. K. (1998). Science in early childhood: Developing and acquring fundamental concepts and skills. Retrieved from ERIC (ED418777), 85. http://files.eric.ed.gov/fulltext/ED418777.pdf
Mandasari, F., Iwan, I., & Damopolii, I. (2021). The relationship between science process skills and biology learning outcome. Journal of Research in Instructional, 1(1), 23–32. https://doi.org/10.30862/jri.v1i1.9
Moore, M. G., & Diehl, W. C. (Eds.). (2018). Handbook of distance education. Routledge. https://doi.org/10.4324/9781315296135
Nurhayati, Saputri, D. F., & Assegaf, S. L. H. (2019). Pengembangan instrumen tes keterampilan proses sains pada materi fisika untuk siswa sekolah menengah pertama. Edukasi: Jurnal Pendidikan, 17(2), 145-158. https://doi.org/10.31571/edukasi.v17i2.1250
Ozdemir, G., & Dikici, A. (2016). Relationships between scientific process skills and scientific creativity: mediating role of nature of science knowledge. Journal of Education in Science, Environment and Health, 3(1), 52–52. https://doi.org/10.21891/jeseh.275696
Prinz, A., Golke, S., & Wittwer, J. (2019). Refutation texts compensate for detrimental effects of misconceptions on comprehension and metacomprehension accuracy and support transfer. Journal of Educational Psychology, 111(6), 957–981. https://doi.org/10.1037/edu0000329
Sappaile, B. I. (2007). Konsep instrumen penelitian pendidikan. Jurnal Pendidikan Dan Kebudayaan, 13(66), 379–391. https://doi.org/10.24832/jpnk.v13i66.356
Soeharto, S., Csapó, B., Sarimanah, E., Dewi, F. I., & Sabri, T. (2019). A review of students’ common misconceptions in science and their diagnostic assessment tools. Jurnal Pendidikan IPA Indonesia, 8(2), 247-266. https://doi.org/10.15294/jpii.v8i2.18649
Suciono, W. (2021). Berpikir kritis. Penerbit Adab.
Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan Rasch pada assessment pendidikan. Trim Komunikata.
Tan, O.-S. (2003). Problem-based learning innovation: Using Problems to power learning in the 21st century. Cengage Learning.
Tauhidah, D., & Farikha, Y. (2022). Analisis keterampilan proses sains mahasiswa selama praktikum daring. Jurnal Education and Development Institut Pendidikan Tapanuli Selatan, 10(2), 240–249. https://journal.ipts.ac.id/index.php/ED/article/view/3481
Turiman, P., Omar, J., Daud, A. M., & Osman, K. (2012). Fostering the 21st century skills through scientific literacy and science process skills. Procedia - Social and Behavioral Sciences, 59, 110–116. https://doi.org/10.1016/j.sbspro.2012.09.253
Van der Kleij, F. M., Vermeulen, J. A., Schildkamp, K., & Eggen, T. J. H. M. (2015). Integrating data-based decision making, assessment for learning and diagnostic testing in formative assessment. Assessment in Education: Principles, Policy & Practice, 22(3), 324–343. https://doi.org/10.1080/0969594X.2014.999024
Wang, M.-T., L. Degol, J., Amemiya, J., Parr, A., & Guo, J. (2020). Classroom climate and children’s academic and psychological wellbeing: A systematic review and meta-analysis. Developmental Review, 57, 100912. https://doi.org/10.1016/j.dr.2020.100912
Yan, D., von Davier, A. A., & Lewis, C. (Eds.). (2016). Computerized multistage testing. Chapman and Hall/CRC. https://doi.org/10.1201/b16858
Yildiz, C., & Yildiz, T. G. (2021). Exploring the relationship between creative thinking and scientific process skills of preschool children. Thinking Skills and Creativity, 39, 100795. https://doi.org/10.1016/j.tsc.2021.100795
Zeidan, A. H., & Jayosi, M. R. (2014). Science process skills and attitudes toward science among palestinian secondary school students. World Journal of Education, 5(1), 13-24. https://doi.org/10.5430/wje.v5n1p13
Zydney, J. M., & Warner, Z. (2016). Mobile apps for science learning: Review of research. Computers & Education, 94, 1–17. https://doi.org/10.1016/j.compedu.2015.11.001
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Dian Tauhidah, Ndzani Latifatur Rofi'ah
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with Research and Development in Education agree to the following terms:
- For all articles published in the Research and Development in Education, copyright is retained by the authors. Authors give permission to the publisher to announce the work with conditions. When the manuscript is accepted for publication, the authors agree to the automatic transfer of non-exclusive publishing rights to the publisher.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
