Analysis the quality of critical thinking and creativity questions in high school biology subjects with the Rasch model
DOI:
https://doi.org/10.22219/raden.v4i1.32758Keywords:
Assessment Instruments, Item Response Theory, Level Of Difficulty, Reliability, ValidityAbstract
A good instrument is an instrument that can measure students' abilities accurately. The research aims to analyze the quality of critical thinking and creativity items on water pollution material in terms of validity, reliability, and level of difficulty using the Rasch model. The research used a quantitative descriptive method involving biology learning experts and 173 class X high school students. The research was carried out in December 2023-January 2024. The data collection method used expert assessment sheets and critical thinking and creativity essay questions. Data were analyzed using the Rasch model assisted by Quest. The results showed that of the 10 critical thinking essay questions, 3 questions were invalid, while of the 8 creativity essay questions, 1 question was invalid based on the suitability of the INFIT MNSQ and OUTFIT T scores. The results of the reliability test with Cronbach’s alpha showed that the reliability value of the critical thinking instrument was 0.74 and creativity 0.79. Average difficulty level of questions with threshold values in the medium and difficult categories. Overall, the instrument was feasible and question items that did not fit the Rasch model were removed.
Downloads
References
Amin, S., Utaya, S., Bachri, S., Sumarmi, & Susilo, S. (2020). Effect of problem-based learning on critical thinking skills and environmental attitude. Journal for the Education of Gifted Young Scientists, 8(2), 743–755. https://doi.org/10.17478/jegys.650344
Astuti, R. T., Dewi, M., & Pratiwi, R. Y. (2023). Pedagogik online test instrument to measure students’ critical thinking ability. Jurnal Riset Pedagogik, 7(1), 276–286. https://doi.org/10.20961/jdc.v7i1.71328
Blegur, J., Rajagukguk, C. P. M., Sjioen, A. E., & Souisa, M. (2023). Innovation of analytical thinking skills instrument for throwing and catching game activities for elementary school students. International Journal of Instruction, 16(1), 723–740. https://doi.org/10.29333/iji.2023.16140a
Bui, T. L. T., Kazarenkov, V. I., & de Tran, V. (2020). Application of Rasch model to develop a questionnaire for evaluating the quality of teaching for students’ creativity development. International Journal of Learning, Teaching and Educational Research, 19(8), 278–296. https://doi.org/10.26803/ijlter.19.8.15
Darmana, A., Sutiani, A., Nasution, H. A., Ismanisa, I., & Nurhaswinda, N. (2021). Analysis of Rasch model for the validation of chemistry national exam instruments. Jurnal Pendidikan Sains Indonesia, 9(3), 329–345. https://doi.org/10.24815/jpsi.v9i3.19618
Eliaumra, E., Samaela, D. P., & Muhdin, N. K. (2022). Developing diagnostic test assessment to measure creative thinking skills of Biology preservice teacher students. Research and Evaluation in Education, 8(2), 152–168. https://doi.org/10.21831/reid.v8i2.50885
Ennis, R. H. (2011). The nature of critical thinking: an outline of critical thinking dispositions and abilities. https://www.yumpu.com/en/document/view/50722770/the-nature-of-critical-thinking-an-outline-of-critical-our-faculty
Erfan, M., Maulyda, M. A., Ermiana, I., Hidayati, V. R., & Widodo, A. (2020). Validity and reliability of cognitive tests study and development of elementary curriculum using Rasch model. Psychology, Evaluation, and Technology in Educational Research, 3(1), 26–33. https://doi.org/10.33292/petier.v3i1.51
Farida, F. & Musyarofah, A. (2021). Validitas dan reliabilitas dalam analisis butir soal. Al-Mu’arrib: Jurnal Pendidikan Bahasa Arab , I(1), 34–44. https://jurnal.lp2msasbabel.ac.id/index.php/AL-MUARRIB
Fietri, W. A., Zulyusri, & Violita. (2021). Analisis butir soal biologi kelas xi madrasah aliyah sakinah kerinci menggunakan program komputer anates 4.0 for windows. Natural Science: Jurnal Penelitian Bidang IPA Dan Pendidikan IPA, 7(1), 28–35. https://doi.org/10.15548/nsc.v7i1.2329
Hamdu, G., Fuadi, F. N., Yulianto, A., & Akhirani, Y. S. (2020). Items quality analysis using Rasch model to measure elementary school students’ critical thinking skill on stem learning. Jurnal Pendidikan Indonesia, 9(1), 61. https://doi.org/10.23887/jpi-undiksha.v9i1.20884
Kardoyo, K., Nurkhin, A., Muhsin, M., & Pramusinto, H. (2020). Problem-based learning strategy: Its impact on students’ critical and creative thinking skills. European Journal of Educational Research, 9(3), 1141–1150. https://doi.org/10.12973/EU-JER.9.3.1141
Leasa, M., Batlolona, J. R., & Talakua, M. (2021). Elementary students’ creative thinking skills in science in the Maluku islands, Indonesia. Creativity Studies, 14(1), 74–89. https://doi.org/10.3846/cs.2021.11244
Lia, R. M., Rusilowati, A., & Isnaeni, W. (2020). NGSS-oriented chemistry test instruments: Validity and reliability analysis with the Rasch model. Research and Evaluation in Education, 6(1), 41–50. https://doi.org/10.21831/reid.v6i1.30112
Lidinillah, D. A. M., Aprilia, M., Suryana, D., & Ahmad, A. B. (2020). Development of creativity instrument through Rasch model analysis. Universal Journal of Educational Research, 8(4), 1620–1627. https://doi.org/10.13189/ujer.2020.080455
Meryastiti, V., Supeno, S., Ridlo, Z. R., & Rahayuningsih, R. (2023). Improving critical thinking skills of junior high school students in science learning using the development of interactive e-module based macromedia flash. Journal of Innovative Science Education, 12(2), 163–172. https://doi.org/10.15294/JISE.V12I2.55080
Muntazhimah, M., Putri, S., & Khusna, H. (2020). Rasch model untuk memvalidasi instrumen resiliensi matematis mahasiswa calon guru matematika. Jurnal Kajian Pendidikan Matematika, 6(1), 65–74. https://doi.org/10.30998/jkpm.v6i1.8144
Ndiung, S., & Jediut, M. (2020). Pengembangan instrumen tes hasil belajar matematika peserta didik sekolah dasar berorientasi pada berpikir tingkat tinggi. Premiere Educandum : Jurnal Pendidikan Dasar Dan Pembelajaran, 10(1), 94. https://doi.org/10.25273/pe.v10i1.6274
Pantiwati, Y., Kusniarti, T., Permana, F. H., Nurrohman, E., & Sari, T. N. I. (2022). The effects of the blended project-based literacy that integrates school literacy movement strengthening character education learning model on metacognitive skills, critical thinking, and opinion expression. European Journal of Educational Research, 12(1), 145–158. https://doi.org/10.12973/eu-jer.12.1.145
Petra, T. Z. H. T., & Aziz, M. J. A. (2020). Investigating reliability and validity of student performance assessment in Higher Education using Rasch Model. Journal of Physics: Conference Series, 1529(4). https://doi.org/10.1088/1742-6596/1529/4/042088
Prasetya, W. A., & Pratama, A. T. (2023). Item quality analysis using the Rasch model to measure critical thinking ability in the material of the human digestive system of Biology subject in high school. Jurnal Penelitian Dan Evaluasi Pendidikan, 27(1), 76–91. https://doi.org/10.21831/pep.v27i1.58873
Priyanto, D., & Dharin, A. (2021). Students creativity development model and its implementation in Indonesian islamic elementary school. Pegem Journal of Education and Instruction, 11(3), 81–87. https://doi.org/10.14527/pegegog.2021.00
Rizbudiani, A. D., Jaedun, A., Rahim, A., & Nurrahman, A. (2021). Rasch model item response theory (IRT) to analyze the quality of mathematics final semester exam test on system of linear equations in two variables (SLETV). Al-Jabar : Jurnal Pendidikan Matematika, 12(2), 399–412. https://doi.org/10.24042/ajpm.v12i2.9939
Sa’diyah, L. H., Siahaan, P., Suhendi, E., Samsudin, A., Aminudin, A. H., Rais, A., Sari, I., & Rachmadtullah, R. (2020). Critical thinking instrument test (ctit): Developing and analyzing sundanese students’ critical thinking skills on physics concepts using Rasch analysis. International Journal of Psychosocial Rehabilitation, 24, 2020. https://doi.org/10.37200/IJPR/V24I8/PR281423
Safitri, I., Lestarani, D., Imtikhanah, R. D. N. W., Akbarini, N. R., Sari, M. W., Fitrah, M., Ilyas, Sista, R. T., Setyono, I. D., Setyaningtyas, R. F., Ndayizeye, O., & Hapsan, A. (2024). Teori pengukuran dan evaluasi (A. Hapsan, Ed.; 1st ed.). CV. Ruang Tentor. https://books.google.co.id/books?id=NWf_EAAAQBAJ&printsec=frontcover&hl=id&source=gbs_ge_summary_r&cad=0#v=onepage&q&f=false
Saputri, H. A., Zulhijrah, Larasati, N. J., & Shaleh. (2023). Analisis instrumen assesmen : validitas, reliabilitas, tingkat kesukaran dan daya beda butir soal. Didaktik : Jurnal Ilmiah PGSD STKIP Subang, 09(05), 2986–2995. https://doi.org/10.36989/didaktik.v9i5.2268
Sari, E. D. K., & Mahmudi, I. (2024). Analisis pemodelan Rasch pada assessment pendidikan (analisis dengan menggunakan aplikasi winstep) (1st ed.). PT. Pena Persada Kerta Utama. https://www.researchgate.net/publication/378210331_BUKU_ANALISIS_PEMODELAN_RASCH_PADA_ASESMEN_PENDIDIKAN
Sari, R. R., Sugiharto, B., & Widoretno, S. (2022). Instrument analysis of biology teachers’ needs to assess students’ creative thinking skills using Rasch model. Tadris: Jurnal Keguruan Dan Ilmu Tarbiyah, 7(2), 241–258. https://doi.org/10.24042/tadris.v7i2.13265
Satria, E., Sarumaha, Y. A., Satria, E., Hs, N., & Anas. (2023). Building students’ critical thinking skill through problem-based learning model. Jurnal Kajian Pendidikan FKIP Universitas Dwijendra, 14(1). https://doi.org/10.46650/wa.14.1.1409.92-98
Setyowarno, D. (2017). Upaya meningkatkan kualitas butir soal dengan analisis aplikasi quest. https://staffnew.uny.ac.id/upload/198810132015041004/lainlain/PPM%20Panduan%20Quest.pdf
Siahaan, E. Y. S., Muhammad, I., Dasari, D., & Maharani, S. (2023). Research on critical thinking of pre-service mathematics education teachers in Indonesia (2015-2023): A bibliometric review. Jurnal Math Educator Nusantara: Wahana Publikasi Karya Tulis Ilmiah Di Bidang Pendidikan Matematika, 9(1), 34–50. https://doi.org/10.29407/jmen.v9i1.19734
Simanjuntak, M. P., Hutahaean, J., Marpaung, N., & Ramadhani, D. (2021). Effectiveness of problem-based learning combined with computer simulation on students’ problem-solving and creative thinking skills. International Journal of Instruction, 14(3), 519–534. https://doi.org/10.29333/iji.2021.14330a
Sudihartinih, E., & Prabawanto, S. (2020). Test instrument validation in plane geometry using Rasch model. Mathematics Education Journals, 4(2), 102–115. http://ejournal.umm.ac.id/index.php/MEJ
Sumardi, S. (2020). Teknik pengukuran dan penilaian hasil belajar [Measurement techniques and assessment of learning outcomes]. Deepublish.
Sumarni, W., & Kadarwati, S. (2020). Ethno-stem project-based learning: Its impact to critical and creative thinking skills. Jurnal Pendidikan IPA Indonesia, 9(1), 11–21. https://doi.org/10.15294/jpii.v9i1.21754
Susdelina, S., Perdana, S. A., & Febrian. (2018). Analisis kualitas instrumen pengukuran pemahaman konsep persamaan kuadrat melalui teori tes klasik dan Rasch model. Jurnal Kiprah, VI(1), 41–48. https://doi.org/10.31629/kiprah.v6i1.574
Tania, T., Sajidan, & Harlita. (2021). Analyzing the quality of instrument for critical thinking skill and assessing students’ critical thinking skill in ecology using the Rasch model. Proceeding Biology Education Conference, 17(1), 120–126.
Tarmizi, P., Setiono, P., Amaliyah, Y., & Agrian, A. (2021). Analisis butir soal pilihan ganda tema sehat itu penting kelas v sd negeri 04 kota bengkulu. Elementary School Education Journal, 4(2), 124. https://doi.org/10.30651/else.v4i2.7090
Tauhidah, D., & Rofi’ah, N. L. (2023). Validation of undergraduate science process skills tests: Rasch model analysis. Jurnal Research and Development in Education, 3(1), 51–57. https://doi.org/10.22219/raden.v3i1
Thornhill-Miller, B., Camarda, A., Mercier, M., Burkhardt, J. M., Morisseau, T., Bourgeois-Bougrine, S., Vinchon, F., El Hayek, S., Augereau-Landais, M., Mourey, F., Feybesse, C., Sundquist, D., & Lubart, T. (2023). Creativity, critical thinking, communication, and collaboration: Assessment, certification, and promotion of 21st century skills for the future of work and education. Journal of Intelligence, 11(3). https://doi.org/10.3390/jintelligence11030054
Torrance, E. P. (1969). Creativity. Dimensions Publishing Company.
Ubadillah, M., Marwoto, P., Wiyanto, Rusilowati, A., Subali, B., Mindyarto, B. N., & Isnaeni, W. (2022). Development of habits of mind instruments in the context 23 of basic physics practicum: Efa and Rasch mode. Journal of Educational Cultural and Psychological Studies, 26(12), 23–49. https://www.ledonline.it/ECPS-Journal/
Yasin, S. N. T. M., Yunus, M. F. M., & Ismail, I. (2018). The use of Rasch measurement model for the validity and reliability. Journal of Counseling and Educational Technology, 1(2), 22. https://doi.org/10.32698/0111
Zainil, M., Kenedi, A. K., Rahmatina, Indrawati, T., & Handrianto, C. (2023). The influence of a STEM-based digital classroom learning model and high-order thinking skills on the 21st-century skills of elementary school students in Indonesia. Journal of Education and E-Learning Research, 10(1), 29–35. https://doi.org/10.20448/jeelr.v10i1.4336
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Tasya Novian Indah Sari, Anna Rakhmawati
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with Research and Development in Education agree to the following terms:
- For all articles published in the Research and Development in Education, copyright is retained by the authors. Authors give permission to the publisher to announce the work with conditions. When the manuscript is accepted for publication, the authors agree to the automatic transfer of non-exclusive publishing rights to the publisher.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
