Validity and reliability of concept inventory test in human physiology
DOI:
https://doi.org/10.22219/jpbi.v10i1.29558Keywords:
biology education, concept inventory test, human physiology, test development, test validationAbstract
Biology education plays a vital role in nurturing the understanding of learners about the intricacy of life. Various efforts have emerged to strengthen learning biological concepts but there were still studies that showed that learners have low mastery in some aspects. To determine how well students understood various biological topics, including human physiology, Concept inventory tests (CIT) were used. The concept inventory test may be able to spot students' misconceptions and ultimately lead to improved comprehension. The crafted CIT developed with the aid of a table of specifications based on Bloom’s taxonomy of cognitive domain was assessed according to its validity and reliability. In validation, content validity and item analysis were considered while reliability test was employed through Cronbach’s alpha. Distractor analysis was also performed to determine possible source of misconception per item. The CIT was administered to 120 senior high school STEM students (50.8% from the private schools, 37.5% in regular public schools and 11.7% from public schools with special programs in science). The results displayed high content validity with a mean of 4.83 for content validity and an average Aiken’s validity coefficient of 0.98. It also highlighted that the test is moderately difficult with the test difficulty of 0.58, as well as, discriminatory with a discriminating level of 0.46. After item classification, 63 items were retained (39 accepted, 24 for revisions) and Chronbach’s alpha (α=0.74) indicated good internal consistency. The concept inventory test propounds to be a good classroom test with minor items to be revised.
Downloads
References
Agboghoroma, T. E., & Oyovwi, E. O. (2015). Evaluating effect of students’ academic achievement on identified difficult concepts in senior secondary school biology in Delta State. Journal of Education and Practice, 6(30), 117–125. https://eric.ed.gov/?id=EJ1081378
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012
Allawan, J. G. (2021). Exploring the Factors Influencing the Performance in Biology of Senior High School Students at University of Mindanao, Philippines. International Journal of Research and Innovation in Social Science, 05(06), 352–359. https://doi.org/10.47772/IJRISS.2021.5618
Amalia, R. F., & Wahyuni, S. (2021). Analysis of Higher Order Thinking Skills (HOTS) Content of SBMPTN Physics Problems. Journal of Physics: Conference Series, 1918(5), 052055. https://doi.org/10.1088/1742-6596/1918/5/052055
Amin, A. M., Corebima, A. D., & Zubaidah, S. (2017). The critical thinking skills profile of preservice biology teachers in animal physiology. Proceedings of the 3rd International Conference on Education and Training, 128(179–183). https://doi.org/10.2991/icet-17.2017.30
Antipolo, A. M. R., & Rogayan, D. V. Jr. (2021). Filipino prospective teachers’ experiences in teaching in K12 science curriculum: A cross-sectional research. Jurnal Pendidikan Biologi Indonesia, 7(1), 1–10. https://doi.org/10.22219/jpbi.v7i1.15468
Caffrey, E. D. (2011). Assessment in elementary and secondary education: A primer. DIANE Publishing. https://books.google.com/books
Cary, T. L., Wienhold, C. J., & Branchaw, J. (2019). A Biology Core Concept Instrument (BCCI) to Teach and Assess Student Conceptual Understanding. CBE—Life Sciences Education, 18(3), ar46. https://doi.org/10.1187/cbe.18-09-0192
Cheung, D., & Bucat, R. (2002). How can we construct good multiple-choice items?. https://www.academia.edu/download/40386455/constructMC.pdf
Engelhardt, V. (2009). An introduction to classical test theory as applied to conceptual multiple-choice tests: Getting started in physics education research. American Journal of Physics, 2(1), 1–40. https://www.per-central.org/items/detail.cfm?ID=8807
Ghazivakili, Z., Norouzi Nia, R., Panahi, F., Karimi, M., Gholsorkhi, H., & Ahmadi, Z. (2014). The role of critical thinking skills and learning styles of university students in their academic performance. Journal of Advances in Medical Education & Professionalism, 2(3), 95–102. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4235550/
Großschedl, J., Mahler, D., Kleickmann, T., & Harms, U. (2014). Content-Related Knowledge of Biology Teachers from Secondary Schools: Structure and learning opportunities. International Journal of Science Education, 36(14), 2335–2366. https://doi.org/10.1080/09500693.2014.923949
Kaptan, K., & Timurlenk, O. (2012). Challenges for Science Education. Procedia - Social and Behavioral Sciences, 51, 763–771. https://doi.org/10.1016/j.sbspro.2012.08.237
Kellaghan, T., & Greaney, V. (2001). Using assessment to improve the quality of education. Unesco, International Institute for Educational Planning. https://unesdoc.unesco.org/ark:/48223/pf0000126231
Lieu, R. M., Gutierrez, A., & Shaffer, J. F. (2018). Student perceived difficulties in learning organ systems in an undergraduate Human Anatomy Course. Journal of the Human Anatomy and Physiology Society, 22(1), 84–92. https://doi.org/10.21692/haps.2018.011
Michael, J. (2007). What makes physiology hard for students to learn? Results of a faculty survey. Advances in Physiology Education, 31(1), 34–40. https://doi.org/10.1152/advan.00057.2006
Morales, M. P. E. (2003). Development and validation of a two-tier test in Natsci 13 (Ecology). De La Salle-College of Saint Benilde. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3884103
Morales, M. P. E. (2012). Development and Validation of a concept test in introductory physics for biology students. The Manila Journal of Science, 7(2), 26–44. https://ejournals.ph/article.php?id=2441
Nolan, M. M., Beran, T., & Hecker, K. G. (2012). Surveys assessing students’ attitudes toward statistics: A systematic review of validity and reliability. Statistics Education Research Journal, 11(2), 103–123. https://doi.org/10.52041/serj.v11i2.333
O’Connor, B., & Hite, R. (2017). Global Learning Using Biology PBL: A Texas-China Collaboration in Middle Grade Genetics. Journal of Interdisciplinary Teacher Leadership, 2(2), 17–26. https://doi.org/10.46767/kfp.2016-0016
Oztas, F. (2014). How do High School Students Know Diffusion and Osmosis? High School Students’ Difficulties in Understanding Diffusion & Osmosis. Procedia - Social and Behavioral Sciences, 116, 3679–3682. https://doi.org/10.1016/j.sbspro.2014.01.822
Rezai, A. (2022). Fairness in classroom assessment: development and validation of a questionnaire. Language Testing in Asia, 12(1), 17. https://doi.org/10.1186/s40468-022-00162-9
Safitri, M., Riandi, R., Widodo, A., & Nasution, W. R. (2017). Integration of Various Technologies in Biology Learning. Journal of Physics: Conference Series, 895, 012145. https://doi.org/10.1088/1742-6596/895/1/012145
Scanlon, V. C., & Sanders, T. (2018). Essentials of anatomy and physiology. FA Davis. https://books.google.co.id/books/about/Essentials_of_Anatomy_and_Physiology.html?id=oXAotAEACAAJ&redir_esc=y
Shin, J., Guo, Q., & Gierl, M. J. (2019). Multiple-Choice Item Distractor Development Using Topic Modeling Approaches. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.00825
Silverthorn, D., Cafferty, P., Casagrand, J., Co, E., Flemming, M., McFarland, J., O’Loughlin, V., Scott, D., & Tomicek, N. (2023). Introducing the HAPS Physiology Learning Outcomes. HAPS Educator, 27(1), 79–86. https://doi.org/10.21692/haps.2023.010
Siri, A., & Freddano, M. (2011). The Use of Item Analysis for The Improvement Of Objective Examinations. Procedia - Social and Behavioral Sciences, 29, 188–197. https://doi.org/10.1016/j.sbspro.2011.11.224
Tanner, K., & Allen, D. (2004). Approaches to Biology Teaching and Learning: From Assays to Assessments—On Collecting Evidence in Science Teaching. Cell Biology Education, 3(2), 69–74. https://doi.org/10.1187/cbe.04-03-0037
Villarino, R. T., & Villarino, M. (2023). Academic Performance of Rural Junior High School Students in Biology: Basis for Learning Activities Development. 4, 1–10. https://dergipark.org.tr/en/download/article-file/2928056
Winanda, G. Z., & Anwar, D. (2022). Analysis of the implementation higher order thinking skills in tasks and test of english subject at SMK Negeri 2 Padang. Advances in Social Science, Education and Humanities Research, https://doi.org/10.2991/assehr.k.220201.019
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with JPBI (Jurnal Pendidikan Biologi Indonesia) agree to the following terms:
- For all articles published in JPBI, copyright is retained by the authors. Authors give permission to the publisher to announce the work with conditions. When the manuscript is accepted for publication, the authors agree to automatic transfer of the publishing right to the publisher.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
