Development and validation of a conceptual test for the human circulatory system
DOI:
https://doi.org/10.22219/jpbi.v10i3.34327Keywords:
biology, concept test, human circulatory system, item analysis, Rasch analysisAbstract
Current biology assessments often lack a strong emphasis on conceptual understanding, which may limit students' ability to apply knowledge in real-world contexts. This study aimed to develop and validate a concept test to assess high school student's understanding of the human circulatory system. The test was carefully designed using the revised Bloom's Taxonomy and aligned with the K-12 curriculum. Initial content validation by biology education experts ensured accuracy and relevance, leading to refinements in the test items. Item quality was enhanced through dichotomous Rasch analysis following preliminary testing with 100 students. After a second administration to a new group of 100 students, further analysis confirmed the test's reliability and validity. A final round of testing with an additional 100 students yielded a Cronbach's alpha of 0.79, confirming internal consistency. The study concluded that the developed concept test is valid and reliable for assessing students' understanding of the circulatory system, providing teachers with a tool to refine instructional methods. Future recommendations involve expanding and updating test items to ensure relevance, integrating technology-enhanced questions to improve the assessment of student comprehension, and evaluating reliability across diverse contexts.
Downloads
References
Abate, N. T., Woldeamanuel, Y. W., & Berhane, D. E. (2020). Effectiveness of concept mapping based teaching methods on Grade eight students’ conceptual understanding of photosynthesis at Ewket Fana Primary School, Bahir Dar, Ethiopia. Eurasia Journal of Mathematics Science and Technology Education, 16(12), em1918. https://doi.org/10.29333/ejmste/9276
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012
Aligway, G. J. B., Delos Angeles, J. C., Collano, A. V., Barroca, E. P., Aves, A. C. D., Catubay, J. F., Edjec, J. T., Butaya, M. D. A., & Cortes, S. T. (2024). Validity and reliability of concept inventory test in human physiology. JPBI (Jurnal Pendidikan Biologi Indonesia), 10(1), 273-282. https://doi.org/10.22219/jpbi.v10i1.29558
Avargil, S., Herscovitz, O., & Dori, Y. J. (2011). Teaching thinking skills in context-based learning: teachers’ challenges and assessment knowledge. Journal of Science Education and Technology, 21(2), 207–225. https://doi.org/10.1007/s10956-011-9302-7
Betts, J. G., Young, K. A., Wise, J. A., Johnson, E., Poe, B., Kruse, D. H., Korol, O., Johnson, J. E., Womble, M., & DeSaix, P. (2022, April 20). Ch. 20 Introduction - Anatomy and Physiology 2E | OpenStax. https://openstax.org/books/anatomy-and-physiology-2e/pages/20-introduction
Black, P., & Wiliam, D. (2018). Classroom assessment and pedagogy. Assessment in Education Principles Policy and Practice, 25(6), 551–575. https://doi.org/10.1080/0969594x.2018.1441807
Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd Edition). Lawrence Erlbaum Associates Publishers. https://doi.org/10.4324/9781315814698
Brookhart, S. M. (2011). Educational assessment knowledge and skills for teachers. Educational Measurement Issues and Practice, 30(1), 3–12. https://doi.org/10.1111/j.1745-3992.2010.00195.x
Buckley, B. C. (2000). Interactive multimedia and model-based learning in biology. International Journal of Science Education, 22(9), 895–935. https://doi.org/10.1080/095006900416848
Cary, T. L., Wienhold, C. J., & Branchaw, J. (2019). A Biology Core Concept Instrument (BCCI) to teach and assess student conceptual understanding. CBE—Life Sciences Education, 18(3), ar46. https://doi.org/10.1187/cbe.18-09-0192
Chandio, M. T., Pandhiani, S. M., & Iqbal, R. (2016). Bloom’s taxonomy: Improving assessment and teaching-learning process. Journal of Education and Educational Development, 3(2), 203–221. https://doi.org/10.22555/joeed.v3i2.1034
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/bf02310555
Crowe, A., Dirks, C., & Wenderoth, M. P. (2008). Biology in Bloom: Implementing Bloom’s Taxonomy to
enhance student learning in Biology. CBE Life Sciences Education, 7(4), 368–381. https://doi.org/10.1187/cbe.08-05-0024
Feltovich, P. J., Spiro, R. J., & Coulson, R. L. (2012). Learning teaching,and testing for complex conceptual understanding. In N. Frederiksen, R. J. Mislevy, & I. I. Bejar (Eds.), Test Theory for A New Generation of Tests (1st ed., pp. 193–230). Routledge. https://doi.org/10.4324/9780203052358-11
Gao, X., Li, P., Shen, J., & Sun, H. (2020). Reviewing assessment of student learning in interdisciplinary STEM education. International Journal of STEM Education, 7(1). https://doi.org/10.1186/s40594-020-00225-4
García-Ceberino, J. M., Antúnez, A., Ibáñez, S. J., & Feu, S. (2020). Design and validation of the instrument for the measurement of learning and performance in football. International Journal of Environmental Research and Public Health, 17(13), 4629. https://doi.org/10.3390/ijerph17134629
Gnidovec, T., Žemlja, M., Dolenec, A., & Torkar, G. (2020). Using augmented reality and the structure–behavior–function model to teach lower secondary school students about the human circulatory system. Journal of Science Education and Technology, 29(6), 774–784. https://doi.org/10.1007/s10956-020-09850-8
Heldt, T., Mukkamala, R., Moody, G. B., & Mark, R. G. (2010). CVSIM: An open-source cardiovascular simulator for teaching and research. Open Pacing, Electrophysiology, & Therapy Journal, 3, 45–54. https://pubmed.ncbi.nlm.nih.gov/21949555
Jensen, J. L., McDaniel, M. A., Woodard, S. M., & Kummer, T. A. (2014). Teaching to the test. . .or testing to teach: Exams requiring higher order thinking skills encourage greater conceptual understanding. Educational Psychology Review, 26(2), 307–329. https://doi.org/10.1007/s10648-013-9248-9
Kim, M., Patel, R. A., Uchizono, J. A., & Beck, L. (2012). Incorporation of Bloom’s Taxonomy into Multiple-Choice Examination Questions for a Pharmacotherapeutics Course. American Journal of Pharmaceutical Education, 76(6), 114. https://doi.org/10.5688/ajpe766114
Lestari, N. W., Selvia, N. F., & Layliyyah, N. R. (2019). Open-ended approach to students’ metacognitive ability. At-Ta`Lim Journal of Education, 5(2), 93–106. https://doi.org/10.36835/attalim.v5i2.263
Lewis, C. C., Fischer, S., Weiner, B. J., Stanick, C., Kim, M., & Martinez, R. G. (2015). Outcomes for implementation science: An enhanced systematic review of instruments using evidence-based rating criteria. Implementation Science, 10(1). https://doi.org/10.1186/s13012-015-0342-x
López-Manjón, A., & Angón, Y. P. (2009). Representations of the human circulatory system. Journal of Biological Education, 43(4), 159–163. https://doi.org/10.1080/00219266.2009.9656176
Morales, M. P. E. (2012). Development and validation of a concept test in introductory physics for biology students. The Manila Journal of Science, 7(2), 26-44. https://www.dlsu.edu.ph/wp-content/uploads/pdf/research/journals/mjs/MJS07-2-2012/MJS07-2-4-morales.pdf
Mundy, N., Poyade, M., & Brownlow, A. (2022). The digital dolphin: Are 3D mobile based and interactive models a useful aid to volunteers on stranding schemes Learning the basic anatomy and pathology of cetaceans? In P. M. Rea (Ed.), Medical Visualization and Applications of Technology: Vol. IX (1st ed., pp. 263–295). Springer Cham. https://doi.org/10.1007/978-3-031-06735-8_9
Nilsson, S., & Holmgren, S. (2021). Comparative physiology and evolution of the autonomic nervous system (1st ed). Routledge. https://doi.org/10.1201/9781315139807
Özen, S. O. (2017). The effect of motivation on student achievement. In E. Karadag (Ed.), The Factors Effecting Student Achievement: Meta-Analysis of Empirical Studies: Vol. VI (1st ed., pp. 35–56). Springer Cham. https://doi.org/10.1007/978-3-319-56083-0_3
Purba, K. R., Liliana, N., & Kwarrie, Y. N. P. (2017). Development of interactive learning media for simulating human blood circulatory system. 2017 International Conference on Soft Computing, Intelligent System and Information Technology (ICSIIT), Denpasar, Indonesia, 2017, pp. 275-278. https://doi.org/10.1109/icsiit.2017.68
Putra, B. K. B., Prayitno, B. A., & Maridi, M. (2018). The effectiveness of guided inquiry and INSTAD towards students’ critical thinking skills on circulatory system materials. Jurnal Pendidikan IPA Indonesia, 7(4), 476–482. https://doi.org/10.15294/jpii.v7i4.14302
Rahmawati, R., Rustaman, N. Y., Hamidah, I., & Rusdiana, D. (2018). The development and validation of conceptual knowledge test to evaluate conceptual knowledge of physics prospective teachers on electricity and magnetism topics. Jurnal Pendidikan IPA Indonesia, 7(4), 483–490. https://doi.org/10.15294/jpii.v7i4.13490
Retnawati, H., Djidu, H., Kartianom, K., Apino, E., & Anazifa, R. D. (2018). Teacher’s knowledge about higher order thinking skills and its learning strategy. Problems of Education in the 21st Century, 76(2), 215–230. https://doi.org/10.33225/pec/18.76.215
Roberts, D. A. (2013). Scientific Literacy/Science Literacy. In S. K. Abell, K. Appleton, & D. Hanuscin (Eds.), Handbook of Research on Science Education (1st ed., pp. 743–794). Routledge. https://doi.org/10.4324/9780203824696-32
Roth, K. J. (1990). Developing meaningful conceptual understanding in science. In B. F. Jones & L. Idol (Eds.), Dimensions of Thinking and Cognitive Instruction (1st ed., pp. 151–188). Routledge. https://doi.org/10.4324/9780203771686-8
Samad, A. (2004). Essentials of language testing for Malaysian teachers. UPM Press http://psasir.upm.edu.my/id/eprint/78579/
Seah, L. H. (2020). What student language reveals about the demands of learning the human circulatory system. Research in Science Education, 51(6), 1529–1547. https://doi.org/10.1007/s11165-020-09915-z
Sele, Y. (2019). Optimizing the potential of Children Learning in Science (CLIS) with brain gym: Review on human circulatory concepts. Biosfer, 12(2), 238–248. https://doi.org/10.21009/biosferjpb.v12n2.238-248
Steinmayr, R., Weidinger, A. F., Schwinger, M., & Spinath, B. (2019). The importance of students’ motivation for their academic achievement – replicating and extending previous findings. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.01730
Sudirtha, I. G., Widiana, I. W., & Adijaya, M. A. (2022). The effectiveness of using revised Bloom’s
Taxonomy-Oriented learning activities to improve students’ metacognitive abilities. Journal of
Education and E-learning Research, 9(2), 55–61. https://doi.org/10.20448/jeelr.v9i2.3804
Suskie, L. A. (2009). Assessing student learning: A common sense guide (2nd ed.). Jossey-Bass. https://www.utep.edu/student-affairs/_files/docs/assessment/assessing-student-learning-suskie-2.pdf
Taber, K. S. (2017). The use of Cronbach’s Alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
Tamil, A. M. (2015). Calculating difficulty, discrimination and reliability index/ standard error of measurement. PPUKM. https://ppukmdotorg.wordpress.com/2015/04/02/calculating-omr-indexes/
Wilbert, J., Grosche, M., & Gerdes, H. (2010). Effects of evaluative feedback on rate of learning and task motivation: An analogue experiment. Learning Disabilities: A Contemporary Journal, 8(2), 43–52. https://files.eric.ed.gov/fulltext/EJ914126.pdf
Wulandari, D. S., Prayitno, B. A., & Maridi, M. (2022). Developing the guided inquiry-based module on the circulatory system to improve student’s critical thinking skills. Jurnal Pendidikan Biologi Indonesia, 8(1), 77–85. https://doi.org/10.22219/jpbi.v8i1.16512
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with JPBI (Jurnal Pendidikan Biologi Indonesia) agree to the following terms:
- For all articles published in JPBI, copyright is retained by the authors. Authors give permission to the publisher to announce the work with conditions. When the manuscript is accepted for publication, the authors agree to automatic transfer of the publishing right to the publisher.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
