Concept inventory test on cellular respiration for senior high school students: An assessment of reliability and validity

Authors

  • John Daryl C. Bace Cebu Technological University, Philippines
  • Shaina D. Guiral Cebu Technological University, Philippines
  • Nichelle Karla C. Galicia Cebu Technological University, Philippines
  • Mark Jay Reyes Cebu Technological University, Philippines
  • Sylvester Cortes Cebu Technological University, Philippines

DOI:

https://doi.org/10.22219/jpbi.v10i3.36635

Keywords:

assessment, concept inventory test, cellular respiration, science education, senior high school

Abstract

Given the complexity of cellular respiration, there is a significant need for effective assessment tools that can accurately gauge students’ understanding, identify misconceptions, and provide educators with actionable insights to improve instruction. Concept Inventory Test (CIT) has emerged as a valuable instrument in science education for this purpose. The aim of this study is to develop a Concept Inventory Test on cellular respiration and assess its reliability and validity. This study employed a mixed-method sequential exploratory approach for each assessment. The study was conducted in a private school in Cebu, targeting the senior high school students. The results of the study showed that the developed Concept Inventory Test’s reliability and validity are made apparent by the process used to gather supporting data, as well as by the findings and observations. Furthermore, this Concept Inventory Test serves a significant instrument for classroom assessment, promotes additional research on students’ critical comprehension, and shows how these diagnostic inventories link to the students’ competencies. However, a greater number of respondents should be taken to account to observe the consistency of the Concept Inventory Test results.

Downloads

Download data is not yet available.

References

Adams, W. K., & Wieman, C. E. (2010). Development and validation of instruments to measure learning of expert-like thinking. International Journal of Science Education, 33(9), 1289-1312. https://doi.org/10.1080/09500693.2010.512369

Aligway, G. B., Delos Angeles, J. C., Collano, A. V., Barroca, E. P., Aves, A. D., Catubay, J. F., Edjec, J.T., Butaya, M.D., & Cortes, S. T. (2024). Validity and reliability of a concept inventory test in human physiology. Jurnal Pendidikan Biologi Indonesia, 10(1), 265-274. https://doi.org/10.22219/jpbi.v10i1.29558

Bhat, S. K & Prasad, K. H. L. (2020). Item analysis and optimizing multiple-choice questions for a viable question bank in ophthalmology. Indian Journal of Opthalmology, 69(2), 343-346.

http://doi.org/ 10.4103/ijo.IJO_1610_20

Bybee, R. W. (2014). NGSS and the next generation of science teachers. Journal of Science Teacher Education, 25(2), 211-221. https://doi.org/10.1007/s10972-014-9381-4

Caldwell, D. J., & Pate, A. N. (2013). Effects of question formats on student and item performance. American Journal of Pharmaceutical Education, 77(4), 71.

http://doi.org/10.5688/ajpe77471

Dauer, J. T., & Long, T. M. (2015). Long-term conceptual retrieval by college biology majors followinhg model-based instruction. Journal of Research in Science Teaching, 52(8), 118-1206. https://doi.org/10.1002/tea.21258

DiBattista, D., & Kurzawa, L. (2011). Examination of the Quality of Multiple-choice Items on Classroom Tests. The Canadian Journal for the Scholarship of Teaching and Learning, 2(2), 25. http://dx.doi.org/10.5206/cjsotl-rcacea.2011.2.4

Ebel, R. L., & Frisbie, D. A. (1972). Essentials of Educational Measurement (5th Edition ed.). Prentice-Hall International, Inc.

Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wnderoth, M. P. (2014). Active learning increases student perfromance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111(23), 8410-8415. https://doi.org/10.1073/pnas.1319030111

Liu, T.C., Lin, Y.C., & Tsai, C.C. (2009). Identifying senior high school students’ misconceptions about statistical correlation, and their possible causes: an exploratory study using concept mapping with interviews. International Journal of Science and Mathematics Education, 7, 791–820. https://doi.org/10.1007/s10763-008-9142-y

Madsen, A., McKagan, S. B., & Sayre, E. C. (2017). Best Practices for administering concept inventories. The Physics Teacher, 55(9), 530-536. https://doi.org/10.1119/1.5011826

McNeish, D. (2017). Thanks Coefficient alpha, we'll take it from here. Psychological Methods, 23(3), 412-433. https://doi.org/10.1037/met0000144

Messick, S. (1989). Validity. New York: American Councsil on Education and Macmilan Publishing Company.

Moradas, J. D., Socubas, F. B., Bacasmas, V. M. R., Arquilita, S. G. L., & Cortes, S. T.(2024).Development and validation of a concept inventory test inphotosynthesis for junior high schoolstudents. JPBI (Jurnal Pendidikan Biologi Indonesia), 10(3),898-908.https://doi.org/10.22219/jpbi.v10i3.36634

Nadanaciva, S., Rana, P., Beeson, G. C., Chen, D., Ferrick, D. A., Beeson, C. C., & Will, Y. (2012). Assessment of drug-induced mitochondrial dysfunction via altered cellular respiration and acidification measured in a 96-well platform. Journal of Bioenergetics and Biomembranes, 44(4), 421-437. https://doi.org/10.1007/s10863-012-9446-z

Odukoya, J. A., Adekeye, O., Igbinoba, A. O., & Afolabi, A. (2017). Item analysis of university-wide multiple choice objective examinations: the experience of a Nigerian private university. Quality & Quantity, 52, 983–997. https://doi.org/10.1007/s11135-017-0499-2

Raimondi, V., Ciccarese, F., & Ciminale, V. (2020). Oncogenic pathways and the electron transport chain: a dangeROS liaison. British Journal of Cancer, 122, 168-181. https://doi.org/10.1038/s41416-019-0651-y

Ramos, A. C., & Ramos. (2022). Exploring Life Through Science Series. Phoenix Publishing House.

Rezigalla, A. A., Eleragi, A. M., Elhussein, A. B., Alfaifi, J., ALGhamdi, M. A., Al Ameer, A. Y., Yahia, A. I. O., Mohammed, O.A., & Adam, M. I. E. (2024). Item analysis: the impact of distractor efficiency on the difficulty index and discrimination power of multiple-choice items. BMC Medical Education, 24. https://doi.org/10.1186/s12909-024-05433-y

Shin, J., Guo, Q., & Gierl, M. J. (2019). Multiple-choice item distractor development using Topic Modeling Approaches. Frontiers Psychology, 10, 825. http://doi.org/10.3389/fpsyg.2019.00825

Smith, J. I., & Tanner, K. (2017). The problem of revealing how students think: Concept inventories and beyond. CBE- Life Sciences Education, 9(1), 1-5. https://doi.org/10.1187/cbe.09-12-0094

Taber, K. S. (2017). The use of Cronbach’s Alpha when developing and reporting research instruments in science education. Research in Science Education, 48, 1273-1296. https://doi.org/10.1007/s11165-016-9602-2

Testa, S., Toscano, A., & Rosato, R. (2018). Distractor efficiency in an item pool for a statistics classroom exam: Assessing its relation with item cognitive level classified according to bloom’s taxonomy. Frontiers in Psychology, 9. http://doi.org/ 10.3389/fpsyg.2018.01585

Voet, D., Voet, J. G., & Pratt, C. W. (2006). Fundamentals of biochemistry: Life at the molecular level (5th ed.). John Wiley & Sons.

Willems, I., Vera, V., Calders, P., Lapauw, B., & Craemer, M. D. (2023). Test–retest reliability and internal consistency of a newly developed questionnaire to assess explanatory variables of 24-h movement behaviors in adults. International Journal of Environmental Research and Public Health, 20(5). https://doi.org/10.3390/ ijerph20054407

Winanda, G. Z., & Anwar, D. (2022). Analysis of the implementation of higher-order thinking skills in tasks and test of English subject at SMK Negeri 2 Padang. In Proceedings of the 67th TEFLIN International Virtual Conference & the 9th ICOELT 2021 (pp. 106–109). Atlantis Press. https://doi.org/10.2991/assehr.k.220201.019.

Wind, S. A., Alemdar, M., Lingle, J. A., Moore, R., & Asilkalkan, A. (2019). Exploring student understanding of the engineering design process using distractor analysis. International Journal of STEM Education, 6(1), 4. https://doi.org/10.1186/s40594-019-0163-6

Zhao, R. Z., Jiang, S., Zhang, L., & Yu, Z. B. (2019). Mitochondrial electron transport chain, ROS generation and uncoupling (Review). International Journal of Molecular Medicine, 44(1), 3-15. https://doi.org/10.3892/ijmm.2019.4188

Downloads

Published

2024-11-30

Issue

Vol. 10 No. 3 (2024): NOVEMBER

Section

Academic Achievement and Learning Difficulties

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Authors who publish with JPBI (Jurnal Pendidikan Biologi Indonesia) agree to the following terms:

  1. For all articles published in JPBI, copyright is retained by the authors. Authors give permission to the publisher to announce the work with conditions. When the manuscript is accepted for publication, the authors agree to automatic transfer of the publishing right to the publisher.
  2. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
  3. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  4. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.