Diagnostic test assessment on protist misconception

Authors

  • Defita Raharjo Master of Science Education, Postgraduate School, Universitas Sebelas Maret, Jl. Ir. Sutami No. 36A, Surakarta, Central Java, 57126
  • Murni Ramli Department of Biology Education, Faculty of Teacher Training and Education, Universitas Sebelas Maret, Jl. Ir. Sutami No. 36A, Surakarta, Central Java, 57126
  • Yudi Rinanto Department of Biology Education, Faculty of Teacher Training and Education, Universitas Sebelas Maret, Jl. Ir. Sutami No. 36A, Surakarta, Central Java, 57126

DOI:

https://doi.org/10.22219/jpbi.v5i2.7685

Keywords:

assessment, diagnostic test, item quality analysis, misconception, protist

Abstract

One of the fatal problems emerge in educational practice is misconception as it is related to the students’ understanding. Consequently, these must be detected at the beginning of learning process. This research was conducted to construct and develop the specific diagnostic test to detect the misconception in protist material. The instrument consisted of, Evidence and Proof (EP), Structure Communication Grid (SCG), and essay. The instruments were analyzed to determine the validity, reliability, discriminatory power, and difficulty levels. As many as 351 students of grade X, XI, and XII were selected as the samples. The samples selected from three Public High Schools and three Private High Schools in Klaten Regency using stratified random sampling. The results showed that 93.10% of the columnar (EP) items, 100% of the SCG items, and 100% of the essay questions were valid; in which the all instruments were reliable. Based on discriminatory power analysis, of the three instruments developed, there was more than 50% of the items were classified as fair level. Whereas, the difficulty level of the instruments were balance. In general, the instruments can be accepted and used after revisions. These diagnostic test instruments can also be developed for another topic.

Downloads

Download data is not yet available.

References

Abdullah, C., Parris, J., Lie, R., Guzdar, A., & Tour, E. (2015). Critical analysis of primary literature in a master’s-level class: Effects on self-efficacy and science-process skills. CBE Life Sciences Education. doi: https://doi.org/10.1187/cbe.14-10-0180

Amin, A. M., & Adiansyah, R. (2018). Lecturers ’ perception on students ’ critical thinking skills development and problems faced by students in developing their critical thinking skills. JPBI (Jurnal Pendidikan Biologi Indonesia), 4(1), 1–10. doi: https://doi.org/10.22219/jpbi.v4i1.5181

Arimoto, M., & Clark, I. (2018). Equitable assessment interactions in the “Open Learning Environment” (OLE). European Journal of Education, 53(2), 141–143. doi: https://doi.org/10.1111/ejed.12277

Ary, D., Jacobs, L. C., Sorensen, C., & Razavieh, A. (2010). Introduction to research in education (Eighth). Belmont, CA: Wadsworth Cengage Learning. Retrieved from http://www.modares.ac.ir/uploads/Agr.Oth.Lib.12.pdf

Bahar, M. (2003). Misconceptions in biology education and conceptual change strategies. Educational Sciences: Theory & Practice, 3(1), 55–64. Retrieved from https://www.researchgate.net/publication/285749401_Misconceptions_in_biology_education_and_conceptual_change_strategies

Bahar, M., Aydin, F., & Karakirik, E. (2009). A diagnostic study of computer application of structural communication grid. The Turkish Online Journal of Educational Technology – TOJET, 8(2), 5–19. Retrieved from http://www.tojet.net/articles/v8i2/821.pdf

Bennett, B. (2016). Assessment and cooperative learning: The missing think. In Leadership of Assesment, Inclusion, and Learning (pp. 45–85). Springer. doi: https://doi.org/10.1007/978-3-319-23347-5

Borualogo, I. S., Kusdiyati, S., Susandari, S., & Sirodj, D. A. N. (2017). Analisis item soal UTS pedologi semester ganjil 2015-2016. SCHEMA - Journal of Psychological Research, 3(1), 46–57. Retrieved from https://ejournal.unisba.ac.id/index.php/schema/article/view/1808/1761

Chu, Y.-C. (2008). Learning difficulties in genetics and the development of related attitudes in Taiwanese junior high schools. Glasgow, Scotland: University of Glasgow. Retrieved from https://core.ac.uk/download/pdf/40064597 .pdf

de Bie, H., Wilhelm, P., & van der Meij, H. (2015). The Halpern critical thinking assessment: Toward a Dutch appraisal of critical thinking. Thinking Skills and Creativity, 17, 33–44. doi: https://doi.org/10.1016/j.tsc.2015.04.001

Duckworth, A. L., & Yeager, D. S. (2015). Measurement matters: assessing personal qualities other than cognitive ability for educational purposes. Educational Researcher, 44(4), 237–251. doi: https://doi.org/10.3102/0013189X15584327

Dunn, L., Morgan, C., Reilly, M. O., & Parry, S. (2003). The student assessment handbook. The Student Assessment Handbook. Routledge. doi: https://doi.org/10.4324/9780203416518

Durmus, S., & Karakirik, E. (2005). A computer assessment tool for structural communication grid. Tojet - The Turkish Online Journal of Educational Technology, 4(4), 3–6. Retrieved from https://files.eric.ed.gov/fulltext/EJ1102471.pdf

Fauzi, A., & Fariantika, A. (2018). Courses perceived difficult by undergraduate students majoring in biology. Biosfer, 11(2), 78–89. doi: https://doi.org/10.21009/biosferjpb.v11n2.78-89

Gengarelly, L. M., & Abrams, E. D. (2009). Closing the gap: Inquiry in research and the secondary science classroom. Journal of Science Education and Technology, 18(1), 74–84. doi: https://doi.org/10.1007/s10956-008-9134-2

Ghazali, N. H. M. (2016). A reliability and validity of an instrument to evaluate the school-based assessment system: A pilot study. International Journal of Evaluation and Research in Education (IJERE), 5(2), 148–157. Retrieved from https://files.eric.ed.gov/fulltext/EJ1108537.pdf

Gumilar, R. P., Wardani, S., & Lisdiana, L. (2019). The implementation of guided-inquiry learning models on the concept mastery, scientific attitude, and science process skill. Journal of Primary Education, 9(2), 148–154. doi: https://doi.org/10.15294 /jpe.v9i2.29256

Gurel, D. K., Eryilmaz, A., & McDermott, L. C. (2015). A review and comparison of diagnostic instruments to identify students’ misconceptions in science. Eurasia Journal of Mathematics, Science and Technology Education, 11(5), 989–1008. doi: https://doi.org/10.12973/eurasia.2015.1369a

Himschoot, A. R. (2012). Student perception of relevance of biology content to everyday life: A study in higher education biology courses. ProQuest Dissertations and Theses. Minneapolis, Minnesota, US: Capella University. Retrieved from https://pdfs.semanticscholar.org/0602/9c7adff8be68af0604a93c23adfae9ffe09e.pdf

Jagals, D., & Walt, M. Van Der. (2016). Enabling metacognitive skills for mathematics problem solving: a collective case study of metacognitive reflection and awareness. African Journal of Research in Mathematics, Science, and Technology Education, 20(2), 154–164. doi: https://doi.org/10.1080/18117295.2016.1192239

Johnstone, A. H., Bahar, M., & Hansell, M. H. (2000). Structural communication grids: A valuable assessment and diagnostic tool for science teachers. Journal of Biological Education, 34(2), 87–89. doi: https://doi.org/10.1080/00219266.2000.9655691

Kiliç, D., & Saǧlam, N. (2014). Students understanding of genetics concepts: The effect of reasoning ability and learning approaches. Journal of Biological Education, 48(2), 63–70. doi: https://doi.org/10.1080/00219266.2013.837402

Kloser, M. (2012). A place for the nature of biology in biology education. Electronic Journal of Science Education, 16(1), 1–18. Retrieved from http://ejse.southwestern.edu/article/viewFile/10994/7987

Kusnani, K., Muldayanti, N. D., & Rahayu, H. M. (2016). Analisis butir soal ulangan akhir semester ganjil pada mata pelajaran biologi kelas X MIA SMA Negeri 1 Sungai Raya tahun ajaran 2014/2015. Jurnal Biologi Education, 3(2), 42–52. doi: https://doi.org/10.29406/185

Lai, E. R. (2011). Critical thinking: A literature review. Pearson’s Research Reports. Retrieved from https://images.pearsonassess ments.com/images/tmrs/CriticalThinkingReviewFINAL.pdf

Lederman, N. G., Lederman, J. S., & Antink, A. (2013). Nature of science and scientific inquiry as contexts for the learning of science and achievement of scientific literacy. International Journal of Education in Mathematics Science and Technology (IJEMST), 1(3), 138–147. doi: https://doi.org/10.18404/ijemst. 19784

Logan, J. W., Lundberg, O. H., Roth, L., & Walsh, K. R. (2017). The effect of individual motivation and cognitive ability on student performance outcomes in a distance education environment. Journal of Learning in Higher Education, 13(1), 83. Retrieved from https://files.eric.ed.gov/fulltext/EJ1139727.pdf

Lukitasari, M., Susilo, H., Ibrohim, I., & Corebima, A. D. (2014). Lesson study in improving the role of e-portfolio on the metacognitive skill and concept comprehension: a study on cell biology subject in IKIP PGRI Madiun, Indonesia. American Journal of Educational Research, 2(10), 919–924. doi: https://doi.org/10.12691/education-2-10-11

Maryani, I., Martaningsih, S. T., & Bhakti, C. P. (2017). Module based on pedagogical content knowledge to increase the engagement and skills of the future teachers in designing a lesson plan. Journal of Education and Learning (EduLearn), 11(1), 91–102. doi: https://doi.org/10.11591/edulearn.v11i1.5758

McCowan, R. J., & McCowan, S. C. (1999). Item analysis for criterion-referenced tests. Center for Development of Human Services. New York: Buffalo State College. Retrieved from https://files.eric.ed.gov/fulltext/ED501716.pdf

McCrum, D. P. (2017). Evaluation of creative problem-solving abilities in undergraduate structural engineers through interdisciplinary problem-based learning. European Journal of Engineering Education, 42(6), 684–700. doi: https://doi.org/10.1080/03043797.2016.1216089

McNeill, M., Gosper, M., & Xu, J. (2012). Assessment choices to target higher order learning outcomes: The power of academic empowerment. Research in Learning Technology, 20(3), 283–296. doi: https://doi.org/10.3402/rlt.v20i0.17595

Mohajan, H. K. (2017). Two criteria for good measurements in research: Validity and reliability. Annals of Spiru Haret University. Economic Series, 17(4), 59–82. doi: https://doi.org/10.26458/1746

Naimnule, L., & Corebima, A. D. (2018). The correlation between metacognitive skills and critical thinking skills toward students ’ process skills in biology learning. Journal of Pedagogical Research, 2(2), 122–134. Retrieved from http://ijopr.com/index.php/ijopr/article/view/50/24

Novitasari, C., Ramli, M., & Karyanto, P. (2018). Facts and proofs diagnostic test and structural communication grid test on the topic of bacteria: A quantitative analysis. Jurnal Pendidikan Biologi Indonesia, 4(3), 195–202. doi: https://doi.org/10.22219/jpbi.v4i3.6166

Onions, P. (2009). Thinking critically: An introduction (Working paper: Prepared for MSc students). Leeds, United Kingdom: Leeds Metropolitan University. Retrieved from http://www.patrickonions.org/docs/academic/2009%20Thinking%20critically.pdf

Osborne, J., Erduran, S., & Simon, S. (2004). Ideas, evidence & argument in science. London: King’s College London. Retrieved from http://www.missionliteracy.com/uploads/3/4/4/5/34456187/21139-ideas_resourcepack.pdf

Raaijmakers, S. F., Baars, M., Schaap, L., Paas, F., van Merriënboer, J., & van Gog, T. (2018). Training self-regulated learning skills with video modeling examples: do task-selection skills transfer? Instructional Science, 46(2), 273–290. doi: https://doi.org/10.1007/s11251-017-9434-0

Raharjo, D., Ramli, M., & Rinanto, Y. (2018). Misconception protist in high school biology textbooks. In International semince on Mathematics and Science Education (Vol. 3, pp. 85–90). Retrieved from http://science.conference.upi.edu/proceeding/index.php/ICMScE/article/download/154/143/

Ramdani, Y. (2012). Pengembangan instrumen dan bahan ajar untuk meningkatkan kemampuan komunikasi, penalaran, dan koneksi matematis dalam konsep integral. Jurnal Penelitian Pendidikan, 13(1), 44–52. Retrieved from http://jurnal.upi.edu/file/6-yani_ramdhani.pdf

Ramdiah, S., Abidinsyah, Royani, M., & Husamah. (2019). Understanding, planning, and implementation of HOTS by senior high school biology teachers in Banjarmasin-Indonesia. International Journal of Instruction, 12(1), 425-440. doi: http://doi.org/10.29333/iji.2019.12128a

Ratnaningsih, A., Widianti, T., & Pukan, K. K. (2013). Analisis kualitas soal-soal try out ujian nasional mata pelajaran IPA SMP di Kabupaten Banjarnegara. Unnes Journal of Biology Education, 2(1), 34–40. Retrieved from https://journal.unnes.ac.id/sju/index.php/ujbe/article/view/2612/2403

Rusilowati, A. (2009). Psikologi kognitif sebagai dasar pengembangan tes kemampuan dasar membaca bidang sains. Jurnal Penelitian dan Evaluasi Pendidikan, 13(2), 286–303. doi: https://doi.org/10.21831/pep.v13i2.1414

Sasongko, P. (2010). Perbandingan keefektifan bentuk tes uraian dan testlet dengan penerapan graded response model (GRM). Jurnal Penelitian dan Evaluasi Pendidikan, 14(2), 269–288. Retrieved from https://journal.uny.ac.id/index.php/jpep/article/view/1082/865

Sukarno, S., Permanasari, A., & Hamidah, I. (2013). The profile of science process skill (SPS) student at secondary high school (Case study in Jambi). International Journal of Scientific Engineering and Research (IJSER), 1(1), 79–83. Retrieved from https://www.ijser.in/archives/v1i1/MDExMzA5MTg=.pdf

Suwono, H. (2016). School literary movement in Indonesia: Challenges for scientific literacy. Paper Presented at International Conference on Education, 309–317. Malang, East Java-Indonesia: Graduate School of Universitas Negeri Malang. Retrieved from http://pasca.um.ac.id/conferences/ index.php/ice/article/view/44/41

Suwono, H., Prasetyo, T. I., Lestari, U., Lukiati, B., Kusairi, S., Saefi, M., & Fauzi, A. (2019). Cell biology diagnostic test (CBD-Test) portrays pre-service teacher misconceptions about biology cell. Journal of Biological Education, 0(0), 1–24. doi: https://doi.org/10.1080/00219266.2019.1643765

Taherdoost, H. (2018). Validity and reliability of the research instrument: How to test the validation of a questionnaire/survey in a research. SSRN Electronic Journal, 5(3), 28–36. doi: https://doi.org/10.2139/ssrn.3205040

Thompson, N. A. (2013). Reliability & Validity. St. Paul, Minnesota-US: Assessment Systems Worldwide, LLC. Retrieved from https://www.assess.com/docs/Test-reliability-and-validity.pdf

Topçu, M. S., & Şahin-Pekmez, E. (2009). Turkish middle school students’ difficulties in learning genetics concepts. Journal of Turkish Science Education, 6(2), 55–62. Retrieved from http://www.tused.org/internet/tused/archive/v6/i2/text/tusedv6i2s5.pdf

Wijayaningputri, A. R., Widodo, W., & Munasir, M. (2018). The effect of guided-inquiry model on science process skills indicators. JPPS (Jurnal Penelitian Pendidikan Sains), 8(1), 1542–1546. Retrieved from https://journal.unesa.ac.id/index.php/jpps/article/view/3856/2187

Wilkin, C. L. (2017). Enhancing critical thinking: accounting students’ perceptions. Education + Training, 59(1), 15–30. doi: https://doi.org/10.1108/ET-01-2015-0007

Yates, T. B., & Marek, E. A. (2014). Teachers teaching misconceptions: A study of factors contributing to high school biology students’ acquisition of biological evolution-related misconceptions. Evolution: Education and Outreach, 7(7), 1–18. doi: https://doi.org/10.1186/s12052-014-0007-2

Zubaidah, S., Corebima, A. D., & Mistianah. (2015). Asesmen berpikir kritis terintegrasi tes essay. In Symbion: Symposium on Biology Education (pp. 200–213). Yogyakarta-Indonesia: Department of Biologi Education, Faculty of Teacher Training And Education Universitas Ahmad Dahlan. Retrieved from https://drive.google.com/file/d/0B4keDkb86kWpd0xRTjFlYVBjcEE/view

Downloads

Published

2019-07-15

Issue

Section

Academic Achievement and Learning Difficulties