Validating instrument to assess science literacy and independent learning skills in high school
DOI:
https://doi.org/10.22219/jpbi.v10i3.34770Keywords:
Science literacy, independent learning, nervous systemAbstract
Inadequate science literacy and independent learning hinder students' ability to analyze scientific information. This study aimed to develop and validate a measurement instrument to assess science literacy and independent learning skills among high school students. The instrument was piloted with 20 twelfth-grade students at SMAN 03 Kota Yogyakarta to assess its reliability and validity. The validated instrument was administered to 20 eleventh-grade students at the same school to identify the profiles of these two skills and explore their relationship in the context of the nervous system. The validity analysis demonstrated that both the science literacy and independent learning instruments exhibited strong validity. Pearson correlation analysis revealed that 20 items in the independent learning questionnaire were strongly correlated with the total score. Rasch analysis of the science literacy test indicated low infit mean square values, appropriate p-values, and high point biserial values, suggesting well-functioning items. Cronbach's alpha reliability coefficients for both instruments were excellent. The profile analysis revealed a discrepancy, with many students showing high independent learning levels but low science literacy scores on the nervous system topic. This gap suggests that even students capable of independent learning may face challenges in grasping specific scientific concepts.
Downloads
References
Aini, K. (2021). Students’ independent learning through blended learning with a flipped classroom model during the COVID-19 pandemic. Journal of Digital Literacy, 1(1), 42–49. https://doi.org/10.54065/jld.1.1.2021.7
Aithal, A., & Aithal, P. S. (2020). Development and validation of survey questionnaire and experimental data. International Journal of Management, Technology, and Social Sciences (IJMTS), 5(2), 233–251. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3724105
Al-Ajmy, S. S., & Al-Mutairi, M. A. (2023). The impact and future of student’s independent learning. Multi-Knowledge Electronic Comprehensive Journal For Education & Science Publications (MECSJ)., 68, 1–30. https://www.researchgate.net/publication/379431603_The_Impact_and_Future_of_Student’s_Independent_Learning
Belawati, T., Daryono, D., Sugilar, S., & Kusmawan, U. (2023). Development of an instrument to assess independent online learning readiness of high school students in Indonesia. Asian Association of Open Universities Journal, 18(1), 34–45. https://doi.org/10.1108/AAOUJ-09-2022-0139
Bellová, R., Melicherčíková, D., & Tomčík, P. (2018). Possible reasons for low scientific literacy of Slovak students in some natural science subjects. Research in Science and Technological Education, 36(2), 226–242. https://doi.org/10.1080/02635143.2017.1367656
Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. In Psychological Assessment (Vol. 7, Issue 3, pp. 309–319). https://doi.org/10.1037//1040-3590.7.3.309
Coppi, M., Fialho, I., & Cid, M. (2023). Developing a scientific literacy assessment instrument for Portuguese 3rd cycle students. Education Sciences, 13(9), 941. https://doi.org/10.3390/educsci13090941
Dantas, L. A., & Cunha, A. (2020). An integrative debate on learning styles and the learning process. Social Sciences and Humanities Open, 2(1), 100017. https://doi.org/10.1016/j.ssaho.2020.100017
Darling-Hammond, L., Flook, L., Cook-Harvey, C., Barron, B., & Osher, D. (2019). Implications for educational practice of the science of learning and development. Applied Developmental Science, 1–44. https://doi.org/10.1080/10888691.2018.1537791
DeBoer, G. E. (2000). Scientific literacy: Another look at its historical and contemporary meanings and its relationship to science education reform. Journal of Research in Science Teaching, 37(6), 582–601. https://doi.org/10.1002/1098-2736(200008)37:6<582::AID-TEA5>3.0.CO;2-L
Dragoş, V., & Mih, V. (2015). Scientific literacy in school. Procedia - Social and Behavioral Sciences, 209(July), 167–172. https://doi.org/10.1016/j.sbspro.2015.11.273
Dubinsky, J. M., Roehrig, G., & Varma, S. (2022). A Place for neuroscience in teacher knowledge and education. Mind, Brain, and Education, 16(4), 267–276. https://doi.org/10.1111/mbe.12334
Eberle, J., & Hobrecht, J. (2021). The lonely struggle with autonomy: A case study of first-year university students’ experiences during emergency online teaching. Computers in Human Behavior, 121(October 2020), 106804. https://doi.org/10.1016/j.chb.2021.106804
Essen, C. B., & Akpan, G. (2018). Analysis of difficulty and point-biserial correlation indices of 2014 akwa ibom state mock multiple choice mathematics test. International Journal of Education and Evaluation, 4(5), 1–11. https://ijee.io/get/IJEE/VOL. 4 NO. 5 2018/ANALYSIS OF DIFFICULTY.pdf
Faisal, S., Rusilowati, A., & Susilaningsih, E. (2023). Science literacy assessment instrument for additives and addictive substances: Development, validation, and Rasch model analysis. Jurnal Penelitian Pendidikan IPA, 9(10), 7826–7836. https://doi.org/10.29303/jppipa.v9i10.4376
Farhat, R. H. (2021). The impact of a balanced literacy program on the gradual release of the instructor’s accountability. International Journal of Childhood Education, 2(4), 32–41. https://doi.org/10.33422/ijce.v2i4.127
Filgona, J., Sakiyo, J., Gwany, D. M., & Okoronka, A. U. (2020). Motivation in learning. Asian Journal of Education and Social Studies, 16–37. https://doi.org/10.9734/ajess/2020/v10i430273
Franzese, M., & Iuliano, A. (2018). Correlation analysis. Encyclopedia of Bioinformatics and Computational Biology: ABC of Bioinformatics, 1–3, 706–721. https://doi.org/10.1016/B978-0-12-809633-8.20358-0
Hartono, A., Djulia, E., Hasruddin, H., & Jayanti, U. N. A. D. (2023). Biology students’ science literacy level on genetic concepts. Jurnal Pendidikan IPA Indonesia, 12(1), 146–152. https://doi.org/10.15294/jpii.v12i1.39941
He, L., Chen, Y., Xiong, X., Zou, X., & Lai, K. (2021). Does science literacy guarantee resistance to health rumors? The moderating effect of self-efficacy of science literacy in the relationship between science literacy and rumor belief. International Journal of Environmental Research and Public Health, 18(5), 2243. https://doi.org/10.3390/ijerph18052243
Hendrayana, A. S. (2014). Learning motivation, independent learning, and academic achievement of Bidikmisi scholarship students at UPBJJ UT Bandung. Journal of Open and Distance Learning, 15(2). https://doi.org/10.33830/ptjj.v15i2.591.2014
Hockings, C., Thomas, L., Ottaway, J., & Jones, R. (2018). Independent learning–what we do when you’re not there. Teaching in Higher Education, 23(2), 145–161. https://doi.org/10.1080/13562517.2017.1332031
Horton, F. . W. (2007). Understanding information literacy: A primer. https://www.voced.edu.au/content/ngv%3A61828
Jurecki, K., & Wander, M. C. F. (2012). Science literacy, critical thinking, and scientific literature: Guidelines for evaluating scientific literature in the classroom. Journal of Geoscience Education, 60(2), 100–105. https://doi.org/10.5408/11-221.1
Karunarathna, I., Gunasena, P., Hapuarachchi, T., Ekanayake, U., Rajapaksha, S., Gunawardana, K., Aluthge, P., Bandara, S., Jayawardana, A., Alvis, K. De, & Gunathilake1, S. (2024). The crucial role of data collection in research: Techniques, challenges, and the crucial role of data collection in research : techniques, challenges, and best practices. Uva Clinical Research, June. https://www.researchgate.net/publication/383155720_The_Crucial_Role_of_Data_Collection_in_Research_Techniques_Challenges_and_Best_Practices
Ke, L., Sadler, T. D., Zangori, L., & Friedrichsen, P. J. (2021). Developing and using multiple models to promote scientific literacy in the context of socio-scientific issues. Science & Education, 30(3), 589–607. https://doi.org/10.1007/s11191-021-00206-1
Kvello, P., & Gericke, N. (2021). Identifying knowledge important to teach about the nervous system in the context of secondary biology and science education-A Delphi study. In PLoS ONE (Vol. 16, Issue 12 December). https://doi.org/10.1371/journal.pone.0260752
Livingstone, S. (2004). Media literacy and the challenge of new information and communication technologies. The Communication Review, 7(March 2013), 86. https://doi.org/10.1080/10714420490280152
Pandiangan, P. (2023). The power of the physics independent learning model instrument in online tutorials to enhance independent learning skills and critical thinking skills. Advances in Social Sciences Research Journal, 10(4), 269–287. https://doi.org/10.14738/assrj.104.14564
Pyle, S. J. (2017). The instructional leadership role of the principal in independent schools: towards 21st century classrooms (Vol. 4, Issue February). University of South Africa. https://uir.unisa.ac.za/bitstream/handle/10500/22726/dissertation_pyle_sj.pdf
Rahmawati, Y., Supriatna, E., & Yuliani, W. (2022). Validitas dan reliabiltas angket kemandirian belajar siswa SMP. FOKUS (Kajian Bimbingan & Konseling Dalam Pendidikan), 5(3), 254–258. https://doi.org/10.22460/fokus.v5i3.7260
Reynders, G., Lantz, J., Ruder, S. M., Stanford, C. L., & Cole, R. S. (2020). Rubrics to assess critical thinking and information processing in undergraduate STEM courses. International Journal of STEM Education, 7(1). https://doi.org/10.1186/s40594-020-00208-5
Ridwan, M., & Ramdhan, F. (2021). Profile of science literacy skills of eighth-grade students on the concept of environmental pollution. Bioed: Journal of Biology Education, 8(1), 34. https://doi.org/10.25157/jpb.v8i1.5993
Sharon, A. J., & Baram‐Tsabari, A. (2020). Can science literacy help individuals identify misinformation in everyday life? Science Education, 104(5), 873–894. https://doi.org/10.1002/sce.21581
Shrestha, N. (2021). Factor analysis as a tool for survey analysis. American Journal of Applied Mathematics and Statistics, 9(1), 4–11. https://doi.org/10.12691/ajams-9-1-2
Sjöström, J., & Eilks, I. (2018). Reconsidering different visions of scientific literacy and science education based on the concept of bildung. In Cognition, Metacognition, and Culture in STEM Education. Innovations in Science Education and Technology (pp. 65–88). https://doi.org/10.1007/978-3-319-66659-4_4
Smith, A. B., Rush, R., Fallowfield, L. J., Velikova, G., & Sharpe, M. (2008). Rasch fit statistics and sample size considerations for polytomous data. BMC Medical Research Methodology, 8(1), 33. https://doi.org/10.1186/1471-2288-8-33
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd
Thiagarajan, S., Semmel, D. S., & Semmel, M. I. (1974). Instructional development for training teachers of exceptional children. Indiana University. https://files.eric.ed.gov/fulltext/ED090725.pdf
Valladares, L. (2021). Scientific literacy and social transformation. Science & Education, 30(3), 557–587. https://doi.org/10.1007/s11191-021-00205-2
Villanueva, M. G. (2010). Integrated teaching strategies model for improved scientific literacy in second-language learners (Issue January) https://www.mandela.ac.za/helpingteachers/GroupProjectWebb/MARY GRACE FLORES VILLANUEVA PhD.pdf
Wadkar, S. K., Singh, K., Chakravarty, R., & Argade, S. D. (2016). Assessing the reliability of attitude scale by Cronbach’s alpha. Journal of Global Communication, 9(2), 113. https://doi.org/10.5958/0976-2442.2016.00019.7
Wati, M., Mahtari, S., Muthi’ah, A., Dewantara, D., & Suharno, S. (2023). The scientific literacy test Instrument on particle dynamics for high school students. Asian Journal of Assessment in Teaching and Learning, 13(2), 46–56. https://doi.org/10.37134/ajatel.vol13.2.5.2023
Wege, K., Harso, A., & Wolo, D. (2022). Analysis of student learning independence during the pandemic. Journal of Research in Instructional, 2(1), 87–96. https://doi.org/10.30862/jri.v2i1.34
Zadworna, M., Kossakowska, K., & Renshaw, T. L. (2023). Measuring subjective wellbeing in a school context: A polish version of the student subjective wellbeing questionnaire. School Mental Health, 15(1), 231–246. https://doi.org/10.1007/s12310-022-09546-x
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with JPBI (Jurnal Pendidikan Biologi Indonesia) agree to the following terms:
- For all articles published in JPBI, copyright is retained by the authors. Authors give permission to the publisher to announce the work with conditions. When the manuscript is accepted for publication, the authors agree to automatic transfer of the publishing right to the publisher.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
