Developing interactive questions to measure the higher-order thinking skills of senior high schools’ students
DOI:
https://doi.org/10.22219/jpbi.v5i2.7747Keywords:
higher-order thinking skills, information technology, interactive questions,Abstract
The traditional assessments which only covered lower-order thinking skills are still commonly used by teachers in Palembang. Yet the 21st-Century education demands the empowerment of higher-order thinking skills (HOTS). The objective of this study was to find out the validity, practicality, and effectiveness of interactive questions in measuring students' HOTS. The research and development applied was 4-D model which included four stages (define, design, develop and disseminate). The study was conducted on the tenth graders of SMAN (Sekolah Menengah Atas Negeri-State Senior High School) 4 Palembang, and SMAN 9 Palembang, in the even semester of academic year 2018/2019. The instruments of data collection were validation sheets and interactive questions. The data analysis techniques used were Microsoft Excel 2010 and WINSTEPS version 3.73.0. In conclusion, the study showed that: 1) the expert validation results were very high category; 2) the instrument was considered as good by teacher responses; and 3) the interactive questions were effective in measuring students’ HOTS.
Downloads
References
Aiken, L. R. (1985). Psychological testing and assessment (5th ed.). Needham Heights, MA, US: Allyn & Bacon. Retrieved from https://psycnet.apa.org/record/1985-97221-000
Almeida, L. da S., & Franco, A. H. R. (2011). Critical thinking: Its relevance for education in a shifting society. Revista de Psicología, 29(1), 175–195. Retrieved from http://pepsic.bvsalud.org/scielo.php?script=sci_arttext&pid=S0254-92472011000100007
Azwar, S. (2012). Reliabilitas dan validitas (4th ed.). Yogyakarta: Pustaka Pelajar. Retrieved from https://scholar.google.com/scholar?cluster=12819496658226871221&hl=en&oi=scholarr
BKLM-Kemendikbud. (2016). Peringkat dan capaian PISA Indonesia mengalami peningkatan. 4 January 2016. Jakarta: Biro Komunikasi dan Layanan Masyarakat Kementerian Pendidikan dan Kebudayaan. Retrieved from https://www.kemdikbud.go.id/main/blog/2016/05/rumah-kunci-sukses-pola-asuh-anak
Brookhart, S. M. (2010). How to assess higher-order thinking skills in your classroom. Alexandria, VA-USA: ASCD. Retrieved from http://www.ascd.org/publications/books/109111.aspx
BSNP. (2013). Peraturan Menteri Pendidikan Pendidikan dan Kebudayaan Republik Indonesia Nomor 69 Tahun 2013 Tentang Kerangka Dasar dan Struktur Kurikulum Sekolah Menengah Atas/Madrasah Aliyah. Jakarta-Indonesia: BSNP. Retrieved from http://bsnp-indonesia.org/id/wp-content/uploads/2013/06/Salinan-Permendikbud-No.-69-th-2013-ttg-ttg-KD-dan-Struktur-Kurikulum-SMA-MA.zip
Budiman, A., & Jailani, J. (2014). Pengembangan instrumen asesmen higher order thinking skill (HOTS) pada mata pelajaran matematika SMP kelas VIII semester 1. Jurnal Riset Pendidikan Matematika, 1(2), 139–151. doi: https://doi.org/10.21831/jrpm.v1i2.2671
Cadorin, L., Bagnasco, A., Tolotti, A., Pagnucci, N., & Sasso, L. (2016). Instruments for measuring meaningful learning in healthcare students: A systematic psychometric review. Journal of Advanced Nursing, 72(9), 1972–1990. doi: https://doi.org/10.1111/jan.12926
Erfianti, L., Istiyono, E., & Kuswanto, H. (2019). Developing lup instrument test to measure higher order thinking skills (HOTS) Bloomian for senior high school students. International Journal of Educational Research Review, 4(3), 320–329. doi: https://doi.org/10.24331/ijere.573863
Gamel, C. J. (2007). Establishing the practicality of an instrument. In The 39th Biennial Convention. Retrieved from https://stti.confex.com/stti/bc39/techprogram/paper_36004.htm
Gardner, R. M. (2016). Clinical information systems – From yesterday to tomorrow. IMIA Yearbook, 62–75. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5171508/pdf/ymi-11-0s62.pdf
Ghani, I. B. A., Ibrahim, N. H., Yahaya, N. A., & Surif, J. (2017). Enhancing students’ HOTS in laboratory educational activity by using concept map as an alternative assessment tool. Chemistry Education Research and Practice. doi: https://doi.org/10.1039/C7RP00120G
Gunawan, I. (2017). Indonesian Curriculum 2013: Instructional management, obstacles faced by teachers in implementation and the way forward. In Advances in Social Science, Education and Humanities Research (Vol. 128, pp. 56–63). Atlantis Press. doi: https://doi.org/10.2991/icet-17.2017.9
Hugerat, M., & Kortam, N. (2014). Improving higher order thinking skills among freshmen by teaching science through inquiry. Eurasia Journal of Mathematics, Science and Technology Education, 10(5), 447–454. doi: https://doi.org/10.12973/eurasia.2014.1107a
Husamah, H., Fatmawati, D., & Setyawan, D. (2018). OIDDE learning model: Improving higher order thinking skills of biology teacher candidates. International Journal of Instruction, 11(2), 249–264. doi: https://doi.org/10.12973/iji.2018.11217a
Istiyono, E. (2017). The analysis of senior high school students’ physics HOTS in Bantul District measured using PhysReMChoTHOTS. AIP Conference Proceedings, 1868(August). doi: https://doi.org/10.1063/1.4995184
Istiyono, E., Mardapi, D., & Suparno. (2014). Pengembangan tes kemampuan berpikir tingkat tinggi Fisika (PhysTHOTS) untuk peserta didik. Jurnal Penelitian Dan Evaluasi Pendidikan, 18(1), 1–12. doi: https://doi.org/10.21831/pep.v18i1.2120
Jones, J. E. (1976). Instrumentation. In Criteria for evaluating instruments (1st ed., pp. 502–506). University Associates, Inc. doi: https://doi.org/10.1177/105960117600100417
Khoiriyah, A. J., & Husamah, H. (2018). Problem-based learning: Creative thinking skills, problem-solving skills, and learning outcome of seventh grade students. JPBI (Jurnal Pendidikan Biologi Indonesia), 4(2), 151–160. doi: https://doi.org/10.22219/jpbi.v4i2.5804
Khoiriyah, K., Jalmo, T., & Abdurrahman, A. (2018). Development of assessment instrument higher order thinking skills on science subjects for student grade eight junior high school. The Online Journal of New Horizons in Education, 8(2), 19–29. Retrieved from http://repository.lppm.unila.ac.id/3260/25/developement HOTS instruments.pdf
Kusaeri, K. (2014). Acuan dan teknik penilaian proses dan hasil belajar dalam kurikulum 2013 (I). Yogyakarta: Ar Ruzz Media. Retrieved from http://digilib.uinsby.ac.id/14615/
Kustijono, R., & Wiwin HM, E. (2017). Pandangan guru terhadap pelaksanaan kurikulum 2013 dalam pembelajaran fisika SMK di Kota Surabaya. Jurnal Penelitian Fisika Dan Aplikasinya (JPFA), 4(1), 1. doi: https://doi.org/10.26740/jpfa.v4n1.p1-14
Madhuri, G. V, Kantamreddi, V. S. S. N., & Goteti, L. N. S. P. (2012). Promoting higher order thinking skills using inquiry-based learning. European Journal of Engineering Education, 37(2), 117–123. doi: https://doi.org/10.1080/03043797.2012.661701
Miles, S., Fulbrook, P., & Mainwaring-Mägi, D. (2016). Evaluation of standardized instruments for use in universal screening of very early school-age children: suitability, technical adequacy, and usability. Journal of Psychoeducational Assessment, 36, 1–21. doi: https://doi.org/10.1177/0734282916669246
Nieveen, N. (1999). Prototyping to reach product quality. In J. an van den Akker, R. M. Branch, K. Gustafson, N. Nieveen, & T. Plomp (Eds.), Design approaches and tools in education and training (pp. 125–135). Switzerland: Springer, Dordrecht. doi: https://doi.org/10.1007/978-94-011-4255-7_10
Nofiana, M., Sajidan, S., & Puguh, P. (2014). Pengembangan instrumen evaluasi two-tier multiple choice question untuk mengukur keterampilan berpikir tingkat tinggi pada materi kingdom plantae. Jurnal Inkuiri, 3(2), 60–74. doi: https://doi.org/10.20961/inkuiri.v3i2.9694
Nursalam, Angriani, A. D., Darmawati, Baharuddin, & Aminuddin. (2018). Developing test instruments for measurement of students’ high-order thinking skill on mathematics in junior high school in Makassar. In Journal of Physics: Conference Series (Vol. 1028, pp. 1–5). doi: https://doi.org/10.1088/1742-6596/1028/1/012169
Papathanasiou, I. V., Kleisiaris, C. F., Fradelos, E. C., Kakou, K., & Kourkouta, L. (2014). Critical thinking: The development of an essential Skill for nursing students. Acta Informatica Medica, 22(4), 283–286. doi: https://doi.org/10.5455/aim.2014.22.283-286
Pramesti, B. N., Sajidan, S., Dwiastuti, S., & Setyaningsih, E. (2019). The feasibility of biology module based on Stim-HOTS models. JPBI (Jurnal Pendidikan Biologi Indonesia)J, 5(1), 101–108. doi: https://doi.org/10.22219/jpbi.v5i1.7385
Prasetyani, E., Hartono, Y., & Susanti, E. (2016). Kemampuan berpikir tingkat tinggi siswa kelas XI dalam pembelajaran trigonometri berbasis masalah di SMA Negeri 18 Palembang. Jurnal Gantang Pendidikan Matematika FKIP - UMRAH, 1(1), 31–40. doi: https://doi.org/10.31629/jg.v1i1.4
Pratama, G. S., & Retnawati, H. (2018). Urgency of higher order thinking skills (HOTS) content analysis in mathematics textbook. In Journal of Physics: Conference Series (Vol. 1097, pp. 1–8). IOP Publishing. doi: https://doi.org/10.1088/1742-6596/1097/1/012147
Purwanto, M. N. (2009). Prinsip-prinsip dan teknik evaluasi pengajaran (10th ed.). Bandung: Tri Remaja Rosdakarya. Retrieved from https://rosda.co.id/pendidikan-keguruan/418-prinsip-teknik-evaluasi-pengajaran.html
Puteh, M., Aziz, A. A. M. A., Tajudin, N. M., & Adnan, M. (2018). Developing a secondary mathematics higher order thinking skills assessment (SMHOTSA) instrument. Turkish Online Journal of Design Art and Communication, 8(SEPT), 1238–1246. doi: https://doi.org/10.7456/1080sse/166
Ramdiah, S., Abidinsyah, A., Royani, M., & Husamah, H. (2019). Understanding, planning, and implementation of HOTS by senior high school biology teachers in Banjarmasin-Indonesia. International Journal of Instruction, 12(1), 425–440. doi: https://doi.org/10.29333/iji.2019.12128a
Ramdiah, S., Abidinsyah, H., & Mayasari, R. (2018). Problem-based learning: Generates higher-order thinking skills of tenth graders in ecosystem concept. JPBI (Jurnal Pendidikan Biologi Indonesia), 4(1), 29–34. doi: https://doi.org/10.22219/jpbi.v4i1.5490
Ramesh, R., & Rao, U. R. (2015). Investigating the impact of in-class assignments on higher order thinking skills of students in engineering course. In Proceedings - 2015 International Conference on Learning and Teaching in Computing and Engineering, LaTiCE 2015 (pp. 95–99). IEEE. doi: https://doi.org/10.1109/LaTiCE.2015.37
Razmawaty, M., & Othman, L. (2017). Authentic assessment in assessing higher order thinking skills. International Journal Of Academic Research In Business And Social Sciences, 7(2), 466–476. doi: https://doi.org/10.6007/IJARBSS/v7-i2/2021
Retnawati, H., Djidu, H., Apino, E., & Anazifa, R. D. (2017). Teachers’ knowledge about higher-order thinking skills and its learning strategy. Problems of Education in The 21st Century, 76(2), 215–230. Retrieved from http://www.scientiasocialis.lt/pec/node/1121
Rofiah, E., Aminah, N. S., & Ekawati, E. Y. (2013). Penyusunan instrumen tes kemampuan berpikir tingkat tinggi Fisika pada siswa SMP. Jurnal Pendidikan Fisika, 1(2), 17–22. Retrieved from https://jurnal.fkip.uns.ac.id/index.php/pfisika/article/view/2797/1913
Sa’adah, A., Sugianto, & Sutarman. (2014). Pengembangan instrumen tes benar-salah untuk menilai kemampuan berpikir tingkat iinggi siswa pada materi dinamika rotasi dan kesetimbangan benda tegar. Jurusan Fisika - Fakultas MIPA Universitas Negeri Malang. Retrieved from http://jurnal-online.um.ac.id/data/artikel/artikel662F729E1D404633A7770C86049A5069.pdf
Setiawan, A., Malik, A., Suhandi, A., & Permanasari, A. (2018). Effect of higher order thinking laboratory on the improvement of critical and creative thinking skills. In IOP Conference Series: Materials Science and Engineering (Vol. 306, pp. 1–7). IOP Publishing. doi: https://doi.org/10.1088/1757-899X/306/1/012008
Silveira, M. B., Saldanha, R. P., Leite, J. C. de C., Silva, T. O. F. da, Silva, T., & Filippin, L. I. (2018). Construction and validation of content of one instrument to assess falls in the elderly. Einstein (São Paulo), 16(2), 1–8. doi: https://doi.org/10.1590/s1679-45082018ao4154
Steers, R. M. (1985). Efektivitas organisasi (1st ed.). Jakarta: Erlangga. Retrieved from http://kin.perpusnas.go.id/DisplayData.aspx?pId=128744&pRegionCode=UN11MAR&pClientId=112
Sumarni, W., Supardi, K. I., & Widiarti, N. (2018). Development of assessment instruments to measure critical thinking skills. In IOP Conference Series: Materials Science and Engineering (Vol. 349, pp. 1–11). IOP Publishing. doi: https://doi.org/10.1088/1757-899X/349/1/012066
Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan Rasch pada asessment pendidikan. (B. Trim, Ed.) (1st ed.). Cimahi: Trim Komunikata. Retrieved from https://www.researchgate.net/publication/282673464
Thiagarajaan, S., Semmel, D. G., & Semmel, M. I. (1974). Instructional development for training teachers of exceptional children: A sourcebook. Bloomington, Indiana: Indiana Univ., Center for Innovation in Teaching the Handicapped. Retrieved from https://files.eric.ed.gov/fulltext/ED090725.pdf
UNESCO. (2011). ICT in education. Retrieved May 23, 2019, from https://en.unesco.org/themes/ict-education
Wicaksono, D. P., Kusmayadi, T. A., & Usodo, B. (2014). Pengembangan perangkat pembelajaran matematika berbahasa inggris berdasarkan teori kecerdasan majemuk (multiple intelligences) pada materi balok dan kubus untuk kelas VIII SMP. Jurnal Elektronik Pembelajaran Matematika, 2(5), 534–549. Retrieved from https://jurnal.fkip.uns.ac.id/index.php/s2math/article/view/4378/3063
Williams, R. (2003). Terminology used in instrument accuracy (pp. 279–284). American school of gas measurement technology. Retrieved from https://asgmt.com/wp-content/uploads/pdf-docs/2003/1/55.pdf
Williams, R. G., Klamen, D. A., & McGaghie, W. C. (2003). Cognitive, social and environmental sources of bias in clinical performance ratings. Teaching and Learning in Medicine, 15(4), 270–292. doi: https://doi.org/10.1207/S15328015TLM1504_11
Yeager, D. S., & Lee Duckworth, A. (2015). Measurement matters: Assessing personal qualities other than cognitive ability for educational purposes. Educational Researcher, 44(4), 237–251. doi: https://doi.org/10.3102/0013189X15584327
Yonata, B., & Nasrudin, H. (2018). Laboratory activity worksheet to train high order thinking skill of student on surface chemistry lecture. In Journal of Physics: Conference Series (Vol. 947, pp. 1–7). IOP Publishing. https://doi.org/10.1088/1742-6596/947/1/012027
Downloads
Published
Issue
Section
License
Authors who publish with JPBI (Jurnal Pendidikan Biologi Indonesia) agree to the following terms:
- For all articles published in JPBI, copyright is retained by the authors. Authors give permission to the publisher to announce the work with conditions. When the manuscript is accepted for publication, the authors agree to automatic transfer of the publishing right to the publisher.
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
