Developing interactive questions to measure the higher-order thinking skills of senior high schools’ students

A. Afandi, Saleh Hidayat, Indawan Syahri


Abstract


The traditional assessments which only covered lower-order thinking skills are still commonly used by teachers in Palembang. Yet the 21st-Century education demands the empowerment of higher-order thinking skills (HOTS). The objective of this study was to find out the validity, practicality, and effectiveness of interactive questions in measuring students' HOTS. The research and development applied was 4-D model which included four stages (define, design, develop and disseminate). The study was conducted on the tenth graders of SMAN (Sekolah Menengah Atas Negeri-State Senior High School) 4 Palembang, and SMAN 9 Palembang, in the even semester of academic year 2018/2019. The instruments of data collection were validation sheets and interactive questions. The data analysis techniques used were Microsoft Excel 2010 and WINSTEPS version 3.73.0. In conclusion, the study showed that: 1) the expert validation results were very high category; 2) the instrument was considered as good by teacher responses; and 3) the interactive questions were effective in measuring students’ HOTS.


Keywords


higher-order thinking skills; information technology; interactive questions;

Full Text:

PDF

References


Aiken, L. R. (1985). Psychological testing and assessment (5th ed.). Needham Heights, MA, US: Allyn & Bacon. Retrieved from https://psycnet.apa.org/record/1985-97221-000

Almeida, L. da S., & Franco, A. H. R. (2011). Critical thinking: Its relevance for education in a shifting society. Revista de Psicología, 29(1), 175–195. Retrieved from http://pepsic.bvsalud.org/scielo.php?script=sci_arttext&pid=S0254-92472011000100007

Azwar, S. (2012). Reliabilitas dan validitas (4th ed.). Yogyakarta: Pustaka Pelajar. Retrieved from https://scholar.google.com/scholar?cluster=12819496658226871221&hl=en&oi=scholarr

BKLM-Kemendikbud. (2016). Peringkat dan capaian PISA Indonesia mengalami peningkatan. 4 January 2016. Jakarta: Biro Komunikasi dan Layanan Masyarakat Kementerian Pendidikan dan Kebudayaan. Retrieved from https://www.kemdikbud.go.id/main/blog/2016/05/rumah-kunci-sukses-pola-asuh-anak

Brookhart, S. M. (2010). How to assess higher-order thinking skills in your classroom. Alexandria, VA-USA: ASCD. Retrieved from http://www.ascd.org/publications/books/109111.aspx

BSNP. (2013). Peraturan Menteri Pendidikan Pendidikan dan Kebudayaan Republik Indonesia Nomor 69 Tahun 2013 Tentang Kerangka Dasar dan Struktur Kurikulum Sekolah Menengah Atas/Madrasah Aliyah. Jakarta-Indonesia: BSNP. Retrieved from http://bsnp-indonesia.org/id/wp-content/uploads/2013/06/Salinan-Permendikbud-No.-69-th-2013-ttg-ttg-KD-dan-Struktur-Kurikulum-SMA-MA.zip

Budiman, A., & Jailani, J. (2014). Pengembangan instrumen asesmen higher order thinking skill (HOTS) pada mata pelajaran matematika SMP kelas VIII semester 1. Jurnal Riset Pendidikan Matematika, 1(2), 139–151. doi: https://doi.org/10.21831/jrpm.v1i2.2671

Cadorin, L., Bagnasco, A., Tolotti, A., Pagnucci, N., & Sasso, L. (2016). Instruments for measuring meaningful learning in healthcare students: A systematic psychometric review. Journal of Advanced Nursing, 72(9), 1972–1990. doi: https://doi.org/10.1111/jan.12926

Erfianti, L., Istiyono, E., & Kuswanto, H. (2019). Developing lup instrument test to measure higher order thinking skills (HOTS) Bloomian for senior high school students. International Journal of Educational Research Review, 4(3), 320–329. doi: https://doi.org/10.24331/ijere.573863

Gamel, C. J. (2007). Establishing the practicality of an instrument. In The 39th Biennial Convention. Retrieved from https://stti.confex.com/stti/bc39/techprogram/paper_36004.htm

Gardner, R. M. (2016). Clinical information systems – From yesterday to tomorrow. IMIA Yearbook, 62–75. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5171508/pdf/ymi-11-0s62.pdf

Ghani, I. B. A., Ibrahim, N. H., Yahaya, N. A., & Surif, J. (2017). Enhancing students’ HOTS in laboratory educational activity by using concept map as an alternative assessment tool. Chemistry Education Research and Practice. doi: https://doi.org/10.1039/C7RP00120G

Gunawan, I. (2017). Indonesian Curriculum 2013: Instructional management, obstacles faced by teachers in implementation and the way forward. In Advances in Social Science, Education and Humanities Research (Vol. 128, pp. 56–63). Atlantis Press. doi: https://doi.org/10.2991/icet-17.2017.9

Hugerat, M., & Kortam, N. (2014). Improving higher order thinking skills among freshmen by teaching science through inquiry. Eurasia Journal of Mathematics, Science and Technology Education, 10(5), 447–454. doi: https://doi.org/10.12973/eurasia.2014.1107a

Husamah, H., Fatmawati, D., & Setyawan, D. (2018). OIDDE learning model: Improving higher order thinking skills of biology teacher candidates. International Journal of Instruction, 11(2), 249–264. doi: https://doi.org/10.12973/iji.2018.11217a

Istiyono, E. (2017). The analysis of senior high school students’ physics HOTS in Bantul District measured using PhysReMChoTHOTS. AIP Conference Proceedings, 1868(August). doi: https://doi.org/10.1063/1.4995184

Istiyono, E., Mardapi, D., & Suparno. (2014). Pengembangan tes kemampuan berpikir tingkat tinggi Fisika (PhysTHOTS) untuk peserta didik. Jurnal Penelitian Dan Evaluasi Pendidikan, 18(1), 1–12. doi: https://doi.org/10.21831/pep.v18i1.2120

Jones, J. E. (1976). Instrumentation. In Criteria for evaluating instruments (1st ed., pp. 502–506). University Associates, Inc. doi: https://doi.org/10.1177/105960117600100417

Khoiriyah, A. J., & Husamah, H. (2018). Problem-based learning: Creative thinking skills, problem-solving skills, and learning outcome of seventh grade students. JPBI (Jurnal Pendidikan Biologi Indonesia), 4(2), 151–160. doi: https://doi.org/10.22219/jpbi.v4i2.5804

Khoiriyah, K., Jalmo, T., & Abdurrahman, A. (2018). Development of assessment instrument higher order thinking skills on science subjects for student grade eight junior high school. The Online Journal of New Horizons in Education, 8(2), 19–29. Retrieved from http://repository.lppm.unila.ac.id/3260/25/developement HOTS instruments.pdf

Kusaeri, K. (2014). Acuan dan teknik penilaian proses dan hasil belajar dalam kurikulum 2013 (I). Yogyakarta: Ar Ruzz Media. Retrieved from http://digilib.uinsby.ac.id/14615/

Kustijono, R., & Wiwin HM, E. (2017). Pandangan guru terhadap pelaksanaan kurikulum 2013 dalam pembelajaran fisika SMK di Kota Surabaya. Jurnal Penelitian Fisika Dan Aplikasinya (JPFA), 4(1), 1. doi: https://doi.org/10.26740/jpfa.v4n1.p1-14

Madhuri, G. V, Kantamreddi, V. S. S. N., & Goteti, L. N. S. P. (2012). Promoting higher order thinking skills using inquiry-based learning. European Journal of Engineering Education, 37(2), 117–123. doi: https://doi.org/10.1080/03043797.2012.661701

Miles, S., Fulbrook, P., & Mainwaring-Mägi, D. (2016). Evaluation of standardized instruments for use in universal screening of very early school-age children: suitability, technical adequacy, and usability. Journal of Psychoeducational Assessment, 36, 1–21. doi: https://doi.org/10.1177/0734282916669246

Nieveen, N. (1999). Prototyping to reach product quality. In J. an van den Akker, R. M. Branch, K. Gustafson, N. Nieveen, & T. Plomp (Eds.), Design approaches and tools in education and training (pp. 125–135). Switzerland: Springer, Dordrecht. doi: https://doi.org/10.1007/978-94-011-4255-7_10

Nofiana, M., Sajidan, S., & Puguh, P. (2014). Pengembangan instrumen evaluasi two-tier multiple choice question untuk mengukur keterampilan berpikir tingkat tinggi pada materi kingdom plantae. Jurnal Inkuiri, 3(2), 60–74. doi: https://doi.org/10.20961/inkuiri.v3i2.9694

Nursalam, Angriani, A. D., Darmawati, Baharuddin, & Aminuddin. (2018). Developing test instruments for measurement of students’ high-order thinking skill on mathematics in junior high school in Makassar. In Journal of Physics: Conference Series (Vol. 1028, pp. 1–5). doi: https://doi.org/10.1088/1742-6596/1028/1/012169

Papathanasiou, I. V., Kleisiaris, C. F., Fradelos, E. C., Kakou, K., & Kourkouta, L. (2014). Critical thinking: The development of an essential Skill for nursing students. Acta Informatica Medica, 22(4), 283–286. doi: https://doi.org/10.5455/aim.2014.22.283-286

Pramesti, B. N., Sajidan, S., Dwiastuti, S., & Setyaningsih, E. (2019). The feasibility of biology module based on Stim-HOTS models. JPBI (Jurnal Pendidikan Biologi Indonesia)J, 5(1), 101–108. doi: https://doi.org/10.22219/jpbi.v5i1.7385

Prasetyani, E., Hartono, Y., & Susanti, E. (2016). Kemampuan berpikir tingkat tinggi siswa kelas XI dalam pembelajaran trigonometri berbasis masalah di SMA Negeri 18 Palembang. Jurnal Gantang Pendidikan Matematika FKIP - UMRAH, 1(1), 31–40. doi: https://doi.org/10.31629/jg.v1i1.4

Pratama, G. S., & Retnawati, H. (2018). Urgency of higher order thinking skills (HOTS) content analysis in mathematics textbook. In Journal of Physics: Conference Series (Vol. 1097, pp. 1–8). IOP Publishing. doi: https://doi.org/10.1088/1742-6596/1097/1/012147

Purwanto, M. N. (2009). Prinsip-prinsip dan teknik evaluasi pengajaran (10th ed.). Bandung: Tri Remaja Rosdakarya. Retrieved from https://rosda.co.id/pendidikan-keguruan/418-prinsip-teknik-evaluasi-pengajaran.html

Puteh, M., Aziz, A. A. M. A., Tajudin, N. M., & Adnan, M. (2018). Developing a secondary mathematics higher order thinking skills assessment (SMHOTSA) instrument. Turkish Online Journal of Design Art and Communication, 8(SEPT), 1238–1246. doi: https://doi.org/10.7456/1080sse/166

Ramdiah, S., Abidinsyah, A., Royani, M., & Husamah, H. (2019). Understanding, planning, and implementation of HOTS by senior high school biology teachers in Banjarmasin-Indonesia. International Journal of Instruction, 12(1), 425–440. doi: https://doi.org/10.29333/iji.2019.12128a

Ramdiah, S., Abidinsyah, H., & Mayasari, R. (2018). Problem-based learning: Generates higher-order thinking skills of tenth graders in ecosystem concept. JPBI (Jurnal Pendidikan Biologi Indonesia), 4(1), 29–34. doi: https://doi.org/10.22219/jpbi.v4i1.5490

Ramesh, R., & Rao, U. R. (2015). Investigating the impact of in-class assignments on higher order thinking skills of students in engineering course. In Proceedings - 2015 International Conference on Learning and Teaching in Computing and Engineering, LaTiCE 2015 (pp. 95–99). IEEE. doi: https://doi.org/10.1109/LaTiCE.2015.37

Razmawaty, M., & Othman, L. (2017). Authentic assessment in assessing higher order thinking skills. International Journal Of Academic Research In Business And Social Sciences, 7(2), 466–476. doi: https://doi.org/10.6007/IJARBSS/v7-i2/2021

Retnawati, H., Djidu, H., Apino, E., & Anazifa, R. D. (2017). Teachers’ knowledge about higher-order thinking skills and its learning strategy. Problems of Education in The 21st Century, 76(2), 215–230. Retrieved from http://www.scientiasocialis.lt/pec/node/1121

Rofiah, E., Aminah, N. S., & Ekawati, E. Y. (2013). Penyusunan instrumen tes kemampuan berpikir tingkat tinggi Fisika pada siswa SMP. Jurnal Pendidikan Fisika, 1(2), 17–22. Retrieved from https://jurnal.fkip.uns.ac.id/index.php/pfisika/article/view/2797/1913

Sa’adah, A., Sugianto, & Sutarman. (2014). Pengembangan instrumen tes benar-salah untuk menilai kemampuan berpikir tingkat iinggi siswa pada materi dinamika rotasi dan kesetimbangan benda tegar. Jurusan Fisika - Fakultas MIPA Universitas Negeri Malang. Retrieved from http://jurnal-online.um.ac.id/data/artikel/artikel662F729E1D404633A7770C86049A5069.pdf

Setiawan, A., Malik, A., Suhandi, A., & Permanasari, A. (2018). Effect of higher order thinking laboratory on the improvement of critical and creative thinking skills. In IOP Conference Series: Materials Science and Engineering (Vol. 306, pp. 1–7). IOP Publishing. doi: https://doi.org/10.1088/1757-899X/306/1/012008

Silveira, M. B., Saldanha, R. P., Leite, J. C. de C., Silva, T. O. F. da, Silva, T., & Filippin, L. I. (2018). Construction and validation of content of one instrument to assess falls in the elderly. Einstein (São Paulo), 16(2), 1–8. doi: https://doi.org/10.1590/s1679-45082018ao4154

Steers, R. M. (1985). Efektivitas organisasi (1st ed.). Jakarta: Erlangga. Retrieved from http://kin.perpusnas.go.id/DisplayData.aspx?pId=128744&pRegionCode=UN11MAR&pClientId=112

Sumarni, W., Supardi, K. I., & Widiarti, N. (2018). Development of assessment instruments to measure critical thinking skills. In IOP Conference Series: Materials Science and Engineering (Vol. 349, pp. 1–11). IOP Publishing. doi: https://doi.org/10.1088/1757-899X/349/1/012066

Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan Rasch pada asessment pendidikan. (B. Trim, Ed.) (1st ed.). Cimahi: Trim Komunikata. Retrieved from https://www.researchgate.net/publication/282673464

Thiagarajaan, S., Semmel, D. G., & Semmel, M. I. (1974). Instructional development for training teachers of exceptional children: A sourcebook. Bloomington, Indiana: Indiana Univ., Center for Innovation in Teaching the Handicapped. Retrieved from https://files.eric.ed.gov/fulltext/ED090725.pdf

UNESCO. (2011). ICT in education. Retrieved May 23, 2019, from https://en.unesco.org/themes/ict-education

Wicaksono, D. P., Kusmayadi, T. A., & Usodo, B. (2014). Pengembangan perangkat pembelajaran matematika berbahasa inggris berdasarkan teori kecerdasan majemuk (multiple intelligences) pada materi balok dan kubus untuk kelas VIII SMP. Jurnal Elektronik Pembelajaran Matematika, 2(5), 534–549. Retrieved from https://jurnal.fkip.uns.ac.id/index.php/s2math/article/view/4378/3063

Williams, R. (2003). Terminology used in instrument accuracy (pp. 279–284). American school of gas measurement technology. Retrieved from https://asgmt.com/wp-content/uploads/pdf-docs/2003/1/55.pdf

Williams, R. G., Klamen, D. A., & McGaghie, W. C. (2003). Cognitive, social and environmental sources of bias in clinical performance ratings. Teaching and Learning in Medicine, 15(4), 270–292. doi: https://doi.org/10.1207/S15328015TLM1504_11

Yeager, D. S., & Lee Duckworth, A. (2015). Measurement matters: Assessing personal qualities other than cognitive ability for educational purposes. Educational Researcher, 44(4), 237–251. doi: https://doi.org/10.3102/0013189X15584327

Yonata, B., & Nasrudin, H. (2018). Laboratory activity worksheet to train high order thinking skill of student on surface chemistry lecture. In Journal of Physics: Conference Series (Vol. 947, pp. 1–7). IOP Publishing. https://doi.org/10.1088/1742-6596/947/1/012027




DOI: https://doi.org/10.22219/jpbi.v5i2.7747 | Abstract views : 379 | PDF views : 0 |

Refbacks



Copyright (c) 2019 Afandi et al

License URL: https://creativecommons.org/licenses/by-sa/4.0/

View JPBI Stats

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.