Development of character assessment instrument on English learning for middle school students

Authors

  • Andi Abdurrahman Manggaberani Educational Research and Evaluation, Post-Graduate Program, Universitas Negeri Yogyakarta, Indonesia
  • Nur Hidayanto Pancoro Setyo Putro English Language Education Study Program, Faculty of Languages, Arts and Culture, Universitas Negeri Yogyakarta, Indonesia

DOI:

https://doi.org/10.22219/raden.v4i1.31923

Keywords:

Assessment, Character, English Learning, Instrument Development

Abstract

There is a present-day necessity to construct character education assessment instruments in English courses. Employing the ADDIE development model, this research undergoes stages encompassing analysis, design, development, implementation, and evaluation to craft a meticulously designed assessment instrument. The resulting instrument is a self-assessment for English subjects, subjected to scrutiny through both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA). The instrument attests to content validity, indicated by an Aiken index of 0.955, and construct validity using EFA & CFA. Outcomes showcasing loading factor values exceeding 0.4 for each item and the model for measuring student character aligns seamlessly with the hypothesized model, substantiated by statistical results of p-values = 0.056; CFI = 0.979; TLI = 0.972; RMSEA = 0.031; SRMR = 0.055. Furthermore, the item reliability in each dimension/factor surpasses 0.7. The study's revelations uncover that 46% of students predominantly concentrate on character development, while 35% prioritize character emphasis. Cultivated character for 14%, whereas a mere 5% of students necessitate guidance. This instrument not only guides educators and researchers in developing character assessment tools but also meets valid and reliable criteria, ensuring credibility and usability across various education levels.

Downloads

Download data is not yet available.

References

Afifuddin, A., & Burga, M. A. (2022). Religious ethics education of muslim and buddhist families in Watampone. Al-Qalam Jurnal Penelitian Agama dan Sosial Budaya, 28(2), 228–238. https://doi.org/10.31969/alq.v28i2.1098

Akhter, S., Haidov, R., Majeed Rana, A., & Hussain Qureshi, A. (2020). Exploring the significance of speaking skill for EFL learners. PalArch’s Journal of Archaeology of Egypt / Egyptology, 17(9), 6019–6030. https://archives.palarch.nl/index.php/jae/article/view/5149

Alivi, F. J., & Widihastuti. (2022). Development of affective self-assessment instrument of chem-istry for high school student as the daily assessment guideline. European Journal of Educational Research, 11(1), 445–456. https://doi.org/https://doi.org/10.12973/eu-jer.11.1.445

Amalia, A. N., Suyono, S., & Arthur, R. (2023). Penyusunan instrumen penelitian: Konsep, teknik, uji validitas, uji reliabilitas, dan contoh instrumen penelitian (1st ed.). PT Nasya Expanding Man-agement. https://books.google.co.id/books/about/Penyusunan_Instrumen_Penelitian.html?id=rx3JEAAAQBAJ&redir_esc=y

Arif, A. M., Nurdin, N., & Elya, E. (2023). Character education management at islamic grassroot education: The integration of local social and wisdom values. Al-Tanzim : Jurnal Manajemen Pendidikan Islam, 07(02), 435–450. https://doi.org/10.33650/al-tanzim.v7i2.5468

Aydin, A., Gürsoy, A., & Karal, H. (2023). Mobile care app development process: using the ADDIE model to manage symptoms after breast cancer surgery (step 1). Discover Oncology, 14(1). https://doi.org/10.1007/s12672-023-00676-5

Azwar, S. (2021). Reliabilitas dan validitas (4th ed.). Pustaka Pelajar. https://inlislite.uin-suska.ac.id/opac/detail-opac?id=1829

Branch, R. M. (2009). Instructional design: The ADDIE approach. Springer. https://link.springer.com/book/10.1007/978-0-387-09506-6

Brauer, K., Ranger, J., & Ziegler, M. (2023). Editorial: Confirmatory factor analyses in psycho-logical test adaptation and development: A nontechnical discussion of the WLSMV esti-mator. Psychological Test Adaptation and Development, 4(1), 4–12. https://doi.org/10.1027/2698-1866/a000034

Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press. https://www.guilford.com/books/Confirmatory-Factor-Analysis-for-Applied-Research/Timothy-Brown/9781462515363

Dariyanto, D., & Awiria, A. (2023). Pendidikan karakter pada pembelajaran percakapan Bahasa Inggris siswa sekolah dasar berasrama. Educational Journal of Bhayangkara (EDUKARYA), 3(1), 65–74. https://doi.org/10.31599/edukarya.v3i1.2534

Darnell, C., Gulliford, L., Kristjánsson, K., & Paris, P. (2019). Phronesis and the knowledge-action gap in moral psychology and moral education: A new synthesis? Human Development, 62(3), 101–129. https://doi.org/10.1159/000496136

Feng, J., & Sangsawang, T. (2023). Information technology, according to the ADDIE model on English subject teaching, enhances the learning achievement of Shunde Polytechnic students in China. TOJET: The Turkish Online Journal of Educational Technology, 22(4), 121–131. https://files.eric.ed.gov/fulltext/EJ1409897.pdf

García-Moriyón, F., González-Lamas, J., Botella, J., Vela, J. G., Miranda-Alonso, T., Palacios, A., & Robles-Loro, R. (2020). Research in moral education: The contribution of P4C to the moral growth of students. Education Sciences, 10(4). https://doi.org/10.3390/educsci10040119

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Cengage. https://books.google.co.id/books/about/Multivariate_Data_Analysis.html?id=0R9ZswEACAAJ&redir_esc=y

Harmanto, B., Anwar, K., Arifani, Y., Basri, H., & Nuruddin, M. (2023). The relationship between attitudes, motivations and gender in learners of english for academic purposes. International Journal of Instruction, 16(3), 971–990. https://doi.org/10.29333/iji.2023.16352a

Heale, R., & Twycross, A. (2015). Validity and reliability in quantitative studies. Evidence-Based Nursing, 18(3), 66–67. https://doi.org/10.1136/eb-2015-102129

Heritage, M., Walqui, A., & Linquanti, R. (2020). English language learners and the new standards: Developing language, content knowledge, and analytical practices in the classroom. Harvard Edu-cation Press. https://hep.gse.harvard.edu/9781612508016/english-language-learners-and-the-new-standards/

Hidayati, K., Budiyono, budiyono, & Sugiman, sugiman. (2018). Development and validation of student’s responsibility scale on mathematics learning using subject scaling model. Inter-national Journal of Instruction, 11(4), 499–512. https://doi.org/10.12973/iji.2018.11431a

Ibrahim, F. M., Abdelaziz, E., Dabou, R., Abdelsamad, S., & Abuijlan, I. A. M. (2024). Prevalence of bullying and its impact on self-esteem , anxiety and depression among medical and health sciences university students in RAS Al Khaimah , UAE. Heliyon, 10(3), e25063. https://doi.org/10.1016/j.heliyon.2024.e25063

Idris, M. R., & Rus, R. C. (2023). Developing the rekatronik module using ADDIE model for elec-tronic design topic in the design and technology (D&T) subject. Asian Journal of Research in Education and Social Sciences, 5(2), 113–122. https://doi.org/10.55057/ajress.2023.5.2.13

Istiyono, E. (2020). Pengembangan instrumen penilaian dan analisis hasil belajar fisika dengan teori tes klasik dan modern (2nd ed.). UNY Press. http://library.uny.ac.id/sirkulasi/index.php?p=show_detail&id=57737

Jabbarova, M. K. (2022). The importance of education directed to the personality of the child in ensuring the education, upbringing, physical, mental and spiritual maturity of the child. Models and Methods for Increasing the Efficiency of Innovative Research, 2(17), 54–59. https://interonconf.org/index.php/ger/article/view/100

Jurianto, J. (2017). Model pengembangan desain instruksional dalam penyusunan modul pen-didikan pemustaka (Library Instruction). Jurnal Media Pustakawan, 24(3), 32–39. https://doi.org/https://doi.org/10.37014/medpus.v24i3.461

Kleemann, S. S., Franikowski, P., & Nicolai, S. (2023). Development and validation of a scale to assess moral disengagement in high-carbon behavior. Sustainability, 15(3), 1–23. https://doi.org/10.3390/su15032054

Koenig, E., Guertler, K., Ĩarnowska, D., & Horbaþauskienơ, J. (2020). Developing English language competence for global engineers. IEEE Global Engineering Education Conference, EDUCON, 242–249. https://doi.org/10.1109/educon45650.2020.9125208

KPAI R.N. (2021). Data kasus perlindungan anak 2016 – 2020. https://bankdata.kpai.go.id/tabulasi-data/data-kasus-perlindungan-anak-2016-2020

Liando, N. V. F., & Tatipang, D. P. (2022). English or Indonesian language? parents’ perception toward children’s second language learning context. Jurnal Lingua Idea, 13(1), 61–75. https://doi.org/10.20884/1.jli.2022.13.1.5749

Malaikosa, C. A., & Taopan, L. L. (2020). Teaching English at junior high school in Indonesian rural area: The implementation of scientific approach. Lensa: Kajian Kebahasaan, Kesusastraan, dan Budaya, 10(2), 206. https://doi.org/10.26714/lensa.10.2.2020.206-217

Mardapi, D. (2017). Pengukuran, penilaian, dan evaluasi pendidikan (2nd ed.). Parama Publishing. https://opac.perpusnas.go.id/DetailOpac.aspx?id=1162325

Marela, G., Wahab, A., & Marchira, C. R. (2017). Bullying verbal menyebabkan depresi pada remaja SMA di kota Yogyakarta. Berita Kedokteran Masyarakat, 33(1), 43–48. https://doi.org/doi.org/10.22146/bkm.8183

Mohamed, A., Abdullah, Z., & Zabidi Abdul Razak, A. (2021). Validation of an instrument for measuring integrated principal leadership practices. The Malaysian Online Journal of Educa-tional Management (MOJEM), 9(1), 1–20. https://ejournal.um.edu.my/index.php/MOJEM/article/view/27958

Nisa, K., Nurhasanah, N., Kusuma, A. S. H. M., Deni Sutisna, D. S., & Sari, M. P. (2021). Pengem-bangan instrumen penilaian karakter untuk siswa sekolah dasar (SD). Jurnal Ilmiah Profesi Pendidikan, 6(1), 102–107. https://doi.org/10.29303/jipp.v6i1.158

Nurmiati, N., Arismunandar, A., & Rauf, B. A. (2023). Problem-based learning based biology learning model development using the environment to improve motivation and learning outcomes of biology high school students. Asian Journal of Education and Social Studies, 49(2), 104–112. https://doi.org/10.9734/AJESS/2023/v49i21123

Panahi, S., Bazrafshani, A., & Mirzaie, A. (2023). Development and validation of a modified LibQUAL scale in health sciences libraries: Application of structural equation modeling. Journal of the Medical Library Association, 111(4), 792–801. https://doi.org/10.5195/jmla.2023.1348

Pulukadang, M. A., Baruadi, M. K., Malabar, S., & Hulukati, E. P. (2023). Development of cultural insights courses (Characterizing of Ung) based on ADDIE approach in the faculty of liter-ature and culture Universitas Negeri Gorontalo. International Journal of Education and Social Science Research, 6(1), 232–244. https://doi.org/10.37500/ijessr.2023.6116

Rao, P. S. (2019). The role of English as global language. Research Journal of English (RJOE), 4(1), 65–79. https://www.researchgate.net/publication/334282978_the_role_of_english_as_a_global_language#fulltextfilecontent

Retnawati, H. (2016). Validitas, reliabilitas, dan karakteristik butir. Parama Publishing. http://library.fip.uny.ac.id/opac/index.php?p=show_detail&id=9172

Sadri, M., Adisaputera, A., & Daulay, S. (2020). The development of character-based assessment instruments in poetry writing material for class X students of SMA Negeri 3 Medan. Budapest International Research and Critics in Linguistics and Education (BirLE) Journal, 3(4), 1884–1905. https://doi.org/10.33258/birle.v3i4.1411

Shakeel, S. I., Al Mamun, M. A., & Haolader, M. F. A. (2022). Instructional design with ADDIE and rapid prototyping for blended learning: validation and its acceptance in the context of TVET Bangladesh. Education and Information Technologies, 1–30. https://doi.org/10.1007/S10639-022-11471-0

Sofiana, N., Mubarok, H., & Yuliasri, I. (2019). English language teaching in secondary schools: An analysis of the implementation of Indonesian ELT 2013 curriculum. International Journal of Instruction, 12(1), 1533–1544. https://doi.org/10.29333/iji.2019.12198a

Steenkamp, J. B. E. M., & Olivares, A. M. (2023). Unrestricted factor analysis: A powerful alternative to confirmatory factor analysis. Journal of the Academy of Marketing Science, 51(1), 86–113. https://doi.org/10.1007/s11747-022-00888-1

Sumague, J. A. (2019). Fundamental concepts of language teaching (2nd ed.). Society Publishing. https://www.amazon.com/Fundamental-Concepts-Language-Teaching-Julieta/dp/1774072661

Suryani. (2014). Persepsi nilai yang diterima nasabah pada layanan perbankan Syariah: Analisis konfirmatori faktor. Finance and Banking Journal, 16(1), 104–124. https://journal.perbanas.id/index.php/jkp/article/view/204/31

Susanto, S., Ritonga, A. W., & Desrani, A. (2022). The challenge of the integrated character education paradigm with 21st-century skills during the Covid-19 pandemic. Cendekia: Jurnal Kepen-didikan dan Kemasyarakatan, 1(1), 85–104. https://doi.org/10.21154/cendekia.v1i1.3816

Tahmasbi, S., Hashemifardnia, A., & Namaziandost, E. (2019). Standard English or world Eng-lishes: Issues of ownership and preference. Journal of Teaching English Language Studies, 7(3), 83–98. https://journals.iau.ir/article_665009_bc918242d35f565d74a0b19073056696.pdf

Tirrell, J. M. (2022). Forgiveness as a character strength: Toward a developmental model and re-search agenda. Journal of Moral Education, 51(3), 312–335. https://doi.org/10.1080/03057240.2021.1873754

Vogt, K. (2018). Assessment—what, why and how? In C. Surkamp & B. Viebrock (Eds.), Teaching English as a foreign language an introduction (p. 251). J. B. Metzler Verlag. https://doi.org/10.1007/978-3-476-04480-8_14

Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psy-chology, 44(3), 219–246. https://doi.org/10.1177/0095798418771807

Wijayanti, D., & Pratomo, W. (2019). Pendidikan karakter melalui model pembelajaran kreatif bagi siswa sekolah dasar (Studi di SDN Mendungan 2 Yogyakarta). Taman Cendekia: Jurnal Pendidikan Ke-SD-An, 3(1), 276–282. https://doi.org/https://doi.org/10.30738/tc.v3i1.4291

Yong, A. G., & Pearce, S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. The Quantitative Methods for Psychology, 9(2), 79–94. https://doi.org/https://doi.org/10.20982/tqmp.09.2.p079

Yoong, S. M. (2022). Applying the ADDIE model to design and develop an instrument for dy-scalculia. Seameo, 1, 55–68. https://www.researchgate.net/publication/366861346_Applying_the_ADDIE_Model_to_Design_and_Develop_an_Instrument_for_Dyscalculia

Yu, S., & Setiyaningrum, A. (2018). Studi mengenai city branding kota Yogyakarta sebagai kota pelajar di Indonesia. Matrik: Jurnal Manajemen, Strategi Bisnis dan Kewirausahaan, 2(1), 31–46. https://doi.org/10.24843/matrik:jmbk.2019.v13.i01.p04

Yusoff, A. M., Madihie, A., & Hutasuhut, I. J. (2023). Efikasi Kendiri sebagai moderator antara metakognitif dan resilien dalam kalangan guru bimbingan dan kaunseling di Sarawak. Malaysian Journal of Social Sciences and Humanities (MJSSH), 8(1), 1–17. https://doi.org/10.47405/mjssh.v8i1.2038

Yusuf, A. M. (2015). Asesmen dan evaluasi pendidikan: Pilar penyedia informasi dan kegiatan pengendalian mutu pendidikan (1st ed.). Prenadamedia Group. https://opac.perpusnas.go.id/DetailOpac.aspx?id=948297

Zhang, Z., & Garcia, L. (2023). Examining dimensionality and validity of the academic integrity survey instrument. Journal of Education and Development, 7(1), 46–51. https://doi.org/10.20849/jed.v7i1.1326

Downloads

Published

2024-05-16

How to Cite

Manggaberani, A. A., & Putro, N. H. P. S. (2024). Development of character assessment instrument on English learning for middle school students. Research and Development in Education (RaDEn), 4(1), 374–389. https://doi.org/10.22219/raden.v4i1.31923

Issue

Section

Articles