Item Quality Analysis of Chemistry Final Semester Test in The Academic Year of 2017/2018, 2018/2019 and 2019/2020

Nazatin Nuroini; Sulistyo Saputro; Suryadi Budi Utomo

doi:10.20961/jkpk.v6i3.54999

Item Quality Analysis of Chemistry Final Semester Test in The Academic Year of 2017/2018, 2018/2019 and 2019/2020

Nazatin Nuroini, Sulistyo Saputro, Suryadi Budi Utomo

Abstract

Item analysis is a process in which both students' answers and test questions are evaluated in order to determine the quality of the items and the test as a whole in the standardized and objective evaluation of student performances. Evaluation is needed to define how much the participants' learning outcomes have changed from their beginning abilities to their abilities after completing the educational process. This research examines the items' quality from a quantitative standpoint. The aims of this study are to determine the difficulty index, item discrimination, distractor effectiveness, and reliability of the final semester test for Chemistry Subject Class X MIPA SMAN 1 Wonosegoro, Boyolali Regency. The research was carried out at SMAN 1 Wonosegoro, Boyolali Regency, using a quantitative descriptive technique. This study's population consists of response data from all 212 students in class X MIPA Chemistry throughout 2019/2020, 2018/2019 and 2017/2018 academic years. Documentation techniques are used to collect data. The data was analyzed quantitatively with the ANATES 4.0.9 version. According to the findings, in three consecutive academic years, the difficulty index was medium means is good because it is neither too complex nor too simple. Item discrimination is acceptable and meets the standards of sufficient, good, and exceptional. The distractor effectiveness was functions and the reliability value in the Academic Year of 2017/2018 was sufficient at 0.45, but it was high at 0.62 and 0.78 in the Academic Year of 2018/2019 and 2019/2020. The finding of this study item analysis is a crucial process in creating tests. This is about the impact of the accuracy of students' scores on test quality.

Keywords

Items Analysis; Chemistry; SMAN 1 Wonosegoro; ANATES 4.0.9.

Full Text:

PDF

References

[1] J. Anamuah-Mensah & K. A. Quaigrain, “Teacher competence in the use of essay test,” The Oguaa Educator University of Cape Coast, vol. 12, pp. 31–42, 1998.
Available: google scholar

[2] A. Siri & F. Michela, “The use of item analysis for the improvement of objective examination,” Procedia – Social and Behavioral Sciences, vol. 29, pp. 188-197, 2011.
Doi: https://doi.org/10.1016/j.sbspro.2011.11.224

[3] M. Ramlawati., M. Anwar., S. R. Yunus., & M. Nuswowati, “Analysis of Students’ Competence in Chemistry Cognitive Test Construction Based on Revised Bloom’s Taxonomy,” Journal of Physics: Conference Series, vol. 1567, pp. 1-6, 2020.
Doi: https://doi.org/10.1088/1742-6596/1567/4/042006

[4] Q. Kennedy & A. K. Arhin, “Using reliability and item analysis to evaluate a teacher-developed test in educational measurement and evaluation,” Cogent Education, vol. 4, 2017.
Doi: https://doi.org/10.1080/2331186X.2017.1301013

[5] W. R. Tyler, Basic Principle of Curriculum and Instruction, Chicago: The University of Chicago Press, 1949.
Available: google scholar

[6] P. Jefri., Mujassam, & Y. T. Alberto. “Item Analysis Using Rasch Model in Semester Final Exam Evaluation Study Subject in Physics Class X TKJ SMK Negeri 2 Manokwari,” Physics Educational Journal vol. 1(1), pp. 43-51, 2018.
Doi: https://doi.org/10.37891/kpej.v1i1.40

[7] H. D. Brown, Teaching by Principles: An Interactive Approach to Language Pedagogy (2nd ed.), New York: Longman, 2001.
Available: google scholar

[8] G. Flucher & F. Davidson, Language Testing and Assessment: An Advance Resource Book, Routledge, 2007.
Available: google scholar

[9] J. B. Heaton, Writing English Language Test, New York: Longman, 1975.
Available: google scholar

[10] V. M. Amalia, “Item Analysis of English Final Semester Test,” Indonesian Journal of EFL and Linguistics, vol. 5, no. 2, pp. 491-504, 2020.
Doi: https://doi.org/10.21462/ijefl.v5i2.302

[11] M. L. Hidayat, W. H. Prasetiyo, & J. Wantoro, “Pre-service student teachers’ perception of using google classroom in a blended course,” Humanities and Social Sciences Reviews, 7(2), 363–368, 2019.
Doi: https://doi.org/10.18510/hssr.2019.7242

[12] M. S. Velou & E. Ahila, “Refine the multiple choice questions tool with item analysis,” International Archives of Integrated Medicine, vol. 7(8), pp. 80-85, 2020.
Available: google scholar

[13] G. Mehta and V. Mokhasi, “Item Analysis of Multiple-Choice Questions- An Assessment of the Assessment Tool”. International Journal of Health Science and Research, vol. 4 (7), pp. 197-202, 2014.
Available: google scholar

[14] N. Agu., N, Onyekuba C., & A. C. Anyichie, Measuring teachers’ competencies in constructing classroom-based tests in Nigerian secondary schools: Need for a test construction skill inventory, Educ. Res. Rev. 8 431, 2013.
DOI: 10.5897/ERR12.219

[15] A. S. Ingale., P. A. Giri., & M. K. Doibale, “Study on item and test analysis of multiple-choice questions amongst undergraduate medical students,” International Journal of Community Medicine and Public Health, vol. 4, no. 5, pp. 1562-1565, 2017.
Doi: https://doi.org/10.18203/2394-6040.ijcmph20171764

[16] M. R. Hingorjo, & F. Jaleel, “Analysis of One-Best MCQs: The Difficulty Index, Discrimination Index and Distractor Efficiency,” JPMA-Journal of the Pakistan Medical Association, vol. 62(2), pp. 142–147, 2012.
Available: google scholar

[17] S. Arikunto, Dasar-dasar Evaluasi Pendidikan, Jakarta: Bumi Aksara, 2013.
Available: google scholar

[18] T. M. Haladyna, Developing and Validating Multiple-Choice Test Items (3rd ed.). Lawrence Erlbaum Associates Publisher, 2004.
Available: google scholar

[19] A. Iskandar, & M. Rizal, “Analisis Kualitas Soal Perguruan Tinggi Berbasis Aplikasi TAP,” Jurnal Penelitian dan Evaluasi Pendidikan, vol. 21, no. 2, pp. 12-23, 2017.
Doi: https://doi.org/10.21831/pep.v22i1.15609

[20] D. Rosana, & D. Setyawarno, “Statistik Terapan Untuk Penelitian Pendidikan,” UNY Press, 2017.
Available: google scholar

[21] Kunandar, Penilaian Autentik: (Penilaian Hasil Belajar Peserta Didik Kurikulum 2013). Raja Grafindo Persada, 2013.
Available: google scholar

[22] Sung, P. J., Lin, S. W., & Hung, P. H, “Factors Affecting Item Difficulty in English Listening Comprehension Tests," Universal Journal of Educational Research, 3(7), 451–459, 2015.
Doi: https://doi.org/10.13189/ujer.2015.030704

[23] Danili, E., & Reid, N, “Cognitive Factors That Can Potentially Affect Pupils’ Test Performance,” Chemistry Education Research and Practice, 7(2), 64–83, 2006.
Doi: https://doi.org/10.1039/B5RP90016F

[24] S. Gajjar., R. Sharma., P. Kumar., & M. Rana, “Item and test analysis to identify quality Multiple Choice Questions (MCQs) from an assessment of medical students of Ahemdabad, Gujarat,” Indian journal of Community Medicine, vol. 39, pp. 17-20, 2014.
Doi: https://doi.org/10.4103/0970-0218.126347

[25] Sugiyono, Metode Penelitian Pendidikan: Pendekatan Kuantitatif, Kualitatif, Dan R&D, Bandung: Alfabeta, 2010.
Available: google scholar

[26] Bintarti, S., & Kurniawan, E. N. (2017). A study of revisit intention: Experiential quality and image of Muara Beting tourism site in Bekasi District. European Research Studies Journal, 20(2), 521–537.
Doi: https://doi.org/10.35808/ersj/657

[27] Kheyami, D., Jaradat, A., Al-Shibani, T., & Ali, F. A, “Item Analysis of Multiple-Choice Questions at the Department of Paediatrics,” Arabian Gulf University, Manama, Bahrain. Sultan Qaboos Univesity Medical Journal, 18(1), 2018.
Doi: https://doi.org/10.18295/squmj.2018.18.01.011

[28] Maharani, A. V., “Item Analysis of English Final Semester Test” Indonesian Journal of EFL and Linguistics, vol. 5 (2): 491-504, 2020.
Doi: https://doi.org/10.21462/ijefl.v5i2.302

[29] Karimah, U., Retnawati, H., Hadiana, D., Pujiastuti., Yusron, E, “The characteristics of chemistry test items on nationally-standardized school examination in Yogyakarta City,” Research and Evaluation in Education, vol. 7 (1), pp. 1-12, 2021.
Doi: 10.21831/reid.v7i1.31297

[30] Manfenrius, A., Sutapa, G., & Wijaya, B, “Item Analysis on English Summative Test at The Eighth Grade Junior High Schools in Pontianak,” Jurnal Pendidikan Dan Pembelajaran Khatulistiwa, 4(12), 1–10, 2015.
Available: google scholar

[31] Reza, M., Puspita, K., Oktaviani, C, “Quantitative Analysis Towards Higher Order Thinking Skill of Chemistry Multiple choice Questions for University Admission,” Jurnal IPA dan Pembelajaran IPA, vol. 5(2): 172-185, 2021.
Doi: 10.24815/jipi.v5i2.20508

[32] Hasanah, I., Copriady, J., & Thaib A, “Analisis Butir Soal Ujian Semester Ganjil Pelajaran Kimia Kelas XI IPA SMA Negeri 10 Pekanbaru Tahun Pelajaran 2013/2014,” JOM, vol. 2(1), 1-10. 2015.
Available: google scholar

[33] Hartati, N., Yogi H., P., S., “Item Analysis for a Better-Quality Test,” ELIF, vol. 2(1), 59-70, 2019.
Doi: https://doi.org/10.24853/elif.2.1.59-70

DOI: https://doi.org/10.20961/jkpk.v6i3.54999