The HOTS-Characteristic Diagnostic Tests Using the System Thinking Approach to Detect Acid-base Misconceptions in High School Chemistry
Abstract
Systems thinking is an approach to understanding the complex relationships between components in a system by combining analytical and systematic thinking. Misconceptions in the thinking process can hinder understanding of chemical concepts, so a diagnostic instrument that can comprehensively identify errors in thinking is needed. Many diagnostic instruments have been developed, but none have used a systems thinking approach. This study aims to develop a diagnostic test instrument based on the systems thinking approach with Higher Order Thinking Skill (HOTS) characteristics. The development follows Wilson's four-block model with a sequential exploratory mixed method, covering qualitative and quantitative stages. The instrument consists of 20 graded items covering four aspects of systems thinking: particle identification, component interaction, cause-and-effect relationships through calculation, and particle interaction inference. Validation shows a high Aiken V index from experts (0.91) and teachers (0.95), indicating content, construct, and language suitability. Student responses yielded an average NRS score of 75.8% (good category), with a note of time constraints. Rasch analysis showed good reliability (0.83) and lower person reliability (0.57) due to homogeneous responses on several basic items. Theoretically, this study confirms the importance of integrating HOTS and system thinking in the development of chemistry diagnostic instruments. The resulting instrument can be used by teachers as a formative assessment to detect students' misconceptions in depth and design more targeted learning interventions.
Keywords
Full Text:
PDFReferences
[1] "Education GPS - Indonesia - Student Performance (PISA 2022)." Accessed: Dec. 16, 2023. [Online]. Available: https://gpseducation.oecd.org/CountryProfile?primaryCountry=IDN&treshold=10&topic=PI
[2] I. N. Ramadhani and W. Sukmawati, "Analisis pemahaman literasi sains berdasarkan gender dengan tes diagnostik three-tier multiple choice," Ideas: Jurnal Pendidikan, Sosial, dan Budaya, vol. 8, no. 3, p. 781, Aug. 2022, doi: https://doi.org/10.32884/ideas.v8i3.860.
[3] N. Mukhlisa, "Miskonsepsi pada peserta didik," Speed Journal: Journal of Special Education, vol. 4, no. 2, pp. 66-76, Jan. 2021, doi: https://doi.org/10.31537/speed.v4i2.403
[4] D. Ngurah and L. Laksana, "Miskonsepsi dalam materi IPA sekolah dasar," JPI (Jurnal Pendidikan Indonesia), vol. 5, no. 2, pp. 166-175, Oct. 2016, doi: https://doi.org/10.23887/jpi-undiksha.v5i2.8588.
[5] O. Deni, E. Nugroho, and M. A. Prayitno, "Analisis miskonsepsi peserta didik dalam memahami konsep kimia dengan menggunakan tes diagnostik TTMC," Jurnal Education and Development, vol. 9, no. 1, pp. 72-72, Jan. 2021, doi: https://doi.org/10.37081/ed.v9i1.2300.
[6] P. Dewi, Elvinawati, and R. Elvia, "Pengembangan butir soal HOTS untuk menguji kemampuan berpikir tingkat tinggi siswa di MA Negeri 2 Kota Bengkulu," Alotrop, vol. 5, no. 2, pp. 141-148, Aug. 2021, doi: https://doi.org/10.33369/atp.v5i2.17119.
[7] B. Anggara, "Pengembangan soal Higher Order Thinking Skills sebagai tes diagnostik miskonsepsi matematis siswa SMA," Algoritma: Journal of Mathematics Education, vol. 2, no. 2, pp. 176-191, Dec. 2020, doi: https://doi.org/10.15408/ajme.v2i2.18387.
[8] I. K. Mustika, "Optimalisasi tes diagnostik berbasis IT dalam meningkatkan mutu pembelajaran Bahasa Bali pada Kurikulum Merdeka di SMA Negeri 1 Seririt," Kalangwan Jurnal Pendidikan Agama, Bahasa dan Sastra, vol. 12, no. 2, pp. 13-22, Sep. 2022, doi: https://doi.org/10.25078/kalangwan.v12i2.1674.
[9] I. N. Diartha, W. Wildan, and M. Muntari, "Penilaian kinerja (performance assessment) dalam pembelajaran kimia," Jurnal Pijar MIPA, vol. 11, no. 1, pp. 65-69, Mar. 2016, doi: https://doi.org/10.29303/jpm.v11i1.64.
[10] N. L. Azizah, L. Mahardiani, and D. S. Yamtinah, "Analisis miskonsepsi dengan tes diagnostik two-tier multiple choice dan in-depth interview pada materi asam basa," Jurnal Pendidikan Kimia, vol. 11, no. 2, pp. 168-177, Dec. 2022, doi: https://doi.org/10.20961/jpkim.v11i2.60345.
[11] T. Fan, J. Song, and Z. Guan, "Integrating diagnostic assessment into curriculum: A theoretical framework and teaching practices," Language Testing in Asia, vol. 11, no. 1, Dec. 2021, doi: https://doi.org/10.1186/s40468-020-00117-y.
[12] S. Fajrin, A. Haetami, D. Muhamad, and A. Marhadi, "Identifikasi kesulitan belajar kimia siswa pada materi pokok larutan asam dan basa di kelas XI IPA 2 SMA Negeri 1 Wolowa Kabupaten Buton," Jurnal Pendidikan Kimia FKIP Universitas Halu Oleo, vol. 5, no. 1, 2020, doi: https://doi.org/10.36709/jpkim.v5i1.13106.
[13] R. Tri Astuti and H. Marzuki, "Analisis kesulitan pemahaman konsep pada materi titrasi asam basa siswa SMA," Orbital: Jurnal Pendidikan Kimia, vol. 1, no. 1, pp. 22-27, Feb. 2018, doi: https://doi.org/10.19109/ojpk.v1i1.1862.
[14] P. G. Mahaffy, E. J. Brush, J. A. Haack, and F. M. Ho, "Journal of Chemical Education call for papers - Special issue on reimagining chemistry education: Systems thinking, and green and sustainable chemistry," J. Chem. Educ., vol. 95, no. 10, pp. 1689-1691, Oct. 2018, doi: https://doi.org/10.1021/acs.jchemed.8b00764.
[15] V. Talanquer and A. R. Szozda, "An educational framework for teaching chemistry using a systems thinking approach," J. Chem. Educ., vol. 101, no. 5, pp. 1785-1792, May 2024, doi: https://doi.org/10.1021/acs.jchemed.4c00216.
[16] P. G. Mahaffy, A. Krief, H. Hopf, G. Mehta, and S. A. Matlin, "Reorienting chemistry education through systems thinking," Nat. Rev. Chem., vol. 2, no. 4, 2018, doi: https://doi.org/10.1038/s41570-018-0126.
[17] A. Irfiana, W. Sumarni, J. Kimia, F. Matematika, D. Ilmu, and P. Alam, "Desain instrumen tes three-tier multiple choice bermuatan critical thinking skills untuk mengukur keterampilan berpikir kritis siswa SMA terkait materi asam basa," Chemistry in Education, vol. 11, no. 2, pp. 101-110, Dec. 2022, doi: https://doi.org/10.15294/chemined.v11i2.55071.
[18] S. A. Suri and A. Andromeda, "Development of IBT based two-tier Higher Order Thingking Skills (HOTS) test instruments on acid-base titration materials for SMA/MA students," Entalpi Pendidikan Kimia, vol. 3, no. 1, pp. 58-65, Feb. 2022, doi: https://doi.org/10.24036/epk.v3i1.249.
[19] M. Wilson, Constructing Measure: An Item Response Modeling Approach. Mahwah, NJ, USA: Lawrence Erlbaum Associates, 2005.
[20] L. R. Aiken, Perspective of Individual Difference: Assessment of Intellectual Functioning, 2nd ed. New York, NY, USA: Plenum Press, 1996.
[21] B. Sumintono and W. Widhiarso, Aplikasi Pemodelan Rasch pada Assessment Pendidikan. Cimahi, Indonesia: Trim Komunikata, 2015.
[22] E. Betley, E. J. Sterling, and A. L. Porzecanski, "The value of systems thinking in a rapidly changing world," Lessons in Conservation, vol. 11, pp. 5-8, 2021, doi: https://doi.org/10.5531/cbc.linc.11.1.1.
[23] T. Strachan, U. H. Cho, T. Ackerman, S.-H. Chen, J. De La Torre, and E. H. Ip, "Evaluation of the linear composite conjecture for unidimensional IRT scale for multidimensional responses," Appl. Psychol. Meas., vol. 46, no. 5, pp. 347-360, Jul. 2022, doi: https://doi.org/10.1177/01466216221084218.
[24] S. Mulyanti and S. Rahmania, "Pengembangan instrumen tes penguasaan konsep senyawa alkil halida: Analisis validitas model Rasch," Jurnal Zarah, vol. 10, no. 1, pp. 21-27, Jun. 2022, doi: https://doi.org/10.31629/zarah.v10i1.4161.
[25] N. Ngadi, "Analisis model Rasch untuk mengukur kompetensi pengetahuan siswa SMKN 1 Kalianget pada mata pelajaran perawatan sistem kelistrikan sepeda motor," Jurnal Pendidikan Vokasi Otomotif, vol. 6, no. 1, pp. 1-20, Dec. 2023, doi: https://doi.org/10.21831/jpvo.v6i1.63479.
[26] M. Ibnu, B. Indriyani, H. Inayatullah, and Y. Guntara, "Aplikasi Rasch Model: Pengembangan instrumen tes untuk mengukur miskonsepsi mahasiswa pada materi mekanika," in Seminar Nasional Hari Pendidikan Nasional FKIP Untirta 2019, 2019, pp. 205-210.
Refbacks
- There are currently no refbacks.






