Evaluating Chemistry Teacher’s Questioning Skills in Microteaching Based on Artificial Intelligence (AI) Using an Assessment Rubric

Nala Izzul Muna, Sri Susilogati Sumarti, Harjono Harjono, Woro Sumarni, Dimas Gilang Ramadhani

Abstract


This study evaluates the questioning skills of chemistry teachers during microteaching using an AI-assisted assessment rubric. A total of 200 publicly available YouTube videos (2019–2024) were selected using defined criteria: chemistry instruction, teacher–student questioning, Indonesian language, minimum audio clarity of 45 dB, and at least 5 minutes in duration. All videos featured pre-service teachers. Transcripts were generated using Otter.ai and segmented into discrete questioning episodes. Evaluation was performed using Gemini Flash 2.0 (build: 2025.03, temperature: 0.0), a large language model configured via prompt design and anchored exemplars to assess six pedagogical indicators: question type, content relevance, question complexity, wait time, teacher’s response, and student interaction. Each indicator was rated on a 4-point scale. Reliability checks against human-coded samples (n = 40) yielded strong agreement (Cohen’s κ = 0.78). Results showed that 25% of sessions were classified as high-performing, with open-ended and cognitively demanding questions, extended wait time, and rich student engagement. In contrast, 42% were low-performing, marked by factual recall, short pauses, and minimal interaction. Clustering analysis (Gower k-medoids) identified three distinct performance profiles (average silhouette = 0.41). This AI-based framework enables reliable, scalable, and interpretable evaluation of questioning practices. A prototype feedback tool was developed, providing per-indicator scores, question examples, and suggested improvements supporting formative teacher development. Ethical compliance was ensured through the exclusive use of public, anonymized content.


Keywords


assessment rubric; cognitive engagement; dialogic teaching; Gemini Flash 2.0; teacher questioning

Full Text:

PDF
rticle

References


Alexander, R. J. (2008). Towards Dialogic Teaching: rethinking classroom talk (4th Edition). Dialogos.

Alharbi, A., & Johnston‐Wilder, S. (2023). Exploring teachers’ perceptions towards dialogic teaching in primary science classrooms in Saudi Arabia. International Journal of Education and Practice, 11(3), 515–528. https://doi.org/10.18488/61.v11i3.3431

Aprilia, S., Agustin, R., Pranatawijaya, V. H., & Sari, N. N. K. (2024). Penerapan API Gemini dalam layanan peminjaman novel online pada website Cozybook. Jurnal Informatika dan Teknik Elektro Terapan, 12(3). https://doi.org/10.23960/jitet.v12i3.4508

Aşıkcan, M., & Uygun, N. (2023). A taxonomic analysis of the questions prepared by prospective primary teachers for primary school mathematics and Turkish language courses. International Journal of Education and Literacy Studies, 11(3), 286–293. https://doi.org/10.7575/aiac.ijels.v.11n.3p.286

Atkinson, R. C., & Shiffrin, R. M. (1968). Human memory: A proposed system and its control processes. In K. W. Spence & J. T. Spence (Eds.), The psychology of learning and motivation (Vol. 2, pp. 89–195). Academic Press. https://doi.org/10.1016/S0079-7421(08)60422-3

Aydemir, M., Kurşun, E., & Karaman, S. (2016). Question–answer activities in synchronous virtual classrooms in terms of interest and usefulness. Open Praxis, 8(1), 9–23. https://doi.org/10.5944/openpraxis.8.1.226

Ballakrishnan, K., & Mohamad, M. (2020). Teachers’ teaching methods in teaching higher order thinking skill (HOTS) comprehension questions. International Journal of Academic Research in Business and Social Sciences, 10(2), 435–446. https://doi.org/10.6007/ijarbss/v10-i2/6935

Bolat, A., & Karamustafaoğlu, S. (2023). The effect of question preparation training program that measures higher order thinking skills on the self-efficiency of science teachers. International E-Journal of Educational Studies, 7(15), 568–583. https://doi.org/10.31458/iejes.1314305

Bonawitz, E., Shafto, P., Yu, Y., Gonzalez, A., & Bridgers, S. (2020). Children change their answers in response to neutral follow-up questions by a knowledgeable asker. Cognitive Science, 44(1), Article e12811. https://doi.org/10.1111/cogs.12811

Çakır, H., & Cengiz, Ö. (2016). The use of open ended versus closed ended questions in Turkish classrooms. Open Journal of Modern Linguistics, 6(2), 60–70. https://doi.org/10.4236/ojml.2016.62006

Chin, C. (2006). Classroom interaction in science: Teacher questioning and feedback to students’ responses. International Journal of Science Education, 28(11), 1315–1346. https://doi.org/10.1080/09500690600621100

Davies, M., Kiemer, K., & Meissel, K. (2017). Quality talk and dialogic teaching: An examination of a professional development programme on secondary teachers’ facilitation of student talk. British Educational Research Journal, 43(5), 968–987. https://doi.org/10.1002/berj.3293

Doğan, A. T., & Ömeroğlu, E. (2019). Early childhood teachers’ views about the use of questions in early childhood education program assessment. Bartın University Journal of Faculty of Education, 8(2), 524–548. https://doi.org/10.14686/buefad.481827

Domu, I., Regar, V. E., Kumesan, S. L., Mangelep, N. O., & Manurung, O. (2023). Did the teacher ask the right questions? An analysis of teacher asking ability in stimulating students’ mathematical literacy. Journal of Higher Education Theory and Practice, 23(5), 79–92. https://doi.org/10.33423/jhetp.v23i5.5970

Elghotmy, H. E. A. (2023). Integrating instructional scaffolding interaction cycle into dialogic teaching to enhance EFL listening and speaking skills among Faculty of Education sophomores Journal of the Faculty of Education - Menoufia University, 2023(1), 1-44. https://doi.org/10.21608/muja.2023.288089

Florensia, N. P., Safa, Y. N., Patimah, Y., Priskila, R., & Pranatawijaya, V. H. (2024). Implementasi Open AI pada website restoran makanan India. JATI (Jurnal Mahasiswa Teknik Informatika), 8(3), 3766–3772. https://doi.org/10.36040/jati.v8i3.9770

Kertil, H. G. D. M. (2021). Skill-based mathematics questions: What do middle school mathematics teachers think about and how do they implement them? Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(1), 151–186. https://doi.org/10.17762/turcomat.v12i1.277

Kurniawati, Z. L., Nasution, R., Jailani, J., & Bardin, S. (2021). Students’ questioning skills in environmental pollution course using case study methods. ScienceEdu, 4(1), 46–55. https://doi.org/10.19184/se.v4i1.23947

Mahajan, N., Jadhav, V., & Sreeletha, A. (2025). Perspectives of nursing teachers on the use of microteaching as a teaching technique. Cureus, 17(1), e83150. https://doi.org/10.7759/cureus.83150

Mayuni, I., Leiliyanti, E., Palupi, T. M., Sitorus, M. L., & Chen, Y. (2022). Designing literacy e-coaching model for English language teachers of junior high schools in Indonesia. TEFLIN Journal: A Publication on the Teaching and Learning of English, 33(2), 310–334. https://doi.org/10.15639/teflinjournal.v33i2/310-329

Murtaza, M., Ahmad, H. M., Kamal, M. S., Hussain, S. M. S., Mahmoud, M., & Patil, S. (2020). Evaluation of clay hydration and swelling inhibition using quaternary ammonium dicationic surfactant with phenyl linker. Molecules, 25(18), 4333. https://doi.org/10.3390/molecules25184333

Paksuniemi, M., Keskitalo, P., Frangou, S.-M., & Körkkö, M. (2021). Pre-service teachers’ experiences of dialogical and reflective supervision through digital technology. International Journal of Technology in Education and Science, 5(3), 463–485. https://doi.org/10.46328/ijtes.243

Pritchard, R., & Morgan, K. (2022). Developing coach education to enhance rugby coaches’ understanding and application of game centred approaches: The importance of questioning. International Journal of Sports Science & Coaching, 17(5), 943–952. https://doi.org/10.1177/17479541221104157

Rahayuningsih, S., Sirajuddin, S., & Ikram, M. (2021). Using open-ended problem-solving tests to identify students’ mathematical creative thinking ability. Participatory Educational Research, 8(3), 285–299. https://doi.org/10.17275/per.21.66.8.3

Rowe, M. B. (1974). Relation of wait-time and rewards to the development of language, logic, and fate control: Part II. Rewards. Journal of Research in Science Teaching, 11(4), 291–308. https://doi.org/10.1002/tea.3660110403

Rowe, M. B. (1986). Wait time: Slowing down may be a way of speeding up. Journal of Teacher Education, 37(1), 43–50. https://doi.org/10.1177/002248718603700110

Semyonov-Tal, K., & Lewìn-Epstein, N. (2021). The importance of combining open-ended and closed-ended questions when conducting patient satisfaction surveys in hospitals. Health Policy Open, 2, 100033. https://doi.org/10.1016/j.hpopen.2021.100033

Simamora, R. M. (2023). Microteaching setting during the COVID-19 pandemic from the author’s point of view. JPI (Jurnal Pendidikan Indonesia), 12(1), 155–164. https://doi.org/10.23887/jpiundiksha.v12i1.53975

Sultan, S. (2022). Power relations in academic discourse: A critical discourse analysis of lecturer-student interrogation during undergraduate thesis defense sessions (Relasi kuasa dalam wacana akademik: Studi wacana kritis interogasi dosen-mahasiswa pada ujian skripsi program sarjana). Gramatika STKIP PGRI Sumatera Barat, 8(2), 188–203. https://doi.org/10.22202/jg.2022.v8i2.6258

Suryani, F. B., & Rismiyanto, R. (2021). The effect of microteaching lesson study on the beliefs of EFL student teachers. EDULITE: Journal of English Education, Literature and Culture, 6(1), 1–13. https://doi.org/10.30659/e.6.1.1-9

Tobin, K. (1987). The role of wait time in higher cognitive level learning. Review of Educational Research, 57(1), 69–95. https://doi.org/10.3102/00346543057001069

Topsakal, O., & Harper, J. B. (2024). Benchmarking large language model (LLM) performance for game playing via tic-tac-toe. Electronics, 13(8), 1532. https://doi.org/10.3390/electronics13081532

Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes (M. Cole, V. John-Steiner, S. Scribner, & E. Souberman, Eds.). Harvard University Press. https://doi.org/10.2307/j.ctvjf9vz4

Zhong, Y., Davies, M., & Wilson, A. (2024). The impact of a dialogic intervention on a Chinese rural teacher and students’ stances towards texts. European Journal of Education, 60(1), e12816. https://doi.org/10.1111/ejed.12816




DOI: https://doi.org/10.20961/ijpte.v9i2.106168

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Nala Izzul Muna, Sri Susilogati Sumarti, Harjono Harjono Harjono, Harjito Harjito Harjito, Dimas Gilang Ramadhani

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

  

International Journal of Pedagogy and Teacher Education

Print ISSN: 2597-7792
Online ISSN: 2549-8525
Website: https://jurnal.uns.ac.id/ijpte/index
Email: ijpte@mail.uns.ac.id
Published by: Faculty of Teacher Training and Education, Universitas Sebelas Maret
Ir. Sutami Street, No. 36A, Surakarta, Jawa Tengah Indonesia