Assessing Language Reasoning Skills of Indonesian Students Using Computerized Adaptive Testing

Memet Sudaryanto, Muhammad Nur Yasir Utomo

Abstract


Language, as the fundamental means of communication, represents the symbolization of thoughts conveyed to others. Human understanding of the structure of messages relies on the speaker's language reasoning ability. This ability can be measured from the simplest to the most complex stimuli. Traditionally, assessing language reasoning has been done through written tests, which require extensive preparation and are time-consuming. This study proposes a model for measuring language reasoning ability using a Computerized Adaptive Test (CAT). The CAT adjusts the difficulty of questions in real time based on the participant's responses. If a participant answers correctly, the system presents a more challenging question. Conversely, the system selects an easier question if the participant answers incorrectly. This adaptive approach ensures a tailored and efficient assessment experience, accurately measuring the participant's abilities. The research began by developing a valid and reliable language reasoning test instrument and its quadrant class. This included determining the starting, jumping, and stopping points, culminating in the CAT design. The results of the CAT proposed in this study can map basic language reasoning skills, starting from understanding the concept of facts, applying linguistic rules according to the agreement formed in the read clauses, breaking down information into more specific forms, judging the values of ideas, combining word selection, ideas formation, and context, analogy thinking, and comparative thinking. The analysis revealed that the participants' dominant ability was in comparative thinking, which involves comparing language forms, conditions, settings, and messages in written discourse. Moreover, the CAT system proposed in this study was proven to speed up the testing process while enabling students to complete the tests according to their abilities.


Keywords


reasoning; computerized adaptive test; language; assessment;

Full Text:

PDF
rticle

References


Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012

Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Publications.

Brown, T. A., & Moore, M. T. (2012). Confirmatory factor analysis. Handbook of Structural Equation Modeling, pp. 361–379. https://psycnet.apa.org/record/2012-16551-022

Clark, S. S. (2007). Thinking locally, suing globally: The international frontiers of mass tort litigation in Australia. Defense Counsel Journal, 74, 139.

Dove, G. (2014). Thinking in words: Language as an embodied medium of thought. Topics in Cognitive Science, 6(3), 371–389. https://doi.org/10.1111/tops.12102

Furr, R. M. (2011). Evaluating psychometric properties: Dimensionality and reliability. Scale Construction and Psychometrics for Social and Personality Psychology, pp. 25–51. https://dx.doi.org/10.4135/9781446287866.n4

Green, B. F., Bock, R. D., Humphreys, L. G., Linn, R. L., & Reckase, M. D. (1984). Technical guidelines for assessing computerized adaptive tests. Journal of Educational Measurement, 21(4), 347–360. https://doi.org/10.1111/j.1745-3984.1984.tb01039.x

Greenspan, S. I., & Shanker, S. (2009). The first idea: How symbols, language, and intelligence evolved from our primate ancestors to modern humans. Da Capo Press. https://doi.org/10.1093/brain/awh564

Hambleton, R. K., & Swaminathan, H. (1991). Item response theory (Principles and applications) (p. 107). Springer Science+Business Media. https://www.springer.com/gp/book/9780898380651

Istiyono, E., Dwandaru, W. S. B., Setiawan, R., & Megawati, I. (2020). Developing of computerized adaptive testing to measure physics higher order thinking skills of senior high school students and its feasibility of use. European Journal of Educational Research, 9(1), 91–101. https://doi.org/10.12973/eu-jer.9.1.91

Kavanagh, J. M., & Szweda, C. (2017). A crisis in competency: The strategic and ethical imperative to assessing new graduate nurses’ clinical reasoning. Nursing Education Perspectives, 38(2), 57–62. https://doi.org/10.1097/01.NEP.0000000000000112

Kingsbury, G. G., & Zara, A. R. (1989). Procedures for selecting items for computerized adaptive tests. Applied Measurement in Education, 2(4), 359–375. https://doi.org/10.1207/s15324818ame0204_6

Lane, S., Raymond, M. R., & Haladyna, T. M. (2015). Handbook of test development. Routledge. https://doi.org/10.4324/9780203102961

Larson, J. W., & Madsen, H. S. (2013). Computerized adaptive language testing: Moving beyond computer-assisted testing. Calico Journal, 2(3), 32–37. https://eric.ed.gov/?id=EJ340118

Leighton, J. P. (2006). Teaching and assessing deductive reasoning skills. The Journal of Experimental Education, 74(2), 107–136. https://eric.ed.gov/?id=EJ340118

Magis, D. (2013). A note on the item information function of the four-parameter logistic model. Applied Psychological Measurement, 37(4), 304–315. https://doi.org/10.1177/0146621613475471

Perera, C. J., Sumintono, B., & Jiang, N. (2018). The psychometric validation of the Principal Practices Questionnaire based on item response theory. International Online Journal of Educational Leadership, 2(1), 21–38. https://doi.org/10.22452/iojel.vol2no1.3

Ramadhan, S., Sumiharsono, R., Mardapi, D., & Prasetyo, Z. K. (2020). The quality of test instruments constructed by teachers in Bima Regency, Indonesia: Document analysis. International Journal of Instruction, 13(2), 507–518. https://doi.org/10.29333/iji.2020.13235a

Retnawati, H. (2015). The comparison of accuracy scores on the paper and pencil testing vs. computer-based testing. Turkish Online Journal of Educational Technology-TOJET, 14(4), 135–142. https://eric.ed.gov/?id=EJ1077660

Retnawati, H., Hadi, S., Nugraha, A. C., Arlinwibowo, J., Sulistyaningsih, E., Djidu, H., & Apino, E. (2017). Implementing the computer-based national examination in Indonesian schools: The challenges and strategies. Problems of Education in the 21st Century, 75(6), 612. https://doi.org/10.33225/pec/17.75.612

Rohmadi, M., Ulya, C., Sudaryanto, M., & Ximenes, M. (2020). Feasibility analysis of basic writing and reading materials for foreign speakers. Proceedings of the 2nd Konferensi BIPA Tahunan by Postgraduate Program of Javanese Literature and Language Education in Collaboration with Association of Indonesian Language and Literature Lecturers, Surakarta: 9 November 2019. https://doi.org/10.4108/eai.9-11-2019.2295063

Ryle, A. (2012). Critique of CBT and CAT. Change for the Better, pp. 4, 1–8. https://in.sagepub.com/sites/default/files/upm-binaries/47043_07_Critique_of_CBTand_CAT.pdf

Sudaryanto, M., Mardapi, D., & Hadi, S. (2019a). Multimedia-based online test on Indonesian language receptive skills development. Journal of Physics: Conference Series, 1339(1), 1–7. https://doi.org/10.1088/1742-6596/1339/1/012120

Sudaryanto, M., Mardapi, D., & Hadi, S. (2019b). How foreign speakers implement their strategies to listen Indonesian language? Journal of Advanced Research in Dynamical and Control Systems, 11(7), 355–361. https://www.jardcs.org/abstract.php?id=2551#

Sudaryanto, M., Ulya, C., Rohmadi, M., & Kuhafeesah, K. (2020). Inter-rater assessment on listening media for foreign language speakers. Proceedings of the 2nd Konferensi BIPA Tahunan by Postgraduate Program of Javanese Literature and Language Education in Collaboration with Association of Indonesian Language and Literature Lecturers, Surakarta: 9 November 2019. https://doi.org/10.4108/eai.9-11-2019.2295064

Sumintono, B. (2018). Rasch model measurements as tools in assessment for learning. Advances in Social Science, Education and Humanities Research, 17(3), 38–42. https://doi.org/10.2991/icei-17.2018.11

Triyono, Senam, Jumadi, & Wilujeng, I. (2017). The effects of creative problem solving-based learning towards students’ creativities. Jurnal Kependidikan: Penelitian Inovasi Pembelajaran, 1(2), 214–226. https://doi.org/10.21831/jk.v1i2.9429

Wainer, H., Dorans, N. J., Flaugher, R., Green, B. F., & Mislevy, R. J. (2000). Computerized adaptive testing: A primer. Routledge. https://doi.org/10.4324/9781410605931

Weiss, D. J., & Kingsbury, G. G. (1984). Application of computerized adaptive testing to educational problems. Journal of Educational Measurement, 21(4), 361–375. https://doi.org/10.1111/j.1745-3984.1984.tb01040.x




DOI: https://doi.org/10.20961/ijpte.v8i1.89913

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Memet Sudaryanto, Muhammad Nur Yasir Utomo

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

slot online

nasa4d

nasa4d

togel online

slot

slot gacor

sensa138

slot 5000

situs toto

toto slot

agen judi bola

togel online

slot gacor hari ini

togel online

kakektogel

Majikantoto

slot gacor

mcr4d

mcr4d

sabung ayam

batmantoto

slot gacor

preman68

slot gacor

slot online

poker

slot gacor

https://advertisingseeker.com/

slot gacor

slot online

https://nmims.edu/

slot gacor

situs toto

toto 4d

situs slot

elegant-sophisticated.net

slot pulsa

parlay

slot gacor

slot

slot88

rokokbet

slot88

slot gacor

rokokbet

slot resmi

rokokbet

https://sandiegohills.org/

Situs Toto

Situs Toto

Dana4d

Situs Toto

Pan4D

Toto 4d

slot777

https://lppm.stba-jia.ac.id/

https://ppki.stba-jia.ac.id/

https://journal.iainkudus.id/

https://pmb.iainkudus.id/

https://jim.iainkudus.id/

https://iainkudus.id/

slot777

Situs Toto

Slot777

SITUS TOTO

PAN4D

PAN4D

Slot88

Toto 4d

situs toto

Slot88

https://pjam.propelmas.com/

https://ignitercasino.id/

situs toto

slot

slot thailand

bonus new member 100

slot bet 100

slot777

bonus 138

LINK GACOR

slot gacor

bandar togel

toto slot

kehebohan freddy main mahjong ways 2 bareng teman di kosan

arif naik bet langsung dapat 3 scatter di mahjong ways

zaki begadang tengah malam menang besar di mahjong ways

tomi subuh subuh main mahjong ways dapat scatter 3x langsung cair

perkalian x10 freespin bikin fandi menang besar di mahjong ways 2

penjual kopi raup jackpot di mahjong ways 2 tanpa pola ribet

modal 50 ribu tembus 5 juta kemenangan besar di mahjong ways

pemuda bandung dapat perkalian x10 di mahjong ways 2 tembus 11 juta

petani solo dapat scatter beruntun di mahjong ways tembus 8 juta

misteri freespin muncul 3x beruntun dengan perkalian x10 di mahjong ways

pecahan wild bawa kemenangan besar di mahjong ways

freespin tak terduga tembus 5 juta dengan bet kecil mahjong ways 2

pengalaman daniel dapat freespin jadi kemenangan besar di mahjong ways

eko dapat freespin beruntun bawa kemenangan emas di mahjong ways 2

rahasia scatter merah penuh selayar di mahjong ways

raih kemenangan besar tanpa modal besar bisa cuan harian

jackpot unik bawa kemenangan ekstra di mahjong ways 2

pemuda bogor dapat rezeki nomplok dari mahjong ways 2

cara mudah cari uang jajan tambahan setelah pulang kerja

main mahjong ways bisa cuan setiap hari dengan modal kecil

kisah sukses pegawai tangerang dapat kemenangan 15 juta mahjong ways

pemuda medan dapat rezeki nomplok freespin mahjong ways saat ngopi

jordi pemuda bali freespin ke 8 bawa kemenangan 20 juta mahjong ways 2

satu freespin bawa keuntungan besar jadi jutaan di mahjong ways

keajaiban freespin bawa rezeki besar saldo naik drastis

andri raih cuan besar dari freespin gratis mahjong ways

kemenangan beruntun bikin andre raih rezeki emas di mahjong ways 2

kejutan freespin bikin saldo damar melejit di mahjong ways

rahasia kemenangan mahjong ways 1 dan 2 member baru wede besar

satu freespin bawa kehebohan haris raih kemenangan 19 juta di layar

firman nemu hoki dari spin biasa dapat freespin x10 di mahjong ways

trik main mahjong biar profit terus tanpa modal besar wajib coba

hamid gak nyangka satu kali depo bawa jackpot besar mahjong ways

jefri penasaran coba mahjong ways 2 dari 50 ribu jadi jutaan

tomi spin mahjong ways saat ngantuk dapat freespin 11 juta

paul raih kemenangan pertama 1 juta dengan modal 20 ribu langusng cuan

bongkar trik anton pakai spin turbo 15x panggil scatter

kisah freespin bawa kemenangan besar 12 juta di mahjong ways

rendi dapat kejutan kemenangan besar di mahjong ways

keberuntungan tak terduga bawa rezeki besar di mahjong ways 2

freespin mahjong ways bikin ridwan cuan rp 11 200 000 di tengah malam

samsul pekerja pabrik menang besar di mahjong ways dan ubah hidup

rahasia andri main mahjong ways santai bisa dapat hasil maksimal

cerita ahmad main mahjong ways saat malam dan dapat hasil maksimal

malam hujan johan coba mahjong ways 2 dan freespin muncul tak terduga

kejutan malam untuk randy saat main mahjong ways tanpa pola

rio dapat momen tak terduga dari pecahan x10 di mahjong ways

momen spesial dengan x10 di mahjong ways bawa hasil luar biasa

cerita farhan main mahjong ways 2 dan spin kelima dapat freespin

cerita rizki dapat kemenangan besar di mahjong ways

freespin ke tujuh ilham bawa kejutan manis 5 juta

modal 50 ribu member baru raih kemenangan di mahjong ways

rahasia kemenangan anton di mahjong ways modal 40 ribu

spin turbo santai di kamar bawa kejutan untuk deni di mahjong ways 2

cerita farhan main mahjong ways 2 dan spin kelima dapat freespin

tono dapat kemenangan besar dari freespin di mahjong malam itu

antara kebetulan atau keberuntungan rifki kena freespin mahjong ways 2

andre berhasil raih kemenangan besar dengan freespin x10 mahjong ways

freespin ubah mood ridwan seharian di mahjong ways

kemenangan tak terduga fahri di tengah malam mahjong ways 2

cerita menarik scatter merah dan kemenangan besar mahjong ways 2

cerita leo dan keberuntungan dari mahjong ways beli iphone 16

waktu luang anton berujung kemenangan modal 25 ribu bawa pulang 3 juta

suara freespin pagi hari bikin tomi melek mahjong ways berikan kejutan

cerita unik fahri saat freespin datang tanpa di duga di mahjong ways 2

main mahjong ways 2 pecah tanpa drama

strategi mahjong ways modal receh dengan hasil maksimal

mahjong ways penuh kejutan dan jackpot hari ini

cerita kemenangan berkesan di mahjong ways dari pemain pemula

modal 20 ribu di mahjong ways 2 bawa kemenangan besar

simbol scatter mahjong ways bawa peluang jackpot besar

mahjong ways server thailand gampang dapat simbol scatter

main mahjong ways disini peluang wd terus dengan modal tipis

peluang besar untuk member baru wede di mahjong ways

rahasia bermain mahjong ways 2 strategi yang bisa dipakai rutin

awalnya ikut teman kantor akhirnya jackpot di mahjong ways

cerita fandi tunggu kereta ketemu hoki di mahjong ways 2

saldo naik drastis saat dion dapat freespin mahjong ways 2

cerita lucu rizal panik lihat layar meledak freespin mahjong ways

scatter muncul satu per satu di mahjong pertanda keberuntungan

awal main mahjong ways langsung buka freespin dari 3 scatter

baru 4 spin mahjong wins 3 hadirkan deretan wild di tengah reels

pertengahan game mahjong ways 2 tiba tiba munculkan bonus mini

main 7 spin di mahjong langsung picu double scatter dan freespin

awal spin mahjong wins 3 sudah aktifkan megawild beruntun

baru 6 spin mahjong ways mendadak borong wild dan scatter

di spin ke 9 mahjong ways 2 aktifkan bonus freespin besar

main sebentar di mahjong langsung buka 3 wild berjejer

awal main mahjong ways 2 tak disangka picu double scatter

baru buka mahjong wins 3 sudah hadirkan wild di dua reels

toto togel

toto slot

https://journals.essrak.org/

https://testss.hait.od.ua/

slot thailand

toto slot

toto slot

slot gacor hari ini

toto togel

mahjong ways

miya4d

toto togel

toto slot

situs toto

arista88

slot toto

situs slot gacor

mahjong

magnum188

Dewaslot88

laetoto

spaceman

agen toto play

slot

slot777

bonus new member 100

mahjong slot

Manjur55

spaceman

mdg188

pstoto99

visi4d

slot gacor

slot777

DPRBET

dollar4d

dewaslot88.eu.com

roda4d

mcmbola

hoki99

situs slot

roda4d

toto slot

situs slot gacor

dewahoki

tiga37

PSTOTO99

levis4d

batmantoto

erek erek

slot gacor

qqpulsa

mastogel

batmantoto

Situs Toto

slot gacor

slot88

https://nanostix.co.id/sp2/

lagi4d

https://malcolmhurst.com/

https://xinuosco.com/

https://reportertatu.com/

situs toto

kosmik 4d

bandar togel

situs togel

DUNIATOTO

indo911

situs toto

dewagaruda

coktogel

coktogel

miya4d

Toto Togel

erek erek

levis4d

javtogel

slot

https://micromaterialsresearch.com/

https://tvwesal.com/

toto slot

AMARTOTO

slot

paitogel

ceri123

slot

spaceman slot

Slot777

Situs Slot Gacor

miya4d

slot longhoki

MOM4D

omtogel

toto slot

paitogel

  

International Journal of Pedagogy and Teacher Education

Print ISSN: 2597-7792
Online ISSN: 2549-8525
Website: https://jurnal.uns.ac.id/ijpte/index
Email: ijpte@mail.uns.ac.id
Published by: Faculty of Teacher Training and Education, Universitas Sebelas Maret
Ir. Sutami Street, No. 36A, Surakarta, Jawa Tengah Indonesia

toto togel

slot gacor

titan777

988slot

988bet

slot88

rokokbet

slot gacor

rokokbet

situs gacor

rokokbet

slot777

rokokbet

slot gacor maxwin

https://sandiegohills.org/

https://journal.iainkudus.id/

Situs Toto

Situs Toto

Dana4d

Ppatk

Situs Toto

Toto 4d

Pan4D

Slot88

Toto 4d

https://for4d.mystrikingly.com/

https://ai-photonics.com/

https://isma.edu.pk/

https://tibafs.com/

https://biosuss.com/

https://persydiamondstore.com/contact-us/

Nana4D

slot gacor

https://cogentworkshop.coconutcommunity.org/

SLOT GACOR

IDCOIN188

slot777

slot gacor

slot777

slot gacor

slot gacor

slot777

merahtoto

merahtoto

slot777

hijautoto

kuningtoto

game slot

kuningtoto slot

kuningtoto

link kuningtoto

birutoto

birutoto

slot gacor

ungutoto

link ungutoto

slot gacor

ungutoto

game online

togel online 4d

tototogel

bandar togel

slot777

situs gacor hari ini

situs gacor maxwin

ungutoto

slot gacor maxwin

hijautoto

hijautoto

scatter hitam bikin pengrajin kaligrafi di cianjur tersenyum saat lembur

sore itu penjual tas anyaman pasar kaget dapat scatter hitam lebih dari sekali

saat nunggu anak pulang ngaji wanita penjual es serut ini kenal scatter hitam

awalnya tak sengaja tetapi scatter hitam bikin mantan satgas covid ketagihan

penata rambut pensiun di kampung miliki cerita unik soal scatter hitam

jarang diketahui kolektor kalender jadul ini selalu santai main mahjong ways 2

mahjong ways 2 jadi hiburan favorit pembuat raket bulu tangkis rumahan

awalnya tukang fotocopy di sekolah negeri ini ragu coba mahjong ways 2

pria perakit ac eks pabrik elektronik curi curi waktu main mahjong ways 2

sebelum berangkat ngamen ibu pemain angklung punya kebiasaan cek mahjong ways 2

cerita nyata edi dapat freespin 3x di mahjong ways 2 malam hari

raka gak nyangka scatter mahjong muncul saat lagi beresin kamar

scatter hitam di mahjong ways bikin ramzi jadi senang seharian

pas lagi nyantai di angkringan andre malah dapat freespin

spin pertama mahjong ways 2 bikin yusuf bingung dan kaya

dapat rp 8.300.000 di mahjong ways saat rangga bosan di kantor

jam 2 subuh alwi cuma niat ngecek mahjong ways tapi malah cuan

freespin anton di mahjong ways 2 bikin heboh satu warung

cerita yusuf menang mahjong ways 2 saat hujan deras

galih ternyata hoki di mahjong ways saat lagi di kos teman

indra main mahjong ways 2 dan tembus 4 juta dalam 1 jam

bayu sambil nunggu teman malah jackpot di mahjong ways

agus dapet rezeki mendadak dari freespin mahjong ways 2

yoga menang 5 juta lewat spin malam di mahjong ways

dika coba coba main mahjong ways 2 eh malah profit banyak

ridho berhasil wede 3 6 juta setelah main mahjong ways

toni main mahjong ways 2 sambil ngopi dan dapet jackpot

faris dapet keberuntungan pagi di mahjong ways

irfan tembus 7 juta lewat freespin mahjong ways 2

zaki main iseng mahjong ways berakhir menang 4 juta

hijautoto

hijautoto

birutoto

slot88

merahtoto

slot88

hijautoto

merona4d

merona4d

merona4d

merona4d

merona4d

merona4d

merona4d

merona4d

merona4d

slot gacor terbaru

birutoto

birutoto

hijautoto

kuningtoto

slot777

slot gacor hari ini