Test Items Analysis of Mathematical Problem Solving Ability using a Classical Test Theory Approach

Muhammad Rais Ridwan, Edi Istiyono, Widihastuti Widihastuti

Abstract


Abstract: This study aims to analyze the item characteristics of the mathematics problem-solving ability test instrument using the Classical Test Theory model. The data collection was based on the results of the test documentation as many as 359 students with dichotomous data. Qualitative validation analysis by experts uses the panel method, and quantitative analysis uses the Aiken index and Content Validity Ratio (CVR), while quantitative validation uses biserial point correlation. The test reliability index used the Alpha-Cronbach method. The results of qualitative validation show that all items correspond to the indicators of solving mathematical problems, but technically writing a few items needs improvement. Quantitative analysis using the Aiken index and CVR shows all items are valid with good validity. The reliability of the test is stable, with a coefficient of 0.83. Then, the test instrument consists of items with very difficult, difficult, and easy levels. All items were able to distinguish the test taker's ability and the effectiveness of the distractor to function correctly. 

Keywords: classical test theory, biserial point correlation, validity, reliability.

Abstrak: Penelitian ini bertujuan untuk menganalisis karakteristik butir soal instrumen tes kemampuan pemecahan masalah matematika menggunakan model Classical Test Theory. Pengumpulan data berdasarkan hasil dokumentasi tes sebanyak 359 siswa dengan bentuk data dikotomus. Analisis validasi kualitatif oleh ahli dengan metode panel dan analisis kuantitatif menggunakan indeks Aiken dan Content Validity Ratio (CVR) sedangkan validasi kuantitatif menggunakan korelasi poin biserial. Indeks reliabilitas tes menggunakan metode Alpha-Cronbach. Hasil validasi kualitatif menunjukkan semua butir memiliki kesesuaian dengan indikator pemecahan masalah matematika, namun secara teknis penulisan beberapa butir soal perlu perbaikan. Analisis kuantitatif menggunakan indeks Aiken dan CVR menunjukkan semua butir valid dengan validitas baik. Reliabilitas tes stabil dengan koefisien sebesar 0.83. Kemudian, instrumen tes terdiri dari butir dengan tingkat sangat sukar, sukar dan mudah. Semua butir soal mampu membedakan kemampuan peserta tes dan juga efektivitas distraktor berfungsi dengan baik.

Kata kunci: teori tes klasik, korelasi poin biserial, validitas, reliabilitas.

 

DOI: http://dx.doi.org/10.23960/jpmipa/v22i1.pp98-111


Full Text:

PDF

References


Allen, M.J., & Yen, W. (1979). Introduction to measurement theory. Monterey, CA: Brooks/Cole Publishing Company.

Azwar, S. (2009). Tes, prestasi, fungsi, dan pengembangan pengukuran prestasi belajar. Yogyakarta: Pustaka Pelajar Offset.

Azwar, S. (2013). Metode Penelitian. Yogyakarta: Pustaka Pelajar Offset.

Crocker, L., & Algina, J. (2008). lntroduction to classical & modern test theory. USA: Cengage Learning.

Ebel, R. L., & Frisbie, D. A. (1986). Essentials of educational measurement. New Jersey: Prentice Hall, Inc.

Guilford, J. P. (1956). Fundamental Statistic in Psychology and Education (3rd ed.). New York: McGraw-Hill Book Company, Inc.

Istiyono, E. (2018). Pengembangan Instrumen Penilaian dan Analisis Hasil Belajar Fisika dengan Teori Tes Klasik dan Modern. Yogyakarta: UNY Press.

Linn, R. L. (1989). Educational measurement. New York: Mac Millan Publishing.

Mardapi, D. (1998). Analisis butir dengan teori klasik dan teori respon butir [Item Analysis with Classical Theory and Item Response Theory]. Jurnal Kependidikan, 28(1), 25–34.

Mardapi, D. (2008). Teknik penyusunan instrumen tes dan non tes. Yogyakarta: Mitra Cendekia Offset.

Mardapi, D. (2017). Pengukuran, penilaian dan evaluasi pendidikan. Yogyakarta: Parama Publishing.

Mehrens, W. A. & Lehmann, I. J. (1984). Measurement and evaluation in educational and psychology. New York: Rinehart and Winston.

Oriondo, L.L. & Dallo-Antonio, E. (1998). Evaluation educational outcomes. Florentino St: Rex Printing Compagny, Inc.

Sarea, M. S., & Ruslan, R. (2019). Karakteristik butir soal: Classical test theory vs item response theory [Item characteristics: Classical test theory vs item response theory]. Jurnal Kependidikan, 13(1), 1-13.

Setiawati, F. A., Izzaty, R. E., & Hidayat, V. (2018). Evaluasi Karakteristik Psikometrik Tes Bakat Differensial dengan Teori Klasik [Evaluation of Psychometric Characteristics of Differential Aptitude Test with Classical Theory]. Humanitas Indonesian Psychological Journal, 15(1), 46-61.

Sudjiono, A. (2005). Pengantar Evaluasi Pendidikan. Jakarta: Paja Grafindo Persada.

Suhariyono, Sriyono, & Ngazizah, N. (2014). Akurasi pendekatan classical test theory dan pendekatan item response theory dalam menganalisis soal UAS Fisika semester genap kelas X SMA Negeri di Purworejo tahun pelajaran 2013/2014 [The accuracy of the classical test theory approach and the item response theory approach in analyzing the UAS Physics questions in the even semester of class X SMA Negeri in Purworejo academic year 2013/2014]. Radiasi: Jurnal Berkala Pendidikan Fisika, 5(2), 75-79.

Sunarmi, Prasetyo, T. I., & Ramadhiana, C. B. (2016). Analisis butir soal ulangan akhir semester gasal Biologi kelas X dan XI tahun pelajaran 2016/2017 di SMAN 1 Kampak berdasarkan teori tes klasik [Analysis of test items at the end of odd semester of Biology class X and XI for the 2016/2017 academic year at SMAN 1 Kampak based on classical test theory]. Jurnal Pendidikan Biologi, 8(1), 27-31.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 Jurnal Pendidikan MIPA

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

View My Stats

Creative Commons License
The copyright is reserved to The Jurnal Pendidikan MIPA that is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.