Analysis of Dichotomous Questions with IRT for Diagnostic Tests in Statistics Courses

Authors

  • Andhita Dessy Wulansari Institut Agama Islam Ponorogo

Keywords:

Dichotomous, IRT, Diagnostic, Statistics

Abstract

The results of the question item analysis can be used as diagnostic information, whether students understand the concepts, have misconceptions, and need help understanding the concepts of the lecture's material. The diagnostic test here consists of 20 multiple-choice questions to identify the level of conceptual understanding of the primary statistics material in the introductory statistics course. In this study, researchers will conduct item analysis using Item Response Theory (IRT). This research aims to determine the questions' quality and the abilities of FTIK IAIN Ponorogo students. This research is evaluative research with a quantitative descriptive approach. The research results show that in terms of model suitability, based on the AIC, BIC, and log-likelihood criteria, itfor this case, the 1PL model is the most suitable compared to the 2PL and 3PL models. Based on the ICC 1PL curve, it can be seen that item number 9 is the most accessible item, and item number 4 is the most challenging item. to the right, the difficulty level of the question item is lower, and further to the left, the difficulty level of the question is higher. The estimated value of the person's ability (person) for each participant totaling 1000 people is symbolized by p1 to p1000. The test taker's ability (ϴ) varies from -3.45106849 to 3.38603802.

References

Agustyaningrum, N., Sari, R. N., et al. (2021). Dominant Factors That Cause Students' Difficulties in Learning Abstract Algebra: A Case Study at a University in Indonesia. 14(1), 847-866.

Andariana, A., Zubaidah, S., et al. (2020). Identification of biology students’ misconceptions in human anatomy and physiology course through three-tier diagnostic test. 8(3), 1071-1085.

Bilad, M. R., Zubaidah, S., et al. (2024). Addressing the PISA 2022 Results: A Call for Reinvigorating Indonesia’s Education System. 3(1), 1-12.

Casella, G., & Berger, R. (2024). Statistical inference: CRC Press.

Gupta, S., & Kapoor, V. (2020). Fundamentals of mathematical statistics: Sultan Chand & Sons.

Hahs-Vaughn, D. L., & Lomax, R. G. (2020). An introduction to statistical concepts: Routledge.

Hambleton, R. K. (1991). Fundamentals of item response theory: Sage.

Hambleton, R. K., & Swaminathan, H. (2013). Item response theory: Principles and applications: Springer Science & Business Media.

Hiltunen, J., Ahonen, A., et al. (2023). PISA 2022 ensituloksia.

Hulin, C. L., Drasgow, F., et al. (1983). Item response theory: Application to psychological measurement.

Jonassen, D. H., & Carr, C. S. (2020). Mindtools: Affording multiple knowledge representations for learning. In Computers as cognitive tools (pp. 165-196): Routledge.

Kristidhika, D. C., Cendana, W., et al. (2020). Contextual teaching and learning to improve conceptual understanding of primary students. 2(2), 71-78.

Maki, P. L. (2023). Assessing for learning: Building a sustainable commitment across the institution: Routledge.

Mertler, C. A., Vannatta, R. A., et al. (2021). Advanced and multivariate statistical methods: Practical application and interpretation: Routledge.

Puspitasari, R., & Mufit, F. (2021). Conditions of learning physics and students’ understanding of the concept of motion during the covid-19 pandemic. Paper presented at the Journal of Physics: Conference Series.

Putra, A., & Hamidah, I. (2020). The development of five-tier diagnostic test to identify misconceptions and causes of students’ misconceptions in waves and optics materials. Paper presented at the Journal of Physics: Conference Series.

Retnawati, H. J. N. M. (2014). Teori respons butir dan penerapannya [Item response theory and its application].

Shultz, K. S., Whitney, D., et al. (2020). Measurement theory in action: Case studies and exercises: Routledge.

Sudirman, S., Son, A. L., et al. (2020). Uncovering the Students’ mathematical concept understanding ability: a based study of both students’ cognitive styles dependent and independent field in overcoming the problem of 3D Geometry. 10(1).

Suwono, H., Prasetyo, T. I., et al. (2021). Cell Biology Diagnostic Test (CBD-Test) portrays pre-service teacher misconceptions about biology cell. 55(1), 82-105.

Tumanggor, A., Kuswanto, H., et al. (2020). Using four-tier diagnostic test instruments to detect physics teacher candidates’ misconceptions: Case of mechanical wave concepts. Paper presented at the Journal of physics: conference series.

Widyaningsih, S. W., Yusuf, I., et al. (2021). The Development of the HOTS Test of Physics Based on Modern Test Theory: Question Modeling through E-Learning of Moodle LMS. 14(4), 51-68.

Wijaya, T. T., Hidayat, W., et al. (2024). Exploring contributing factors to PISA 2022 mathematics achievement: Insights from Indonesian teachers. 13(1), 139-156.

Zsido, A. N., Teleki, S. A., et al. (2020). Development of the short version of the spielberger state—trait anxiety inventory. 291, 113223.

Downloads

Published

2024-11-11

How to Cite

Wulansari, A. D. (2024). Analysis of Dichotomous Questions with IRT for Diagnostic Tests in Statistics Courses. IMEJ : Indonesian Mathematics Education Journal, 1(2), 243–258. Retrieved from https://imej.iainponorogo.ac.id/index.php/imej/article/view/28

Issue

Section

Articles