Construction of an item bank using Rasch analysis

Suhaila Bahrom

Abstract

Constructing examination papers has been a lengthy and tedious procedure that is commonly raise by issues with content validity, reliability, and fairness. Therefore, investigating alternative methods such as item banking using Rasch analysis may present a more practical and efficient approach for creating assessments. This study aims to demonstrate how to develop an item bank using Rasch analysis and assess the reliability and validity of the final exam paper for a statistics course that uses item bank as its foundation. In this research, Statistics course which consist of 7 questions are divided into 21 items based on test specification table (TST). The results from Rasch analysis are recorded in an item bank interface created by using excel. The item bank interface facilitates easy access to a large variety of pretested items, allowing for the creation of diverse and balanced exam papers. A well-developed item bank will be a great assistance to exam setters as it makes the process of creating tests easier, faster, and more efficient, which leads to higher-quality examination questions paper. Keywords item bank, rasch-analysis, reliability

References

B. D. Wright and S. R. Bell, “Item Banks: What, Why, How,” J Educ Meas, vol. 21, no. 4, 1984, doi: 10.1111/j.1745-3984.1984.tb01038.x..

A. Nuntiyagul, K. Naruedomkul, N. Cercone, and D. Wongsawang, “Adaptable learning assistant for item bank management,” Comput Educ, vol. 50, no. 1, 2008, doi: 10.1016/j.compedu.2006.07.003.

A. Zainol, “Designing a Question Bank Management System to Support Outcome-Based Education Approach,” International Journal Of Computer Science And Network Security, vol. 20, no. 4, 2020.

M. A. Hossain, P. M. Menz, and J. M. Stockie, “An Open-Access Clicker Question Bank for Numerical Analysis,” PRIMUS, vol. 32, no. 8, 2022, doi: 10.1080/10511970.2021.1954113.

D. Salibašić Glamočić et al., “Maintaining item banks with the Rasch model: An example from wave optics,” Phys Rev Phys Educ Res, vol. 17, no. 1, 2021, doi: 10.1103/PhysRevPhysEducRes.17.010105.

Robitaille, David F., and Thomas O’Shea. “The Development of an Item Bank in Mathematics Using the Rasch Model.” Canadian Journal of Education / Revue Canadienne de l’éducation 8, no. 1 (1983): 57–70.

https://doi.org/10.2307/1494406.

S. L. Wong and S. L. Wong, “Relationship between interest and mathematics performance in a technology-enhanced learning context in Malaysia,” Res Pract Technol Enhanc Learn, vol. 14, no. 1, 2019, doi: 10.1186/s41039-019-01143

C. Chuesathuchon and R. Waugh, “Item banking and computerized adaptive testing with rasch measurement: An example for primary mathematics in Thailand,” in Applications of Rasch Measurement in Education, 2012.

M. J. Gierl and H. Lai, “The Role of Item Models in Automatic Item Generation,” Int J Test, vol. 12, no. 3, 2012, doi: 10.1080/15305058.2011.635830.

M. Cupani, T. C. Zamparella, G. Piumatti, and G. Vinculado, “Development of an Item Bank for the Assessment of Knowledge on Biology in Argentine University Students,” J Appl Meas, vol. 18, no. 3, 2017.