UPSI Digital Repository (UDRep)
Start | FAQ | About
Menu Icon

QR Code Link :

Type :article
Subject :T Technology (General)
ISSN :0305-5698
Main Author :Noor Hidayah Che Lah
Title :Applying alternative method to evaluate online problem-solving skill inventory (OPSI) using Rasch model analysis
Place of Production :Tanjung Malim
Publisher :Fakulti Komputeran dan Meta Teknologi
Year of Publication :2023
Notes :Educational Studies
Corporate Name :Universiti Pendidikan Sultan Idris
HTTP Link :Click to view web link

Abstract : Universiti Pendidikan Sultan Idris
The aim of the study was to evaluate the extended version of the Problem-Solving Inventory (PSI) via an online learning setting known as the Online Problem-Solving Inventory (OPSI) through the lens of Rasch Model analysis. To date, there is no extended version of the PSI for online settings even though many researchers have used it; thus, this study validated the OPSI taking into account evidence based on Rasch model analysis. Firstly, the OPSI employed content validation by three experts. The result of the percent agreement showed that the overall percent agreement of the OPSI is 95.05% which consists of six constructs: impulsive style, reflective style, problem-solving confidence, avoidance style, monitoring, and planfulness. Next, eight measurement properties of Rasch model analysis were employed with the OPSI among 49 undergraduate students in Malaysia. The results revealed that 19 respondents needed to be dropped according to Rasch model analysis. Next, retained 30 respondents continued to perform item analysis using Rasch model. The results revealed that 11 items need to be dropped. Rasch model analysis provided strong evidence to show the 22 retained items in OPSI are fit, valid, and reliable to measure problem-solving skills in an online learning setting in an educational field. 2021 Informa UK Limited, trading as Taylor & Francis Group.

References

Abdollahi, A., M. A. Talib, S. N. Yaacob, and Z. Ismail. 2015. “Problem-solving Skills Appraisal Mediates Hardiness and Suicidal Ideation among Malaysian Undergraduate Students.” PloS One 10 (4): e0122222. doi:10.1371/journal.pone.0122222.

Abdullah, A. H., N. L. Z. Abidin, and M. Ali. 2015. “Analysis of Students’ Errors in Solving Higher Order Thinking Skills (HOTS) Problems for the Topic of Fraction.” Asian Social Science 11 (21): 133. doi:10.5539/ass.v11n21p133.

Alias, M., Z. Iksan, A. Karim, A. Nawawi, and S. Nawawi. 2020. “A Novel Approach in Problem-solving Skills Using Flipped Classroom Technique.” Creative Education 11 (1): 38–53. doi:10.4236/ce.2020.111003.

Alnahdi, G. H. 2019. “Rasch Validation of the Arabic Version of the Teacher Efficacy for Inclusive Practices (TEIP) Scale.” Studies in Educational Evaluation 62: 104–110. doi:10.1016/j.stueduc.2019.05.004.

Andrich, D. 1988. “A General Form of Rasch’s Extended Logistic Model for Partial Credit Scoring.” Applied Measurement in Education 1 (4): 363–378. doi:10.1207/s15324818ame0104_7.

Aryadoust, V. 2018. “Using Recursive Partitioning Rasch Trees to Investigate Differential Item Functioning in Second Language Reading Tests.” Studies in Educational Evaluation 56: 197–204. doi:10.1016/j.stueduc.2018.01.003.

Awang, Z. 2015. SEM Made Simple. A Gentle Approach to Learning Structural Equation Modelling. 1st ed. Bandar Baru Bangi, Selangor: MPWS Rich Publication Sdn. Bhd.

Aziz, A. A. 2010. Rasch Model Fundamentals: Scale Construct and Measurement Structure. Kuala Lumpur: Perpustakaan Negara Malaysia

Aziz, A. A., A. Arshad, N. Zakaria, and S. Masodi. 2007. “Appraisal of Course Learning Outcomes Using Rasch Model: A Case Study in Information Technology Education.” International Journal of Systems Applications, Engineering and Development 1 (4).

Aziz, A. A., M. S. Masodi, and A. Zaharim. 2013. Asas Model Pengukuran Rasch: Pembentukan Skala Dan Struktur Pengukuran. Malaysia: Penerbit Universiti Kebangsaan.

Bakar, A. N., and A. B. Bhasah. 2008. Penaksiran Dalam Pendidikan & Sains Sosial. Tanjong Malim: Penerbit UPSI.

Baylor, C., W. Hula, N. J. Donovan, P. J. Doyle, D. Kendall, and K. Yorkston. 2011. “An Introduction to Item Response Theory and Rasch Models for Speech-language Pathologists.” American Journal of Speech-Language Pathology 20 (3): 243–259. doi:10.1044/1058-0360(2011/10-0079).

Bode, R. K., and B. D. Wright. 1999. “Rasch Measurement in Higher Education.” In Higher Education: Handbook of Theory and Research, edited by J. C. Smart and W. G. Tierney, 14. Dordrecht: Springer. h ttps://d o i-o rg.ezproxy.utm.my/1 0.1 007/978-94-011-3955-7_7

Bond, T. G., and C. M. Fox. 2007. Applying the Rasch Model: Fundamental Measurement in the Human Sciences. (second edition). London: Lawrence Erlbaum Associates Publishers.

Chan, D. W. 2001. “Dimensionality and Correlates of Problem Solving: The Use of the Problem Solving Inventory in the Chinese Context.” Behaviour Research and Therapy 39 (7): 859–875. doi:10.1016/S0005-7967(00)00082-6.

Coe, R. 2008. “Comparability of GCSE Examinations in Different Subjects: An Application of the Rasch Model.” Oxford Review of Education 34 (5): 609–636. doi:10.1080/03054980801970312.

Cook, J. D., S. J. Hepworth, T. D. Wall, and P. B. Warr. 1981. The Experience of Work. London: Academic Press.Curtis, D. D. 2004. “Person Misfit in Attitude Surveys: Influences, Impacts and Implications.” International Education Journal 5 (2): 125–144.

De Ayala, R. J. 2008. “Multivariate and Mixture Distribution Rasch Models by Von Davier & Carstensen.” Applied Measurement in Education 21 (2): 182–186. doi:10.1080/ 08957340801934692.

Engelhard Jr., J. G. 1992. “The Measurement of Writing Ability with a Many-faceted Rasch Model.” Applied Measurement in Education 5 (3): 171–191. doi:10.1207/s15324818ame0503_1.

Fisher, W. P. J. 2007. “Rating Scale Instrument Quality Criteria.” Rasch Measurement Transaction 21 (1): 1095.

Ghandi, P. S. 2012. “Calculating and Interpreting Reliability Estimates for Achievement Test in Graph Theory (A Modern Branch of Mathematics).” International Indexed & Referred Research Journal 5: 36-3.

Gillies, R. M., A. Carroll, R. Cunnington, M. Rafter, K. Palghat, J. Bednark, and A. Bourgeois. 2016. “Multimodal Representations during an Inquiry Problem-solving Activity in A Year 6 Science Class: A Case Study Investigating Cooperation, Physiological Arousal and Belief States.” Australian Journal of Education 60 (2): 111–127. doi:10.1177/0004944116650701.

Harvey, R. J., R. S. Billings, and K. J. Nilan. 1985. “Confirmatory Factor Analysis of the Job Diagnostic Survey: Good News and Bad News.” Journal of Applied Psychology 70 (3): 461. doi:10.1037/0021- 9010.70.3.461.

Heppner, P. P., and C. H. Petersen. 1982. “The Development and Implications of a Personal Problem Solving Inventory.” Journal of Counseling Psychology 29 (1): 66–75. doi:10.1037/0022- 0167.29.1.66.

Heppner, P. P., T. E. Witty, and W. A. Dixon. 2004. “Problem-solving Appraisal and Human Adjustment: A Review of 20 Years of Research Using the Problem Solving Inventory.” The Counseling Psychologist 32 (3): 344–428. doi:10.1177/0011000003262793.

Hinkin, T. R. 1998. “A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires.” Organizational Research Methods 1 (1): 104–121. doi:10.1177/ 109442819800100106.

Hissbach, J. C., D. Klusmann, and W. Hampe. 2011. “Dimensionality and Predictive Validity of the HAM-Nat, a Test of Natural Sciences for Medical School Admission.” BMC Medical Education 11 (1). Article 83. doi:10.1186/1472-6920-11-83.

Huang, Y. P. 2005. “Exploring the Validity of the Problem Solving Inventory with Mexican American High School Students.” Doctoral dissertation, University of Missouri–Columbia.

Huang, Y. P., and L. Y. Flores. 2011. “Exploring the Validity of the Problem-solving Inventory with Mexican American High School Students.” Journal of Career Assessment 19 (4): 431–441. doi:10.1177/1069072711409720.

Ismail, W., W. O. Ali Saifuddin, and H. Noraini. 2017. “Critical Thinking and Problem Solving Skills among Engineering Students at Public Universities in Malaysia.” 2017 7th World Engineering Education Forum (WEEF), Kuala Lumpur, 262–267. doi:10.1109/WEEF.2017.8466969.

Ji, M., S. M. Sereika, J. M. Rohay, and J. A. Erlen. 2018. “Psychometric Properties of the Problem Solving Inventory in Caregivers of Individuals with Memory Loss.” Journal of Gerontological Nursing 44 (6): 25–32. doi:10.3928/00989134-20180509-05.


This material may be protected under Copyright Act which governs the making of photocopies or reproductions of copyrighted materials.
You may use the digitized material for private study, scholarship, or research.

Back to previous page

Installed and configured by Bahagian Automasi, Perpustakaan Tuanku Bainun, Universiti Pendidikan Sultan Idris
If you have enquiries, kindly contact us at pustakasys@upsi.edu.my or 016-3630263. Office hours only.