UPSI Digital Repository (UDRep)
|
UPSI Digital Repository (UDRep)
|
|
|
| ||||||||||||||||||||||||
| Abstract : Universiti Pendidikan Sultan Idris |
| The aim of the study was to evaluate the extended version of the Problem-Solving Inventory (PSI) via an online learning setting known as the Online Problem-Solving Inventory (OPSI) through the lens of Rasch Model analysis. To date, there is no extended version of the PSI for online settings even though many researchers have used it; thus, this study validated the OPSI taking into account evidence based on Rasch model analysis. Firstly, the OPSI employed content validation by three experts. The result of the percent agreement showed that the overall percent agreement of the OPSI is 95.05% which consists of six constructs: impulsive style, reflective style, problem-solving confidence, avoidance style, monitoring, and planfulness. Next, eight measurement properties of Rasch model analysis were employed with the OPSI among 49 undergraduate students in Malaysia. The results revealed that 19 respondents needed to be dropped according to Rasch model analysis. Next, retained 30 respondents continued to perform item analysis using Rasch model. The results revealed that 11 items need to be dropped. Rasch model analysis provided strong evidence to show the 22 retained items in OPSI are fit, valid, and reliable to measure problem-solving skills in an online learning setting in an educational field. ? 2021 Informa UK Limited, trading as Taylor & Francis Group. |
| References |
Abdollahi, A., Talib, M. A., Yaacob, S. N., & Ismail, Z. (2015). Problem-solving skills appraisal mediates hardiness and suicidal ideation among malaysian undergraduate students. PLoS ONE, 10(4) doi:10.1371/journal.pone.0122222 Abdullah, A. H., Abidin, N. L. Z., & Ali, M. (2015). Analysis of students’ errors in solving higher order thinking skills (HOTS) problems for the topic of fraction. Asian Social Science, 11(21), 133-142. doi:10.5539/ass.v11n21p133 Alias, M., Iksan, Z. H., Karim, A. A., Nawawi, A. M. H. M., & Nawawi, S. R. M. (2020). A novel approach in problem-solving skills using flipped classroom technique. Creative Education, 11(1), 38-49. Retrieved from www.scopus.com Alnahdi, G. H. (2019). Rasch validation of the arabic version of the teacher efficacy for inclusive practices (TEIP)scale. Studies in Educational Evaluation, 62, 104-110. doi:10.1016/j.stueduc.2019.05.004 Andrich, D. (1988). A general form of rasch’s extended logistic model for partial credit scoring. Applied Measurement in Education, 1(4), 363-378. doi:10.1207/s15324818ame0104_7 Aryadoust, V. (2018). Using recursive partitioning rasch trees to investigate differential item functioning in second language reading tests. Studies in Educational Evaluation, 56, 197-204. doi:10.1016/j.stueduc.2018.01.003 Awang, Z. (2015). SEM made simple: A gentle approach to learning structural equation modeling. SEM made Simple: A Gentle Approach to Learning Structural Equation Modeling, Retrieved from www.scopus.com Aziz, A. A. (2010). Rasch Model Fundamentals: Scale Construct and Measurement Structure, Retrieved from www.scopus.com Aziz, A. A., Masodi, M. S., & Zaharim, A. (2013). Asas Model Pengukuran Rasch: Pembentukan Skala & Struktur Pengukuran (Pertama), Retrieved from www.scopus.com Baylor, C., Hula, W., Donovan, N. J., Doyle, P. J., Kendall, D., & Yorkston, K. (2011). An introduction to item response theory and rasch models for speech-language pathologists. American Journal of Speech-Language Pathology, 20(3), 243-259. doi:10.1044/1058-0360(2011/10-0079) Bode, R. K., & Wright, B. D. (1999). Rasch measurement in higher education. Higher Education: Handbook of Theory and Research, 14, 287-316. Retrieved from www.scopus.com Bond, T. G., & Fox, C. M. (2007). Applying the rasch model: Fundamental measurement in the human sciences: Second edition. Applying the rasch model: Fundamental measurement in the human sciences: Second edition (pp. 1-340) doi:10.4324/9781410614575 Retrieved from www.scopus.com Chan, D. W. (2001). Dimensionality and correlates of problem solving: The use of the problem solving inventory in the chinese context. Behaviour Research and Therapy, 39(7), 859-875. doi:10.1016/S0005-7967(00)00082-6 Coe, R. (2008). Comparability of GCSE examinations in different subjects: An application of the rasch model. Oxford Review of Education, 34(5), 609-636. doi:10.1080/03054980801970312 Cook, J. D., Hepworth, S. J., Wall, T. D., & Warr, P. B. (1981). The experience of work: A compendium and review of 249 measures and their use. The Experience of Work: A Compendium and Review of 249 Measures and their use, Retrieved from www.scopus.com Curtis, D. D. (2004). Person misfit in attitude surveys: Influences, impacts and implications. International Education Journal, 5(2), 125-143. Retrieved from www.scopus.com De Ayala, R. J. (2008). Multivariate and mixture distribution rasch models by von davier & carstensen. Applied Measurement in Education, 21(2), 182-186. Retrieved from www.scopus.com Engelhard, G., Jr. (1992). The measurement of writing ability with a many-faceted rasch model. Applied Measurement in Education, 5(3), 171-191. doi:10.1207/s15324818ame0503_1 Fisher, W. P. (2007). Rating scale instrument quality criteria. Rasch Measurement Transactions, 21(1) Retrieved from www.scopus.com Ghandi, P. S. (2012). Calculating and interpreting reliability estimates for achievement test in graph theory (A modern branch of mathematics). International Indexed & Referred Research Journal, 5, 36-38. Retrieved from www.scopus.com Gillies, R. M., Carroll, A., Cunnington, R., Rafter, M., Palghat, K., Bednark, J., & Bourgeois, A. (2016). Multimodal representations during an inquiry problem-solving activity in a year 6 science class: A case study investigating cooperation, physiological arousal and belief states. Australian Journal of Education, 60(2), 111-127. doi:10.1177/0004944116650701 Harvey, R. J., Billings, R. S., & Nilan, K. J. (1985). Confirmatory factor analysis of the job diagnostic survey. good news and bad news. Journal of Applied Psychology, 70(3), 461-468. doi:10.1037/0021-9010.70.3.461 Heppner, P. P., & Petersen, C. H. (1982). The development and implications of a personal problem-solving inventory. Journal of Counseling Psychology, 29(1), 66-75. doi:10.1037/0022-0167.29.1.66 Heppner, P. P., Witty, T. E., & Dixon, W. A. (2004). Problem-solving appraisal and human adjustment: A review of 20 years of research using the problem solving inventory. The Counseling Psychologist, 32(3), 344-428. doi:10.1177/0011000003262793 Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1(1), 104-121. doi:10.1177/109442819800100106 Hissbach, J. C., Klusmann, D., & Hampe, W. (2011). Dimensionality and predictive validity of the HAM-nat, a test of natural sciences for medical school admission. BMC Medical Education, 11(1) doi:10.1186/1472-6920-11-83 Huang, Y. P. (2005). Exploring the Validity of the Problem Solving Inventory with Mexican American High School Students, Retrieved from www.scopus.com Huang, Y. -., & Flores, L. Y. (2011). Exploring the validity of the problem-solving inventory with mexican american high school students. Journal of Career Assessment, 19(4), 431-441. doi:10.1177/1069072711409720 Ismail, W., Ali Saifuddin, W. O., & Noraini, H. (2018). Critical thinking and problem solving skills among engineering students at public universities in malaysia. Paper presented at the Proceedings - 2017 7th World Engineering Education Forum, WEEF 2017- in Conjunction with: 7th Regional Conference on Engineering Education and Research in Higher Education 2017, RCEE and RHEd 2017, 1st International STEAM Education Conference, STEAMEC 2017 and 4th Innovative Practices in Higher Education Expo 2017, I-PHEX 2017, 262-267. doi:10.1109/WEEF.2017.8466969 Retrieved from www.scopus.com Ji, M., Sereika, S. M., Rohay, J. M., & Erlen, J. A. (2018). Psychometric properties of the problem solving in ventory in caregivers of individuals with memory loss. Journal of Gerontological Nursing, 44(6), 25-32. doi:10.3928/00989134-20180509-05 Kadir, Z. A., Abdullah, N. H., Anthony, E., Salleh, B. M., & Kamarulzaman, R. (2016). Does problem-based learning improve problem solving skills? – A study among business undergraduates at malaysian premier technical university. International Education Studies, 9(5), 166-172. Retrieved from www.scopus.com Kourmousi, N., Xythali, V., Theologitou, M., & Koutras, V. (2016). Validity and reliability of the problem solving inventory (PSI) in a nationwide sample of greek educators. Social Sciences, 5(2) doi:10.3390/socsci5020025 Kuo, F. R., Hwang, G. J., & Lee, C. C. (2012). A hybrid approach to promoting N web-based problem solving competence and learning attitude. Computers & Education, 28(4), 253-263. Retrieved from www.scopus.com Lah, N. H. C., & Tasir, Z. (2018). Measuring reliability and validity of questionnaire on online social presence: A rasch model analysis. Advanced Science Letters, 24(11), 7900-7903. Retrieved from www.scopus.com Linacre, J. M. (1994). Sample size and item calibration stability. Rasch Measurement Transactions, 7(4), 328. Retrieved from www.scopus.com Linacre, J. M. (2002). What do infit and outfit, mean-square and standardized mean? Rasch Measurement Transactions, 16(2) Retrieved from www.scopus.com Micoogullari, B. O., & Ekmekci, R. (2018). Adaptation Study of the Problem Solving Inventory on the Turkish Athlete Population, Retrieved from www.scopus.com Molenaar, I. W., & Hoijtink, H. (1996). Person-fit and the rasch model, with an application to knowledge of logical quantors. Applied Measurement in Education, 9(1), 27-45. doi:10.1207/s15324818ame0901_4 Nielsen, T., Makransky, G., Vang, M. L., & Dammeyer, J. (2017). How specific is specific self-efficacy? A construct validity study using rasch measurement models. Studies in Educational Evaluation, 53, 87-97. doi:10.1016/j.stueduc.2017.04.003 Nordin, A. B., & Abu Bakar, B. (2008). Penaksiran Dalam Pendidikan Dan Sains Sosial, Retrieved from www.scopus.com Nota, L., Heppner, P. P., Ginevra, M. C., Ferrari, L., Heppner, M. J., & Soresi, S. (2013). Development of the problem solving inventory with italian youth. International Perspective in Psychology: Research, Practice, Consultation, 2(3), 181-193. Retrieved from www.scopus.com Nota, L., Heppner, P. P., Soresi, S., & Heppner, M. J. (2009). Examining cultural validity of the problem-solving inventory (PSI) in italy. Journal of Career Assessment, 17(4), 478-494. doi:10.1177/1069072709339490 Ostini, R., & Nering, M. L. (2006). Retrieved from www.scopus.com Pallant, J. F., & Tennant, A. (2007). An introduction to the rasch measurement model: An example using the hospital anxiety and depression scale (HADS). British Journal of Clinical Psychology, 46(1), 1-18. doi:10.1348/014466506X96931 Peeters, M. J., & Stone, G. E. (2009). An instrument to objectively measure pharmacist professionalism as an outcome: A pilot study. Canadian Journal of Hospital Pharmacy, 62(3), 209-216. doi:10.4212/cjhp.v62i3.790 Pomeranz, J. L., Byers, K. L., Moorhouse, M. D., Velozo, C. A., & Spitznagel, R. J. (2008). Rasch analysis as a technique to examine the psychometric properties of a career ability placement survey subtest. Rehabilitation Counseling Bulletin, 51(4), 251-259. doi:10.1177/0034355208317317 Randall, J., & Engelhard Jr., G. (2010). Using confirmatory factor analysis and the rasch model to assess measurement invariance in a high stakes reading assessment. Applied Measurement in Education, 23(3), 286-306. doi:10.1080/08957347.2010.486289 Sahin, N., Sahin, N. H., & Heppner, P. P. (1993). Psychometric properties of the problem solving inventory in a group of turkish university students. Cognitive Therapy and Research, 17(4), 379-396. doi:10.1007/BF01177661 Saidfudin, M., Azlinah, M., Azrilah, A. A., Nor Habibah, A., & Sohaimi, Z. (2007). Appraisal of course learning outcomes using rasch measurement: A case study in information technology education. International Journal of Systems Applications, Engineering & Development, 1(4), 164-172. Retrieved from www.scopus.com Salzberger, T. (2000). An Alternative Way an Establishing Measurement in Marketing Research-its Implication for Scale Development and Validity, , 111-1117. Retrieved from www.scopus.com Smith Jr., E. V., Conrad, K. M., Chang, K., & Piazza, J. (2002). An introduction to rasch measurement for scale development and person assessment. Journal of Nursing Measurement, 10(3), 189-206. doi:10.1891/jnum.10.3.189.52562 Soliman, M. A. (2014). The problem-solving inventory: Appraisal of problem solving in the arab context, factor structure, and validation. International Perspectives in Psychology: Research, Practice, Consultation, 3(4), 252-267. Retrieved from www.scopus.com Tran, H. P., Griffin, P., & Nguyen, C. (2010). Validating the university entrance english test to the vietnam national university: A conceptual framework and methodology. Paper presented at the Procedia - Social and Behavioral Sciences, , 2(2) 1295-1304. doi:10.1016/j.sbspro.2010.03.190 Retrieved from www.scopus.com Vaughan, B. (2018). A rasch analysis of the revised study process questionnaire in an australian osteopathy student cohort. Studies in Educational Evaluation, 56, 144-153. doi:10.1016/j.stueduc.2017.12.003 Veerasamy, A. K., D'Souza, D., Lindén, R., & Laakso, M. -. (2019). Relationship between perceived problem-solving skills and academic performance of novice learners in introductory programming courses. Journal of Computer Assisted Learning, 35(2), 246-255. doi:10.1111/jcal.12326 Wilson, M. (2005). Constructing Measures: An Item Response Modeling Approach, Retrieved from www.scopus.com Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370. Retrieved from www.scopus.com Yeen-Ju, H. T., Mai, N., & Selvaretnam, B. (2015). Enhancing roblem-solving skills in an authentic blended learning environment: A malaysian context. Int.J.Inf.Educ.Technol., 5(11), 841-846. Retrieved from www.scopus.com Yew, W. T., & Akmar, S. N. (2016). Problem solving strategies of selected pre-service secondary school mathematics teachers in malaysia. The Malaysian Online Journal of Educational Sciences, 4(2), 17-31. Retrieved from www.scopus.com Youngman, M. B. (1979). A comparison of item-total point biserial correlation, rasch and alpha-beater item analysis procedures. Educational Studies, 5(3), 265-273. doi:10.1080/0305569790050307 |
| This material may be protected under Copyright Act which governs the making of photocopies or reproductions of copyrighted materials. You may use the digitized material for private study, scholarship, or research. |