Construct validity and reliability of manufacturing industry: a rasch measurement model approaches for pilot study

Zaliza Hanapi

Abstract

This pilot study was conducted to examine and verify the reliability of instruments for the manufacturing industry in Malaysia. The manufacturing industry instruments that had been prepared consists of 88 items and is distributed to 40 female workers from several factories located in Kedah, Perak, and Selangor. The purpose of the establishment of this instrument is to measure the three main constructs of this study, which is; (1) career aspiration; (2) job satisfaction; and (3) career development. The approach used to examine the validity and reliability of the items and respondents in this study is emanate from the Rasch Measurement Model Approaches which is much more valid and well-grounded compared to just focus on the output produced by Cronbach’s Alpha. The Winsteps software Version 3.73 has been used to check on the functionality of the items in the aspects such as the item reliability and the separation of item-respondent, polarity item, the suitability of the item to measure the construct, the item difficulty level, and the respondent’s ability. It also allows the removal of items based on the statistics of polarity item and the suitability of the item. At the end of the analysis, it is found that there is a total of 16 items that were discarded because they did not meet the inspection criteria specified in accordance to the Rasch Model. The final instrument recorded a total of 72 items that can only be used to measure the three constructs of the study. Since this study was established as a pilot study, then the distribution made to the actual respondents can be carried out in order to measure the three main constructs of this study.

References

Hassan, A. (2011). Kesahan dan Kebolehpercayaan Item Penilaian Pembimbing dalam Pembelajaran Berasaskan Kerja (PBK) Menggunakan Model Pengukuran Rasch. USM, Psychometrics Centre, MIMOS & Malaysian Examination Syndicate, MOE.

Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). Mahwah, New Jersey: Lawrence Erlbaum Associates.

Cooper, D. R., & Schindler, P. S. (2011). Business research methods (11th edition). New York: McGraw-Hill.

Fox, C. M., & Jones, J. A. (1998). Uses of Rasch modeling in counseling psycology research. Journal of Counselling Psychology, 45(1), 30-45.

Fuzi, N. M., Habidin, N. F., Hibadullah, S. N., & Ong, S. Y. Y. (2017). CSR Practices, ISO 26000 and Performance Among Malaysian Automotive Suppliers. Social Responsibility Journal, 13(1), 203-220.

Habidin, N. F., Yusof, S. M., & Fuzi, N. M. (2016). Lean Six Sigma, Strategic Control Systems, and Organizational Performance for Automative Suppliers. International Journal of Lean Six Sigma, 7(2), 110-135.

Wan, H. L. (2016) The Manufacturing Sector in Malaysia. In: Organisational Justice and Citizenship Behaviour in Malaysia. Governance and Citizenship in Asia. Springer, Singapore. 21-36. Doi: 10.1007/978-981-10-0030-0_2.

Johanson, G. A., & Brooks, G. P. (2010). Initial scale development: sample size for pilot studies. Educational and Psychological Measurement, 70(3), 394-400.

Linacre, J. M. (2005). Test validity, and Rasch measurement: Construct, content, etc. Rasch Measurement Transactions.

Linacre, J. M. (2007). A user’s guide to WINSTEPS Rasch-model computer programs. Chicago, Illinois: MESA Press.

Jailani, M. K. M. (2011). Manual Pengenalan Pengukuran Rasch & Winsteps. Pengukuran dan Penilaian dalam Pendidikan. Fakulti Pendidikan Universiti Kebangsaan Malaysia.

Spencer, S. Y., Adams, C., & Yapa, P. W. S. (2013). The Mediating Effects of the Adoption of an Environmental Information System on Top Management’s Commitment and Environmental Performance. Sustainability Accounting, Management and Policy Journal, 4(1), 75-102. Doi: 10.1108/SAMPJ-10-2011-0030.