UPSI Digital Repository (UDRep)

Improving questionnaire reliability using construct reliability for researches in educational technology

AVAILABLE Article 1667 Views
Scan QR Code to share or view item link:

Digital Assets & Download Files
Login required to access this item.
General Information Cached
Title
Improving questionnaire reliability using construct reliability for researches in educational technology
Type
Article
Main Author
Mohd Shafie Rosli
Additional Authors
  • Mohd Mokhzani Ibrahim
Subject
Q Science (General)
ISSN
1865-7923
Language Code
eng
Bibliographic Details
Place of Production
Tanjung Malim
Publisher
Fakulti Sains dan Matematik
Year of publication
2021
Notes
International Journal of Interactive Mobile Technologies
Degree Type
Others
Corporate Name
Universiti Pendidikan Sultan Idris

Abstract

This paper is exploring on maneuver to improve research instrument reliability in scientific research related to Educational Technology by analyzing the traditional Cronbach?s alpha reliability using SPSS software and the newer statistical tool, AMOS using Construct Reliability (CR) approach. Two sets of data were used as sample to perform the comparison. The first set of data is from a research involving Technology Enhanced Learning Environment. The second data are sampled from research in digital competency. Finding from this paper concluded that, conventional approach of using Cronbach?s alpha have lower reliability than the newer approach of using CR. Using Cronbach?s alpha show tendency toward measuring consistency instead of reliability. CR offer better definition of reliability and give a robust measurement of reliability in research. This paper had shed light into offering alternative approach to the commonly and widely uses of research reliability especially when it involves questionnaire as instrument. ? 2021

References

Aris, B., Gharbaghi, A., Ahmad, M. H., & Rosli, M. S. (2013). A check list for evaluating persuasive features of mathematics courseware. International Education Studies, 6(9), 125-134. doi:10.5539/ies.v6n9p125

Aypay, A., Çelik, H. C., Aypay, A., & Sever, M. (2012). Technology acceptance in education: A study of pre-service teachers in turkey. Turkish Online Journal of Educational Technology, 11(4), 264-272. Retrieved from www.scopus.com

Cunha, M., Duarte, J., Cruz, A., & Students 26Th Cle. (2015). Learning strategies: Validating a questionnaire. Turkish Online Journal of Educational Technology, 2015, 284-300. Retrieved from www.scopus.com

Fernández Batanero, J. M., & Torres González, J. A. (2015). Teacher attitudes and best practices with ICT faculty adult continuing education in andalusia. [Actitudes docentes y buenas prácticas con TIC del profesorado de educación permanente de adultos en Andalucía] Revista Complutense De Educacion, 26, 33-49. doi:10.5209/rev_RCED.2015.v26.43812

Helms, J. E., Henze, K. T., Sass, T. L., & Mifsud, V. A. (2006). Treating cronbach's alpha reliability coefficients as data in counseling research. The Counseling Psychologist, 34(5), 630-660. doi:10.1177/0011000006288308

Juned, M., & Adil, M. (2015). Factors influencing adoption of ubiquitous internet amongst students. International Journal of Information and Communication Technology Education, 11(3), 62-76. doi:10.4018/IJICTE.2015070106

Liu, F., Ritzhaupt, A., & Cavanaugh, C. (2013). Leaders of school technology innovation: A confirmatory factor analysis of the change facilitator style questionnaire (CFSQ). Journal of Educational Administration, 51(5), 576-593. doi:10.1108/JEA-01-2012-0011

Novick, M. R., & Lewis, C. (1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 32(1), 1-13. doi:10.1007/BF02289400

Peterson, R. A., & Kim, Y. (2013). On the relationship between coefficient alpha and composite reliability. Journal of Applied Psychology, 98(1), 194-198. doi:10.1037/a0030767

Rosli, M. S., Aris, B., & Ahmad, M. H. (2015). Online intellectual transformation system. Contemporary Engineering Sciences, 8(1-4), 39-47. doi:10.12988/ces.2015.412254

Rosli, M. S., Saleh, N. S., Aris, B., Ahmad, M. H., & Salleh, S. M. (2016). Ubiquitous hub for digital natives. International Journal of Emerging Technologies in Learning, 11(2), 29-34. doi:10.3991/ijet.v11i02.4993

Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8(4), 350-353. doi:10.1037/1040-3590.8.4.350

Shelby, L. B. (2011). Beyond cronbach's alpha: Considering confirmatory factor analysis and segmentation. Human Dimensions of Wildlife, 16(2), 142-148. doi:10.1080/10871209.2011.537302

Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of cronbach's alpha. Psychometrika, 74(1), 107-120. doi:10.1007/s11336-008-9101-0

Tavakol, M., & Dennick, R. (2011). Making sense of cronbach's alpha. International Journal of Medical Education, 2, 53-55. doi:10.5116/ijme.4dfb.8dfd

Yang, Y., & Green, S. B. (2011). Coefficient alpha: A reliability coefficient for the 21st century? Journal of Psychoeducational Assessment, 29(4), 377-392. doi:10.1177/0734282911406668


Installed and configured by Bahagian Automasi, Perpustakaan Tuanku Bainun, Universiti Pendidikan Sultan Idris
If you have enquiries, kindly contact us at pustakasys@upsi.edu.my or 016-3630263. Office hours only.