Validity and reliability of an evaluation instrument for English curriculum system in Chinese vocational higher education institutions

Arasinah Kamis

QR Code Link :
Type :	Article
Subject :	P Philology. Linguistics
ISBN :	2705-0610
Main Author :	Arasinah Kamis
Title :	Validity and reliability of an evaluation instrument for English curriculum system in Chinese vocational higher education institutions
Hits :	86

Place of Production :	Tanjung Malim
Publisher :	Fakulti Teknikal & Vokasional
Year of Publication :	2024
Notes :	Forum for Linguistic Studies
Corporate Name :	Universiti Pendidikan Sultan Idris
HTTP Link :	Click to view web link
PDF Full Text :	You have no permission to view this item.

Abstract : Universiti Pendidikan Sultan Idris

The English curriculum is the basic part of the curriculum system of vocational higher education institutions (VHEIs) in China, and it is the public compulsory curriculum that students of all majors must study. It not only cultivates students’ ability to learn and apply English but also lays an English foundation for students’ future further learning and lifelong development. The purpose of this study is to validate the evaluation instrument for English curriculum system. This is a quantitative research and the questionnaire has adapted from previous scholars. A stratified random sampling technique has been employed to select 350 English lecturers from a total of 864 English lecturers at 20 vocational HEIs in Shandong Province, China. The results showed: i) Each dimension Clonbach alpha coefficient and McDonald’s omega (Composite reliability) are more than 0.70. ii) For the convergent validity, each item factor loading >0.5, each dimension AVE >0.5. iii) For the discriminant validity, the square root of the AVE of the five dimensions is greater than the corresponding correlation coefficients between the two dimensions. Iv) Measurement model meet the fit indices, that CMIN χ2 = 411.228, with degrees of freedom (df) 314, CMIN/df = 1.310 (1-3), CFI = 0.979 (>0.9), GFI = 0.916 (>0.9), NFI = 0.916 (>0.9), and RMSEA = 0.031(

References

Bagozzi, R.P., Yi, Y., 1988. On the evaluation of structural equation models. Journal of the Academy of Marketing Science. 16(1), 74–94. DOI:https://doi.org/10.1007/bf02723327.

Bai, H., 2021. Dilemma and path selection of English curriculum standards for Higher Vocational Education. Vocational Education Research. (12), 60–64.

Bentler, P.M., 1990. Comparative fit indexes in structural models. Psychological Bulletin. 107(2), 238–246. DOI: https://doi.org/10.1037/00332909.107.2.238.

Brown, T.A., 2015. Confirmatory Factor Analysis for Applied Research, Second Edition. Guilford Publications.

Byrne, B.M., 1998. Structural equation modeling with LISREL, PRELIS and SIMPLIS: Basic concepts, applications and programming. Mahwah, New Jersey: Lawrence Erlbaum Associates.

Byrne, B.M., Van De Vijver, F.J.R., 2010. Testing for Measurement and Structural Equivalence in Large-Scale Cross-Cultural Studies: Addressing the issue of Nonequivalence. Interna- tional Journal of Testing, 10(2), 107–132. DOI:https://doi.org/10.1080/15305051003637306.

Chen, Y., 2022. A study on the current problems of evaluation in public English teaching in higher vocational colleges. Journal of Hubei Open Vocational College. (13), 186–188.

Creswell, J.W., Creswell, J.D., 2017. Research design: Qualitative, Quantitative, and Mixed Methods Approaches. SAGE Publications.

Fornell, C., Larcker, D.F., 1981. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research. 18(1), 39–50. DOI:https://doi.org/10.1177/002224378101800104.

General Office of the Ministry of Education. (2021, March 23). English curriculum standards for vo- cational higher education institutions (2021). Available from: https://www.gov.cn/zhengce/zhengceku/202104/10/content_5598801.htm.

Göbel, J. (2019, November 11). ”Discover your talents.” deutschland.de. Available from: https://www.deutschland.de/zh-hans/topic/jingji/lianheguojiaokewenzuzhicujinzhiyejiaoyu.

Goodlad, J.I., 1979. Curriculum Inquiry: The study of Curriculum practice. Available from: https://ci.nii.ac.jp/ncid/BA05076058.

Hair, J.F., Black, W.C., Babin, B.J., et al., 2006. Multivariate data analysis (6th ed.). Pearson Prentice Hall Upper Saddle River, NJ.

Hair, J., Black, B., Babin, B., et al., 2010. Multivariate Data Analysis: A Global Perspective (7th ed.). New Jersey, USA: Pearson Education Inc.

Hamid, M.R., Sutaman, S., Natsir, M., et al., 2022. The development of an evaluation instrument for the implementation of the Arabic language curriculum in Islamic High School. Jurnal Al-Bayan, 14(1), 242– 257. DOI: https://doi.org/10.24042/albayan.v14i1.10303.

Hayes, A.F., Coutts, J.J., 2020. Use Omega Rather than Cronbach’s Alpha for Es- timating Reliability. But... Communication Methods and Measures. 14(1), 1–24. DOI: https://doi.org/10.1080/19312458.2020.1718629.

Imansari, N., Sutadji, E., 2017. A concep- tual framework curriculum evaluation Electrical engineering education. International Journal of Evaluation and Research in Education. 6(4), 265. DOI:https://doi.org/10.11591/ijere.v6i3.7624.

Jiang, L., 2022. Effective Utilization of Computer-Mediated Communication Technology in Networkbased Foreign Language Teaching. Wireless communications and mobile computing. 1–7. DOI:https://doi.org/10.1155/2022/1048311.

Jiang, L., 2024. Factors influencing EFL teachers’ implementation of SPOC-based blended learning in higher vocational colleges in China: A study based on grounded theory. Interactive Learning Environments. 32(3), 859–878. DOI:https://doi.org/10.1080/10494820.2022.2100428.

Jiang, L., Al-Shaibani, G.K.S., 2024. Influencing factors of students’ small private online course-based learning adaptability in a higher vocational college in China. Interactive Learning Environments. 32(3), 972–993. DOI: https://doi.org/10.1080/10494820.2022.2105901.

Jiang, L., Liang, X., 2023. Influencing factors of Chinese EFL students’ continuance learning intention in SPOC-based blended learning environ- ment. Education and Information Technologies. 28(10), 13379–13404. DOI: https://doi.org/10.1007/s10639-023-11734-4.

Kline, R.B., 2023. Principles and practice of structural equation modeling. Guilford publications. Krejcie, R.V., Morgan, D.W., 1970. Determining sample size for research activities. Educational and Psychological Measurement. 30(3), 607–610. DOI:https://doi.org/10.1177/001316447003000308.

Kusmiyati, N., Hamidah, K., 2023. CIPPO model Evaluation on the English Language training program at the Indonesian Navy Education Services. IJHCM (International Journal of Human Capital Management) (Online). 7(1), 104–114. DOI:https://doi.org/10.21009/ijhcm.07.01.8.

Marsh, H.W., Hocevar, D., 1985. Application of confirmatory factor analysis to the study of selfconcept: First- and higher order factor models and their invariance across groups. Psychological Bulletin. 97(3), 562–582. DOI: https://doi.org/10.1037/0033-2909.97.3.562.

This material may be protected under Copyright Act which governs the making of photocopies or reproductions of copyrighted materials.
You may use the digitized material for private study, scholarship, or research.

Back to search page