Assessment and ranking framework for the English skills of pre-service teachers based on fuzzy Delphi and TOPSIS methods

Osamah Shihab Ahmed Albahrey

QR Code Link :
Type :	article
Subject :	L Education (General)
Main Author :	Osamah Shihab Ahmed Albahrey
Additional Authors :	Aos A. Z. Ansaef Al-Juboori Intan Safinas binti Mohd Ariff Charanjit Kaur Swaran Singh Hamsa Hammed Mohammed Assim Alsalem Ali Najm Jasim Ali H. Shareef Shahad Nidhal N. S. Jalood M. J. Baqer
Title :	Assessment and ranking framework for the English skills of pre-service teachers based on fuzzy Delphi and TOPSIS methods

Place of Production :	Tanjong Malim
Publisher :	Fakulti Seni, Komputeran dan Industri Kreatif
Year of Publication :	2019
Corporate Name :	Universiti Pendidikan Sultan Idris

Abstract : Universiti Pendidikan Sultan Idris

In this study, pre-service teaching refers to teaching English as a second language (TESL) to Malaysian students whose first language is not English. TESL prepares English-language learners to become future teachers of English as a second language. To date, no multi-criteria framework has been developed to evaluate and select the skills of pre-service teachers. This study presents a new framework to assess and rank the English skills of pre-service teachers on the basis of fuzzy Delphi and multi-criteria analysis. Three experiments were conducted. Firstly, criteria were identified from the literature review and the opinions of representative experts via the Delphi method. Secondly, 31 pre-service teachers were evaluated to determine the skills of pre-service teachers on the basis of Delphi criteria outcomes. English proficiency was tested through the English Language Testing Service and four language skill examinations. Each examination was evaluated by experts with vast experience in English teaching. Thirdly, pre-service teachers were ranked on the basis of a set of evaluated Delphi criteria outcomes through the technique for the order of preference by similarity to ideal solution (TOPSIS) method. Thereafter, the mean and standard deviation were utilised to ensure the identical systematic ranking of pre-service teachers. Findings are as follows. Twenty-five criteria from previous studies are representative as evaluated by the opinions of experts, which were gathered through interviews and a structured questionnaire. The validity of content was verified using a five-point Likert scale. With Delphi method outcomes, 14 criteria were selected and included in the final framework. The results of the proposed evaluation framework were tested on Malaysian pre-service teachers. TOPSIS is effective for solving the selection problems of pre-service teachers. In the final experiment, significant differences were recognised between the scores of groups, indicating identical ranking results.

References

1. Kamarulzaman, N., et al., Applying the Fuzzy Delphi Method to Analyze the user Requirement for user Centred Design Process in Order to Create Learning Applications. Indian Journal of Science and Technology, 2015. 8(32): p. 1-7.

2. Yunus, M.M., et al., Understanding TESL preservice teachers‘ teaching experiences and challenges via post-practicum reflection forms. Procedia - Social and Behavioral Sciences, 2010. 9(1): p. 722-728.

3. Yunus, M.M., et al., Teacher-student relationship factor affecting motivation and academic achievement in ESL classroom. Procedia - Social and Behavioral Sciences, 2011. 15(1): p. 2637-2641.

4. Ismail, N., et al., The Benefits of ESL Community Service Project on ESL Student Tutors. English Language Journal, 2011. 4(1): p. 67-74.

5. Ismail, N., et al., Pre-service teachers' reflection on the use of self-developed English language teaching materials for English as a second language students. International Journal of Pedagogy and Curriculum, 2014. 20(4): p. 35-51.

6. Albakri, I.S.M.A., et al., Malay Pre-service Teachers‘Conception Of ELT Materials For Language Classrooms. Malay, 2012. 7(1): p. 1.

7. Kabilan, M.K., et al., Assessing pre-service English language teachers‘ learning using e-portfolios: Benefits, challenges and competencies gained. Computers & Education, 2012. 58(4): p. 1007-1020.

8. Wah, L.K., et al., Understanding the Blended Learning Experiences of English Language Teachers in a Distance TESL Degree Programme in Malaysia. Sains Humanika, 2013. 65(2): p. 55–65.

9. Kepol, N., Quality Malaysian English language teachers: Examining a policy strategy. Malaysian Journal of Learning and Instruction, 2017. 14(1): p.187-209.

10. Kabilan, M.K., English language teachers reflecting on reflections: A Malaysian experience. TESOL quarterly, 2007. 41(4): p. 681-705.

11. Joharry, S.A., et al., Corpus research in Malaysia: a bibliographic analysis. Kajian Malaysia, 2014. 32(1): p. 17

12. Javed, M., et al., Identifying Reading Strategies to Teach Literal, Reorganisation and Inferential Comprehension Questions to ESL Students. The Journal of AsiaTEFL, 2016. 13(3): p. 204-220.

13. Batemanazan, V., et al., A Comparative Study on the Eye Movement Patterns in Malay- english Bilingual Readers. Procedia - Social and Behavioral Sciences, 2014. 118(5): p. 229-234.

14. Che Musa, N., et al., Exploring English Language Learning And Teaching In Malaysia. GEMA Online Journal of Language Studies, 2012. 12(1): p. 65-78.

15. Ming, T.S., et al., Induced Content Schema Vs Induced Linguistic Schema—Which Is More Beneficial for Malaysian Esl Readers? RELC Journal, 1997. 28(2): p. 107-127.

16. Omar, A., et al., Thinking maps to promote critical thinking through the teaching of literature in the esl context. Indonesian Journal of English Language Teaching and Applied Linguistics, 2016. 1(1): p.23-35.

17. Azlan, N.M.N.I., et al., The Role of Code-switching as a Communicative Tool in an ESL Teacher Education Classroom. Procedia - Social and Behavioral Sciences, 2013. 90(10): p. 458-467.

18. Paris, T.N.S.T.D., et al., Use of ?Time Trap Board Game‘ to Teach Grammar. Procedia - Social and Behavioral Sciences, 2013. 105(12): p. 398-409.

19. Fayyaz, S., et al., A Study of Contextual Situatedness of English Language Teachers‘ Beliefs and Practices about the Form-focused Instruction: A Case Study in Sandakan District, Sabah. Procedia - Social and Behavioral Sciences, 2014. 134(5): p. 201-212.

20. Ting, S.-H., et al., Grammatical Errors In Spoken English Of University Students In Oral Communication Course. GEMA Online Journal of Language Studies, 2010. 10(1): p. 53-69.

21. Ahour, T., et al., Errors and variations of TESL students‘ written description. Pertanika Journal Social Science and Humanities, 2012. 20(1): p. 55-64.

22. Mukundan, J., et al., Effect of peer review and tutor conferencing on English as a second language learners‘ writing performance. Pertanika Journal of Social Sciences and Humanities (JSSH), 2011. 19(1): p. 25-38.

23. Hashim, N.M.H.N., et al., Relationship between teacher‘s personality, monitoring, learning environment, and students‘ EFL performance. GEMA Online® Journal of Language Studies, 2014. 14(1): p. 4637-23875.

24. Maasum, T.N.R.T.M., et al., Development of an automated tool for detecting errors in Tenses. GEMA Online® Journal of Language Studies, 2012. 12(2): p. 427-442.

25. Ansarimoghaddam, S., et al., Undergraduates' Experiences and Attitudes of Writing in L1 and English. GEMA Online Journal of Language Studies, 2014. 14(1): p. 1-22.

26. Kaur, K., The emergent nature of strategic mediation in ESL teacher education. Language Teaching Research, 2015. 19(3): p. 374-388.

27. Mastan, M.E., et al., ESL Learners‘ Self-efficacy Beliefs and Strategy Use in Expository Writing. Procedia - Social and Behavioral Sciences, 2014. 116(2): p. 2360-2363.

28. Ismail, N., et al., Investigating the impacts of IQwrite online writing program toward ESL students' attitude and interest in learning academic writing. International Journal of Interdisciplinary Educational Studies, 2016. 11(1): p. 21-34.

29. Sardareh, S.A., et al., Malaysian Primary School ESL Teachers‘ Questions during Assessment for Learning. English Language Teaching, 2013. 6(8): p. 1.

30. Yunus, M.M., et al., Effects of using digital comics to improve ESL writing. Research Journal of Applied Sciences, Engineering and Technology, 2012. 4(18): p. 3462-3469.

31. Kwan, L.S., et al., Cohesive Errors in Writing among ESL Pre-Service Teachers. English Language Teaching, 2014. 7(11): p. 130-159.

32. Yoke, S.K., et al., The use of online corrective feedback in academic writing by L1 Malay learners. English Language Teaching, 2013. 6(12): p. 175.

33. Wei, W.S., et al., Exploring strategies for vocabulary learning and teaching for ESL learners–a literature review. Sains Humanika, 2013. 65(2): p. 1-6.

34. Mokhtar, N.H., et al., The Effectiveness of Storytelling in Enhancing Communicative Skills. Procedia - Social and Behavioral Sciences, 2011. 18(1): p. 163-169

35. Yunus, N.M., et al., The Use of Indirect Strategies in Speaking: Scanning the MDAB Students. Procedia - Social and Behavioral Sciences, 2014. 123(5): p. 204-214.

36. Shahidi, A., et al., Production and perception of English word final stops by Malay speakers. GEMA Online® Journal of Language Studies, 2012. 12(4): p. 1109-1125.

37. Bakar, N.A., et al., Enhancing ESL learners speaking skills through asynchronous online discussion forum. Asian Social Science, 2013. 9(9): p. 224.

38. Zare, P., et al., Students‘ perceptions toward using classroom debate to develop critical thinking and oral communication ability. Asian Social Science, 2015. 11(9): p. 158.

39. Bahrani, T., et al., Exposure to audiovisual programs as sources of authentic language input and second language acquisition in informal settings. Southern African Linguistics and Applied Language Studies, 2012. 30(3): p. 347-359.

40. Krish, P., et al., Learner Diversity among ESL Learners in the Online Forum. Procedia - Social and Behavioral Sciences, 2010. 7(1): p. 92-96.

41. Ibrahim, N., et al., The Importance of Implementing Collaborative Learning in the English as a Second Language (ESL) Classroom in Malaysia. Procedia economics and Finance, 2015. 31(1): p. 346-353.

42. Soo, R.S., et al., Pre-service English Teachers‘ Reticent Beliefs Towards Oral Participation in EAP Classrooms. The Asia-Pacific Education Researcher, 2017. 26(3-4): p. 155-162.

43. Pathinathan, S., et al., Intragroup conflicts during collaborative writing in an ESL/EFL preparatory programme. International Journal of Applied Linguistics and English Literature, 2012. 1(7): p. 8-18.

44. Ahmad, S.Z., et al., An investigation of the factors determining student destination choice for higher education in the United Arab Emirates. Studies in Higher Education, 2017. 42(7): p. 1324-1343.

45. Tang, H.-W.V., Optimizing an immersion ESL curriculum using analytic hierarchy process. Evaluation and Program Planning, 2011. 34(4): p. 343-352.

46. Kaur, D., et al., The Use of Videos as a Cognitive Stimulator and Instructional Tool in Tertiary ESL Classroom. Malaysian Online Journal of Educational Technology, 2014. 2(3): p. 32-41.

47. Nazeera, A.B., Development of an online casebased problem-solving module for ESL writing instruction/Nazeera Ahmed Bazari. University of Malaya, 2017. 2(1): p. 1512.

48. Menon, S., et al., Wikipedia in Promoting Science Literary Skills in Primary Schools. Malaysian Online Journal of Educational Technology, 2014. 2(3): p. 42-47.

49. Thuraisingam, T.G., et al., Implementing PreReading Strategies to Improve Struggling ESL Learners‘ Interest and Comprehension in English Reading Lessons. International Journal of Education, Culture and Society, 2017. 2(3): p. 94.

50. Hamidon, I.S., et al., Potential of twitter in postreading activities among community college students in malaysia. Procedia-Social and Behavioral Sciences, 2013. 103: p. 725-734.

51. Zheng, X.-M., Methods for multiple attribute decision making with hesitant fuzzy uncertain linguistic information and their application for evaluating the college English teachers' professional development competence. Journal of Intelligent & Fuzzy Systems, 2015. 28(3): p. 1243- 1250.

52. Alinejad, Z., Identifying, Evaluating and Prioritizing the Factors Affecting the Effectiveness of In-Service Training Courses (Case Study: English Language Teachers of the Secondary Schools in Tehran Selected Districts). International Journal of English Linguistics, 2016. 6(3): p. 221.

53. Nigam, B., Performance Evaluation Of English Teacher: Vague Modelling Of Communication Practices. International Journal of Current Engineering And Scientific Research, 2017. 4(9): p.44-49.

54. Wang, J., Evaluation of Several New Models to Teach English as a Second Language. International Journal of Emerging Technologies in Learning (iJET), 2016. 11(08): p. 4-8.

55. Lou, C., et al. Implementation and application of gray fuzzy decision in English teaching quality. 2016. SHS Web of Conferences: 25(1): p. 01016.

56. Goh, P.S.C., et al., Teacher preparation in Malaysia: needed changes. Teaching in Higher Education, 2015. 20(5): p. 469-480.

57. Wong, M.S.-L., Language learning strategies and language self-efficacy: Investigating the relationship in Malaysia. RELC journal, 2005. 36(3): p. 245-269.

58. Yahya, S.A., R. Mansor, and M.H. Abdullah. Teaching Practice Assessment Methods For PreService Teachers In Malaysian Teacher Education. in International Conference on Education in Muslim Society (ICEMS 2017). 2017. Atlantis Press.

59. Senom, F. and J. Othman, The native speaker mentors: A qualitative study on novice teachers‘ professional development. Procedia-Social and Behavioral Sciences, 2014. 141: p. 617-622.

60. Tangen, D. and L. Mercer, International preservice teachers' self-confidence in critical reflective thinking and writing through an intercultural Patches program. TESOL in Context, 2012. 22(1): p. 56.

61. Abd, K., et al. A methodology for fuzzy multicriteria decision-making approach for scheduling problems in robotic flexible assembly cells. Industrial Engineering and EngineeringManagement (IEEM), 2014. 1(12): p. 374-378.

62. Malakolunthu, S., et al., Teacher perspectives of school-based assessment in a secondary school in Kuala Lumpur. Procedia-Social and Behavioral Sciences, 2010. 9(1): p. 1170-1176.

63. Yahya, S.A., et al., Analysis of Teaching Practice Assessment Framework in Teacher Education towards 21st Century Assessment. International Journal of Academic Research in Business and Social Sciences, 2017. 7(6): p. 2222-6990.

64. Kalid, N., et al., Based on real time remote health monitoring systems: A new approach for prioritization ?large scales data? patients with chronic heart diseases using body sensors and communication technology. Journal of medical systems, 2018. 42(4): p. 69.

65. Alsalem, M., et al., Systematic review of an automated multiclass detection and classification system for acute Leukaemia in terms of evaluation and benchmarking, open challenges, issues and methodological aspects. Journal of medical systems, 2018. 42(11): p. 204.

66. Zaidan, A., et al., A review on smartphone skin cancer diagnosis apps in evaluation and benchmarking: Coherent taxonomy, open issues and recommendation pathway solution. Health and Technology, 2018. 8(4): p. 223-238.

67. AlSattar, H., et al., MOGSABAT: a metaheuristic hybrid algorithm for solving multi-objective optimisation problems. Neural Computing and Applications, 2018: p. 1-15.

68. Enaizan, O., et al., Electronic medical record systems: Decision support examination framework for individual, security and privacy concerns using multi-perspective analysis. Health and Technology, 2018: p. 1-28.

69. Salih, M.M., et al., Survey on fuzzy TOPSIS stateof-the-art between 2007–2017. Computers & Operations Research, 2019. 104(12): p. 207-227.

70. Kalid, N., et al., Based real time remote health monitoring systems: A review on patients prioritization and related" big data" using body sensors information and communication technology. Journal of medical systems, 2018. 42(2): p. 30.

71. Jumaah, F., et al., Decision-making solution based multi-measurement design parameter for optimization of GPS receiver tracking channels in static and dynamic real-time positioning multipath environment. Measurement, 2018. 118: p. 83-95.

72. Albahri, A., et al., Real-time fault-tolerant mHealth system: Comprehensive review of healthcare services, opens issues, challenges and methodological aspects. Journal of medical systems, 2018. 42(8): p. 137.

73. Albahri, O., et al., Real-time remote healthmonitoring Systems in a Medical Centre: A review of the provision of healthcare services-based body sensor information, open challenges and methodological aspects. Journal of medical systems, 2018. 42(9): p. 164.

74. Yas, Q.M., et al., A systematic review on smartphone skin cancer apps: Coherent taxonomy, motivations, open challenges and recommendations, and new research direction. Journal of Circuits, Systems and Computers, 2018. 27(05): p. 1830003.

75. Zaidan, A., et al., Evaluation and selection of opensource EMR software packages based on integrated AHP and TOPSIS. Journal of biomedical informatics, 2015. 53(1): p. 390-404.

76. Zaidan, A., et al., Multi-criteria analysis for OSEMR software selection problem: A comparative study. Decision support systems, 2015. 78(1): p. 15-27.

77. Khatari, M., et al., Multi-criteria evaluation and benchmarking for active queue management methods: Open issues, challenges and recommended pathway solutions. International Journal of Information Technology & Decision Making, 2019. 121(1): p. 1-23.

78. Talal, M., et al., Comprehensive review and analysis of anti-malware apps for smartphones. Telecommunication Systems, 2019. 12(1): p. 1-53.

79. Zaidan, A., et al., Multi-agent learning neural network and Bayesian model for real-time IoT skin detectors: a new evaluation and benchmarking methodology. Neural Computing and Applications, 2019. 14(1): p. 1-52.

80. Albahri, A., et al., Based multiple heterogeneous wearable sensors: A smart real-time health monitoring structured for hospitals distributor. IEEE Access, 2019. 7: p. 37269-37323.

81. Albahri, O., et al., Fault-tolerant mHealth framework in the context of IoT-based real-time wearable health data sensors. IEEE Access, 2019. 7: p. 50052-50080.

82. Almahdi, E., et al., Mobile patient monitoring systems from a benchmarking aspect: Challenges, open issues and recommended solutions. Journal of medical systems, 2019. 43(7): p. 207.

83. Alsalem, M., et al., Multiclass benchmarking framework for automated acute Leukaemia detection and classification based on BWM and group-VIKOR. Journal of medical systems, 2019. 43(7): p. 212.

84. Almahdi, E., et al., Mobile-based patient monitoring systems: A prioritisation framework using multi-criteria decision-making techniques. Journal of medical systems, 2019. 43(7): p. 219.

85. Mohammed, K., et al., Real-Time Remote-Health Monitoring Systems: a Review on Patients Prioritisation for Multiple-Chronic Diseases, Taxonomy Analysis, Concerns and Solution Procedure. Journal of medical systems, 2019. 43(7): p. 223.

86. Jumaah, F., et al., Technique for order performance by similarity to ideal solution for solving complex situations in multi-criteria optimization of the tracking channels of GPS baseband telecommunication receivers. Telecommunication Systems, 2018. 68(3): p. 425-443.

87. Yas, Q.M., et al., Comprehensive insights into evaluation and benchmarking of real-time skin detectors: Review, open issues & challenges, and recommended solutions. Measurement, 2018. 114: p. 243-260.

88. Zaidan, B. and A. Zaidan, Software and hardware FPGA-based digital watermarking and steganography approaches: Toward new methodology for evaluation and benchmarking using multi-criteria decision-making techniques. Journal of Circuits, Systems and Computers, 2017. 26(07): p. 1750116.

89. Rahmatullah, B., et al. Multi-complex attributes analysis for optimum GPS baseband receiver tracking channels selection. in 2017 4th international conference on control, decision and information technologies (CoDIT). 2017. IEEE.

90. Zaidan, B. and A. Zaidan, Comparative study on the evaluation and benchmarking information hiding approaches based multi-measurement analysis using TOPSIS method with different normalisation, separation and context techniques. Measurement, 2018. 117: p. 277-294.

91. Abdullateef, B.N., et al., An evaluation and selection problems of OSS-LMS packages. SpringerPlus, 2016. 5(1): p. 248.

92. Yas, Q.M., et al., Towards on develop a framework for the evaluation and benchmarking of skin detectors based on artificial intelligent models using multi-criteria decision-making techniques. International Journal of Pattern Recognition and Artificial Intelligence, 2017. 31(03): p. 1759002.

93. Zaidan, B., et al., A new digital watermarking evaluation and benchmarking methodology using an external group of evaluators and multi? criteria analysis based on ?large? scale data‘. Software: Practice and Experience, 2017. 47(10): p. 1365-1392.

94. Qader, M., et al., A methodology for football players selection problem based on multimeasurements criteria analysis. Measurement, 2017. 111(12): p. 38-50.

95. Salman, O., et al., Novel methodology for triage and prioritizing using ?big data? patients with chronic heart diseases through telemedicine environmental. International Journal of Information Technology & Decision Making, 2017. 16(05): p. 1211-1245.

96. Zaidan, B., et al., A new approach based on multidimensional evaluation and benchmarking for data hiding techniques. International Journal of Information Technology & Decision Making, 2017. 1(1): p. 1-42.

97. Dana, P.H., Global Positioning System (GPS) time dissemination for real-time applications. RealTime Systems, 1997. 12(1): p. 9-40.

98. Kos, T., et al. Effects of multipath reception on GPS positioning performance. Proceedings, 2010. 20(15): p. 399-402.

99. Vahdani, B., et al., Group decision making based on novel fuzzy modified TOPSIS method. Applied Mathematical Modelling, 2011. 35(9): p. 4257-4269.

100. Aghaie, H., et al. A new modified fuzzy TOPSIS for group decision making using fuzzy majority opinion based aggregation. Electrical Engineering (ICEE), 2011. 5(4): p. 1-6.

101. Liu, X. and C. Chang. The TOPSIS algorithm based on a+ bi type connection numbers for decisionmaking in the convergence of heterogeneous networks. Advanced Computer Theory and Engineering (ICACTE), 2010. 2(1): p. V2-323-V2-327.

102. Feng, Y., et al. Flow Distribution Strategy in heterogeneous networks based on satisfaction. Ubiquitous and Future Networks, (ICUFN), 2016. 11(1): p. 966-971.

103. Xing, L., et al. The performance evaluation of IT project risk based on TOPSIS and vague set. Computational Intelligence and Software Engineering, 2009. 12(1): p. 9-40.

104. Li, J., et al. A new solution of intuitionistic fuzzy multiple attribute decision-making based on attributes preference. Fuzzy Systems and Knowledge Discovery, 2009. 12(1): p. 228-232.

105. Baykaso?lu, A., et al., Development of a novel multiple-attribute decision making model via fuzzy cognitive maps and hierarchical fuzzy TOPSIS. Information Sciences, 2015. 301(4): p. 75-98.

106. Xu, Z., et al. , Hesitant fuzzy multi-attribute decision making based on TOPSIS with incomplete weight information. Knowledge-Based Systems, 2013. 52(7): p. 53-64.

107. Roszkowska, E., et al., Application of fuzzy TOPSIS to scoring the negotiation offers in ill-structured negotiation problems. European Journal of Operational Research, 2015. 242(3): p. 920-932.

108. Othman, J., et al., MUET as a predictor of academic achievement in ESL teacher education. GEMA Online Journal of Language Studies, 2013. 13(1): p. 99-111.

109. Sani, A.M., et al., I‘ll Read in English if...: A Glimpse into the Nature of Tertiary ESL Reading Motivation. Procedia - Social and Behavioral Sciences, 2014. 118(8): p. 343-350.

110. Noor, N.M., ESL learners' reading approaches of an academic expository text. 3L: Southeast Asian Journal of English Language Studies, 2010. 16(2): p. 911.

111. Hamid, S.K.S., et al., Discovering the Potential of Wiki through Collaborative Story Writing. Procedia - Social and Behavioral Sciences, 2012. 66(12): p. 337-342.

112. Fung, Y.M., Improving ESL learners‘ academic text construction through a collaborative task. Pertanika Journal of Social Sciences & Humanities, 2011. 19(2): p. 475.

113. Fung, Y.M., Collaborative writing features. RELC Journal, 2010. 41(1): p. 18-30.

This material may be protected under Copyright Act which governs the making of photocopies or reproductions of copyrighted materials.
You may use the digitized material for private study, scholarship, or research.

Back to previous page