The multi-dimensional core component dynamic model of evaluation

Muhammad Salim Tufail

Abstract

The _Multi-Dimensional Core Component Dynamic Model_ of evaluation was devised in a quest for an approach which could maximize the outcomes of an evaluation of an English language programme. This approach was employed in an evaluation of an adult English language programme in a training establishment in Malaysia. This evaluation was based on a mixed method design which focused on the three core programme components: the teachers, the students and the teaching material, and looked at the teaching and learning as the central process to which the evaluation contributed to. This was done by the use of multiple instruments which included interviews with teachers and students, students_ questionnaires, classroom observations, use of pretest and post-test results and a teaching material evaluation checklist. The use of these instruments facilitated the combination the summative-formative, product-process and quantitative-qualitative dimensions of this evaluation. This type of approach was devised based on recent developments in language programme evaluation approaches, as suggested by leading experts in the field. By using such an approach, the outcomes of the evaluation were maximised by incorporating and capitalising on the advantages of the different dimensions, which made the evaluative outcomes more holistic, accurate and meaningful by bringing together a broad range of different perspectives in giving a deep understanding of the complex, dynamic and diverse nature of a language programme in addition, the application of the principle of triangulation further enhanced the validity and reliability of this evaluation. The development of this model signified new directions and frontiers in the field of language programme evaluation by providing yet another evaluation model to the existing ones. Keywords evaluation, language programme, dimension, mixed-method, approach

References

Alderson, J.C. (1992). Guidelines for the evaluation of language education. In J. C. Alderson, & A. Beretta (Eds.), Evaluating second language education (pp. 274‒304). Cambridge: Cambridge University Press.

Brown, J.D. (1989). Language program evaluation: a synthesis of existing possibilities. In R.K. Johnson (Ed.), The second language curriculum (pp. 222‒241). Cambridge: Cambridge University Press.

Fraenkel, J. R., & Wallen, N. E. (2006). How to design and evaluate research in education. Boston: McGraw Hill.

Gall, M.D., Gall, J.D. & Borg, W. B. (2003). Educational research: An introduction. Boston: Allyn and Bacon.

Graves, K. (2008). The language curriculum: A social contextual perspective. Language Teaching, 41(2), 147‒181.

Hedge, T. (2000). Teaching and learning in the language classroom. Oxford: Oxford University Press.

Jarvis, G.A., & Adams, S.J. (1979). Evaluating a second language program. Virginia: Center for Applied Linguistics.

Johnson, B., & Onwegbuzie, A.J. (2004). Mixed methods research: a research paradigm whose time has come. Educational Researcher, 33(7), 14‒26.

Johnson, R.K. (1989). A decision making framework for the coherent language curriculum. In

Johnson, R.K. (ed.), The second language curriculum (pp. 1‒23).Cambridge: Cambridge University Press.

Kiely, R. 2009. Small answers to the big question: learning from language programme evaluation. Language Teaching Research, 13(1), 99‒116.

Kiely, R., & Rea-Dickins, P. (2005). Program evaluation in language education. Hampshire: Palgrave Macmillan.

Krish, P. (2008). Some considerations in investigating synchronous online delivery of English courses: interfacing qualitative and quantitative paradigms. GEMA Online Journal of Language Studies, 8(2), 103‒125.

Low, G. (1989). Appropriate design: the internal organisation of course units. In Johnson, R.K. (Ed.), The second language curriculum (pp. 136‒154). Cambridge: Cambridge University Press.

Lynch, B.K. (2003). Language assessment and programme evaluation. Edinburgh: Edinburgh University Press.

Muhammad Salim Tufail. (2010). An Evaluation of the Malaysian Armed Forces General English Upper Intermediate Course (Officers). (Unpublished PhD thesis). Universiti Kebangsaan Malaysia.

Murphy, D.F. (1985). Evaluation in language teaching: assessment, accountability and awareness. In Alderson, J.C. (Ed.), Evaluation (pp. 1‒18). Oxford: Pergamon.

Norris, J.M. (2006). The why (and how) of assessing student outcomes in college foreign language programs. The Modern Language Journal, 90(4), 576‒583.

Norris, J.M. (2009). Understanding and improving language education through program evaluation: introduction to the special issue. Language Teaching Research, 13(1), 7‒13.

Nunan, D. (1989). Understanding language classrooms. New York: Prentice-Hall.

Richards, J.C. (2001). Curriculum development in language teaching. Cambridge: Cambridge University Press.

Weir, C., & Roberts, J. (1994). Evaluation in ELT. Oxford: Blackwell.