UPSI Digital Repository (UDRep)
|
|
|
Abstract : Universiti Pendidikan Sultan Idris |
The purpose of this study is to develop and validate the Writing Assessment Literacy
Inventory (WALI) for the English primary school teachers focusing on three
constructs which are practices, belief, and knowledge. The items of the instrument
were mainly adapted based on the original instrument by Crusan et al., (2016) and
input from literature in order to best suit the Malaysian context. This study used
quantitative research approach using Rasch model in the data analysis. The draft
instrument containing 56 items of original WALI was administered to 40 primary
schools teachers for pilot study in order to measure the validity and reliability of this
instrument. Based on the results of the pilot study, five items were removed from the
original instrument. The real study involved 214 primary school English teachers
from 32 schools in the district of Kinta Utara selected through simple random
sampling technique. Rasch Measurement analysis was used to obtain important
information about the validity and reliability of the instrument. The findings from the
real study showed that WALI has good validity values as demonstrated by PTMEA
CORR (0.04-0.63), and fit statistics, and the scale is functioning well. Item (0.97) and
person (0.87) reliability also showed high values. Unidimensionality value showed
acceptable range (27.6%, 31.3%) based on the analysis. The final version of the
WALI contained 49 items. The level of writing assessment literacy of teachers is at an
average level based on logit scores (0.99). From the results, it can be concluded that
WALI has good validity and reliability values. Therefore, the instrument can be used
in other primary schools in Malaysia. In addition, WALI will add to collection of
assessment instrument in writing literacy, and it encourages the use of modern test
theory in language testing. |
References |
Adibah Abdul Latif. (2013). Pembangunan Instrumen Penilaian Akhlak Pelajar (IMPAK) di Institusi Pengajian Tinggi Awam, PhD dissertation. Universiti Teknologi Malaysia. Johor Bharu.
Alkharusi, H. (2011). Psychometric properties of the Teacher Assessment Literacy Questionnaire for preservice teachers in Oman. In Procedia - Social and Behavioral Sciences (Vol. 29, pp. 1614–1624).
American Federation of Teachers, National Council of Measurement in Education, National Education Association (1990), Standards for Teacher Competence in Educational Assessment of Students, Retrieved from https://buros.org/standardsteacher- competence-educational-assessment-students
Andrich, D., and Marais, I., (2019). A Course in Rasch Measurement Theory, Measuring in the Educational, Social and Health Sciences. Singapore: Springer.
Black, P., William, D., (1998). Inside the black box: Raising the standards through classroom assessment. Phi Delta Kappa, 1-13
Bond, T.G., and Fox, C.M. (2015). Applying the Rasch Model: Fundamental Measurement in the Human Sciences (3rd Edition). New York: Routledge.
Boone, W., J., Staver, J., R., & Yale, M., S. (2014). Rasch Analysis in the human sciences, Dordrecht: Springer.
Boone, W., J., (2016). Rasch Analysis for Instrument Development: Why, When, And How? CBE Life Sciences Education, 15(4), 1-7.
Boone, W., J., & Noltemeyer, A., (2017), Rasch Analysis: A primer for school psychology researchers and practitioners. Cogent Education 4:1416898, 1-13.
Brookhart, S. M. (2010). How to assess higher-order thinking skills in your classroom. Alexandria, VA: ASCD.
Brown, S. (2014). Assessment literacy: the foundation for improving student learning. Assessment & Evaluation in Higher Education, 39(3), 395–396.
Colby-Kelly, C. (2014). Assessment for Learning in Theory and Practice in L2 Classroom. The Encyclopedia of Applied Linguistics, 1-7.
Conrad, J., K., Conrad, M., K., Dennis, L., M., Riley, B., B., & Funk, R. Validation of the Crime and Violence Scale (CVS) to the Rasch Measurement Model, GAIN Methods Report 1.2, 1-32.
Creswell. J., W., (2012). Educational Research, Planning, Conducting, and Evaluating Quantitative Research. (4th Edition). Boston: Pearson.
Crusan, D., (2010). Assessment in Second Language Writing Classroom. United States of America: The University of Michigan Press.
Crusan, D., Plakans, L., & Gebril, A. (2016). Writing assessment literacy: Surveying second language teachers‟ knowledge, beliefs, and practices. Assessing Writing, 28, 43–56.
Davis, L. (2018). Analytic, Holistic, and Primary Trait Marking Scales. The TESOL Encyclopedia of English Language Teaching, 1–6.
Deluca, C., Johnson, S. (2017), Developing assessment capable teachers in this age of Accountability. Assessment in Education: Principles, Policy, and Practice, Vol. 24(2), 121-126.
DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016). Approaches to Classroom Assessment Inventory: A New Instrument to Support Teacher Assessment Literacy. Educational Assessment, 21(4), 248–266.
DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016). Teacher assessment literacy: a review of international standards and measures. Educational Assessment, Evaluation and Accountability, 28(3), 251–272.
DeMars, C. (2010). Item Response Theory: Understanding Statistic Measurement. New York: Oxford University Press. Education and Performance Unit (PADU). (2018), Malaysia Education Blueprint Annual Report, Retrieved from https://www.padu.edu.my/wpcontent/ uploads/2019/07/AR2018_Report-Card.pdf
Education and Performance Unit (PADU). (2017), Malaysia Education Blueprint Annual Report, Retrieved from https://www.padu.edu.my/wp-content/ uploads/2018/07/PADU-AR2017-CARD-ENG_Web.pdf
Education and Performance Unit (PADU), (2018), 21st Century Learning Teachers Campaign Launch, Retrieved from https://www.padu.edu.my/events/21st-century- Learning-teachers-campaign-launch/
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132.
Ghazali Darusalam & Sufean Hussein.(2017). Metodologi Penyelidikan dalam Pendidikan: Amalan dan Analisis Kajian. Kuala Lumpur: Penerbit Universiti Malaya.
Giraldo, F. (2018). Language Assessment Literacy: Implications for Language Teachers. Profile: Issues in Teachers´ Professional Development, 20(1), 179– 195.
Gotch, C. M., & French, B. F. (2014). A systematic review of assessment literacy measures. Educational Measurement: Issues and Practice, 33(2), 14–18.
Green, K.E. & Frantom, C.G. (2002), Survey Development and Validation with the Rasch Model, Presentation Manuscript, Charleston, SC. Retrieved from, https://portfolio.du.edu/downloadItem/115525
Hailaya, W., Alagumalai, S., & Ben, F. (2014). Examining the utility of Assessment Literacy Inventory and its portability to education systems in the Asia Pacific region. Australian Journal of Education, 58(3), 297–317.
Hyland, K. (2003). Second Language Writing. United States of America: Cambridge University Press.
Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385–402.
Inbar-Lourie, O. (2016). Language Assessment Literacy. In Language Testing and Assessment (pp. 1–14). Springer International Publishing.
Intisar Ibrahim Ridwan, Rosmah Ali, Mohamad Zulkefli, Nazar Elfadil and Izzeldin Ibrahim, (2016). Instrument development and validation using Rasch Model to Measure student cognitive skills. International Research Conference on Engineering, Science, and Humanities, 9-10 November 2016.
Khadijeh, B., & Amir, R. (2015). Importance of Teachers‟ Assessment Literacy., International Journal of English Language Education, 3(1), 139.
Lam, R. (2019). Teacher assessment literacy: Surveying knowledge, conceptions and practices of classroom-based writing assessment in Hong Kong. System, 81, 78– 89.
Lan, C., & Fan, S. (2019). Developing classroom-based language assessment literacy for in-service EFL teachers: The gaps. Studies in Educational Evaluation, 61, 112–122.
Lee, I. (2017). Classroom writing assessment and feedback in L2 school contexts. Singapore: Springer.
Lian, L. H., Yew, W. T. (2016). A Framework for Examining Assessment Literacy of Preservice Teachers. US-China Education Review A, Vol. 6 (5), 294-300.
Lian, L. H., Yew, W. T., & Meng, C. C. (2014). Enhancing Malaysian Teachers‟ Assessment Literacy. International Education Studies, 7(10).
Linacre. J. M., (2005). A user’s guide to Winsteps/Ministeps Rasch model programs. Chicago, Illanois: MESA Press.
Linacre, J., M., (2007). A user’s guide to WINSTEPS Rasch-model computer programs. Chicago, Illinois: MESA Press.
Malone, M. E. (2013). The essentials of assessment literacy: Contrasts between testers and users. Language Testing, 30(3), 329–344.
Mellati, M., & Khademi, M. (2018). Exploring teachers‟ assessment literacy: Impact on learners‟ writing achievements and implications for teacher development. Australian Journal of Teacher Education, 43(6), 1–18.
Mertler, C. A., & Campbell, C. (2005). Measuring Teachers‟ Knowledge & Application of Classroom Assessment Concepts: Development of the Assessment Literacy Inventory. American Educational Research Association.
Ministry of Education (2011). Malaysia Education Blueprint 2013-2025, Retrieved From https://www.moe.gov.my/menumedia/media-cetak/penerbitan/dasar/1207- malaysia-education-blueprint-2013-2025/file
Miller, M., D., Linn, R., L., & Gronlund, N.E. (2013). Measurement and Assessment In Teaching, United States of America: Pearson.
Mohd Kashfi Mohd Jailani (2011). Manual Pengenalan Pengukuran Rasch dan Winsteps, Universiti Kebangsaan Malaysia. Selangor.
Mohamad Affi Yusri Mohamad Zaini & Nooraini Othman. (2016). Pengujian Kebolehpercayaan Instrumen Sikap Dan Persepsi Terhadap Akademik Dan Sahsiah: Pengaplikasian Model Rasch Sains Humanika 8(2), 27-37.
Muhamad Shazielan Sharif, Zaliza Hanapi, Irdayanti Mat Nashir, Che Ghani Che Kob, and Arman Shah Abdullah. (2019). Construct Validity and Reliability of Manufacturing Industry: A Rasch Measurement Model Approaches for Pilot Study. International Journal of Academic Research in Business and Social Sciences, 9(3), 654–665.
Mujumdar, A. (2017). Teaching English as A Second Language: Theory and Praxis, India: Sage.
Norhasnida Che Mad Ghazali (2016). The implementation of School-Based Assessment System in Malaysia: A study of teacher perceptions. Geografia Online, Malaysia Journal of Society and Space 12(9), 104-117.
Normarina Abd Rahman. (2016). Pembinaan dan validasi instrument pengukuran efikasi kendiri terhadap pentaksiran alternatif, Master‟s dissertation. Universiti Pendidikan Sultan Idris. Tanjong Malim.
Opre, D., (2015). Teachers‟ Conceptions of Assessment. Procedia Social and Behavioural Sciences 209, 229-233.
Pastore, S. & Andrade, H. L., (2019). Teacher assessment literacy: A threedimensional model. Teaching and Teacher Education, Vol. 84, 128-138
Perera, C. J, Sumintono, B, Jiang Na, (2018). The Psychometric Validation of the Principal Practices Questionnaire Based on Item Response Theory. International Online Journal of Educational Leadership, 2(1), 21-38.
Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory into Practice, 48(1), 4–11.
Popham, W. J. (2011). Assessment literacy overlooked: A teacher educator‟s confession. Teacher Educator, 46(4), 265–273.
Rasch, G., (1980). Probabilistic Models for Some Intelligence and Attainment Test. Chicago: University of Chicago.
Rohaya Talib, Mohd Najib Abd Ghafar, Hamimah Abu Naim., (2014), Assessment Literacy: A Catalyst to the Success of School-Based Assessment in Malaysian Schools.
Rohaya Talib, Mohd Zaki Kamsah, Mohd Najib Abd Ghafar, Megat Aman Zahiri Megat Zakaria, and Hamimah Abu Naim. (2013), T-Assess: Assessment Literacy Test For Malaysian Teachers. International Conference on Assessment for Higher Education Across Domains and Skills (pg. 1-9).
Rozmi Ismail (2015), Metodologi Penyelidikan Teori dan Praktis. Bangi. Penerbit Universiti Kebangsaan Malaysia.
Russell, M., K., & Airasian, P., W. (2012). Classroom Assessment: Concepts and Application. New York: McGraw Hill.
Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309– 327.
Scarino, A. (2017), Developing assessment literacy of teachers of languages: A Conceptual and interpretive challenge. Papers in Language Testing and Assessment, Vol. 6(1), 18-39.
Sharifah Nurulhuda Tuan Mohd Yasin, Mohd Fauzi Mohd Yunus and Izwah Ismail (2018). The use of rasch measurement model for the validity and reliability, Journal of Counselling and Educational Technology, 1(2), 22-27.
Sinnema, C., Ludlow, L., & Robinson, V. (2016). Educational leadership effectiveness: a Rasch analysis. Journal of Educational Administration, 54(3), 305 - 339.
Siti Eshah Mokhsein, Othman Lebar, Jamal@Nordin Yunus, Azali Rahmat, Mohd Uzi Dollah, Azliza Muhammad, Nor Azah Mansor, Azma Mahmood & Norain Md Noor. (2015). Development and Validation of Assessment Practice Inventory for Teacher Educators. International Journal of Assessment and Evaluation in Education (5), 25-43
Siti Sahirah Saidi & Nyet Moi Siew. (2019). Reliability and Validity Analysis of Statistical Reasoning Test Survey Instrument using the Rasch Measurement Model. International Electronic Journal of Mathematics Education, 14(3), 535-546.
Sultana, N. (2019). Language Assessment Literacy: An Uncharted Area for the English Language Teachers in Bangladesh. Language Testing in Asia 9(1), 1-14.
Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch Pada Assessment Pendidikan. Cimahi. Trim Komunikata Publishing House.
Wei, S., L., Haslinda Ismail. Costa, J., S., Hong, B., T., (2018). Assessment for learning research in East Asian countries. Studies in Educational Evaluation Vol.59, 270-277.
Taherdoost, H. (2016). Sampling Method in Research Methodology; How to Choose Sampling Technique. International Journal of Academic Research in Management 5(2), 18-27.
Weigle. S., C., (2014). Considerations for Teaching Second Language Writing, in Murcia, M., C., Brinton, D., M., Snow, M., A. (eds). Teaching English as a Second or Foreign Language (4th Edition). United States of America: National Geographic Learning.
Weigle, S., C. (2002). Assessing Writing. United Kingdom: Cambridge University Press.
Wiliam, D. (2016). Foreword: Assessment Literacy. London Review of Education, 13(3), 3–4.
Wright, B., D. (1991). Diagnosing misfit. Rasch Measurement Trans 5(2), 56.
Wu, M., & Adams, R. (2007). Applying the Rasch Model to psycho-social measurement: A Practical Approach. Melbourne, Australia:Education Measurement Solutions.
Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149–162.
Yamtim, V., & Wongwanich, S. (2014). A Study of Classroom Assessment Literacy of Primary School Teachers. Procedia - Social and Behavioral Sciences, 116, 2998–3004.
Zhang, L. & Soh. K.C., (2018), Teacher Assessment Literacy Scale: Design and Validation. Teaching Chinese Language in Singapore, 179-191
|
This material may be protected under Copyright Act which governs the making of photocopies or reproductions of copyrighted materials. You may use the digitized material for private study, scholarship, or research. |