UPSI Digital Repository (UDRep)
Start | FAQ | About
Menu Icon

QR Code Link :

Type :thesis
Subject :LB Theory and practice of education
Main Author :Nur Atiqah Shaharuddin
Title :Development and validation of Writing Assessment Literacy Inventory (WALI) for English language primary school teachers using Rasch model
Place of Production :Tanjong Malim
Publisher :Fakulti Pembangunan Manusia
Year of Publication :2021
Corporate Name :Universiti Pendidikan Sultan Idris
PDF Guest :Click to view PDF file

Abstract : Universiti Pendidikan Sultan Idris
The purpose of this study is to develop and validate the Writing Assessment Literacy Inventory (WALI) for the English primary school teachers focusing on three constructs which are practices, belief, and knowledge. The items of the instrument were mainly adapted based on the original instrument by Crusan et al., (2016) and input from literature in order to best suit the Malaysian context. This study used quantitative research approach using Rasch model in the data analysis. The draft instrument containing 56 items of original WALI was administered to 40 primary schools teachers for pilot study in order to measure the validity and reliability of this instrument. Based on the results of the pilot study, five items were removed from the original instrument. The real study involved 214 primary school English teachers from 32 schools in the district of Kinta Utara selected through simple random sampling technique. Rasch Measurement analysis was used to obtain important information about the validity and reliability of the instrument. The findings from the real study showed that WALI has good validity values as demonstrated by PTMEA CORR (0.04-0.63), and fit statistics, and the scale is functioning well. Item (0.97) and person (0.87) reliability also showed high values. Unidimensionality value showed acceptable range (27.6%, 31.3%) based on the analysis. The final version of the WALI contained 49 items. The level of writing assessment literacy of teachers is at an average level based on logit scores (0.99). From the results, it can be concluded that WALI has good validity and reliability values. Therefore, the instrument can be used in other primary schools in Malaysia. In addition, WALI will add to collection of assessment instrument in writing literacy, and it encourages the use of modern test theory in language testing.

References

Adibah Abdul Latif. (2013). Pembangunan Instrumen Penilaian Akhlak Pelajar

(IMPAK) di Institusi Pengajian Tinggi Awam, PhD dissertation. Universiti

Teknologi Malaysia. Johor Bharu.

 

Alkharusi, H. (2011). Psychometric properties of the Teacher Assessment Literacy

Questionnaire for preservice teachers in Oman. In Procedia - Social and

Behavioral Sciences (Vol. 29, pp. 1614–1624).

 

American Federation of Teachers, National Council of Measurement in Education,

National Education Association (1990), Standards for Teacher Competence in

Educational Assessment of Students, Retrieved from https://buros.org/standardsteacher-

competence-educational-assessment-students

 

Andrich, D., and Marais, I., (2019). A Course in Rasch Measurement Theory,

Measuring in the Educational, Social and Health Sciences. Singapore: Springer.

 

Black, P., William, D., (1998). Inside the black box: Raising the standards through

classroom assessment. Phi Delta Kappa, 1-13

 

Bond, T.G., and Fox, C.M. (2015). Applying the Rasch Model: Fundamental

Measurement in the Human Sciences (3rd Edition). New York: Routledge.

 

Boone, W., J., Staver, J., R., & Yale, M., S. (2014). Rasch Analysis in the human

sciences, Dordrecht: Springer.

 

Boone, W., J., (2016). Rasch Analysis for Instrument Development: Why, When,

And How? CBE Life Sciences Education, 15(4), 1-7.

 

Boone, W., J., & Noltemeyer, A., (2017), Rasch Analysis: A primer for school

psychology researchers and practitioners. Cogent Education 4:1416898, 1-13.

 

Brookhart, S. M. (2010). How to assess higher-order thinking skills in your

classroom. Alexandria, VA: ASCD.

 

Brown, S. (2014). Assessment literacy: the foundation for improving student

learning. Assessment & Evaluation in Higher Education, 39(3),

395–396.

 

Colby-Kelly, C. (2014). Assessment for Learning in Theory and Practice in L2

Classroom. The Encyclopedia of Applied Linguistics, 1-7.

 

Conrad, J., K., Conrad, M., K., Dennis, L., M., Riley, B., B., & Funk, R. Validation of

the Crime and Violence Scale (CVS) to the Rasch Measurement Model, GAIN

Methods Report 1.2, 1-32.

 

Creswell. J., W., (2012). Educational Research, Planning, Conducting, and

Evaluating Quantitative Research. (4th Edition). Boston: Pearson.

 

Crusan, D., (2010). Assessment in Second Language Writing Classroom. United

States of America: The University of Michigan Press.

 

Crusan, D., Plakans, L., & Gebril, A. (2016). Writing assessment literacy: Surveying

second language teachers‟ knowledge, beliefs, and practices. Assessing Writing,

28, 43–56.

 

Davis, L. (2018). Analytic, Holistic, and Primary Trait Marking Scales. The TESOL

Encyclopedia of English Language Teaching, 1–6.

 

Deluca, C., Johnson, S. (2017), Developing assessment capable teachers in this age of

Accountability. Assessment in Education: Principles, Policy, and Practice, Vol.

24(2), 121-126.

 

DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016). Approaches to Classroom

Assessment Inventory: A New Instrument to Support Teacher Assessment

Literacy. Educational Assessment, 21(4), 248–266.

 

DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016). Teacher assessment

literacy: a review of international standards and measures. Educational

Assessment, Evaluation and Accountability, 28(3), 251–272.

 

DeMars, C. (2010). Item Response Theory: Understanding Statistic Measurement.

New York: Oxford University Press.

Education and Performance Unit (PADU). (2018), Malaysia Education Blueprint

Annual Report, Retrieved from https://www.padu.edu.my/wpcontent/

uploads/2019/07/AR2018_Report-Card.pdf

 

Education and Performance Unit (PADU). (2017), Malaysia Education Blueprint

Annual Report, Retrieved from https://www.padu.edu.my/wp-content/

uploads/2018/07/PADU-AR2017-CARD-ENG_Web.pdf

 

Education and Performance Unit (PADU), (2018), 21st Century Learning Teachers

Campaign Launch, Retrieved from https://www.padu.edu.my/events/21st-century-

Learning-teachers-campaign-launch/

 

Fulcher, G. (2012). Assessment literacy for the language classroom. Language

Assessment Quarterly, 9(2), 113–132.

 

Ghazali Darusalam & Sufean Hussein.(2017). Metodologi Penyelidikan dalam

Pendidikan: Amalan dan Analisis Kajian. Kuala Lumpur: Penerbit Universiti

Malaya.

 

Giraldo, F. (2018). Language Assessment Literacy: Implications for Language

Teachers. Profile: Issues in Teachers´ Professional Development, 20(1), 179–

195.

 

Gotch, C. M., & French, B. F. (2014). A systematic review of assessment literacy

measures. Educational Measurement: Issues and Practice, 33(2), 14–18.

 

Green, K.E. & Frantom, C.G. (2002), Survey Development and Validation with the

Rasch Model, Presentation Manuscript, Charleston, SC. Retrieved from,

https://portfolio.du.edu/downloadItem/115525

 

Hailaya, W., Alagumalai, S., & Ben, F. (2014). Examining the utility of Assessment

Literacy Inventory and its portability to education systems in the Asia Pacific

region. Australian Journal of Education, 58(3), 297–317.

 

Hyland, K. (2003). Second Language Writing. United States of America: Cambridge

University Press.

 

Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A

focus on language assessment courses. Language Testing, 25(3), 385–402.

 

Inbar-Lourie, O. (2016). Language Assessment Literacy. In Language Testing and

Assessment (pp. 1–14). Springer International Publishing.

 

Intisar Ibrahim Ridwan, Rosmah Ali, Mohamad Zulkefli, Nazar Elfadil and Izzeldin

Ibrahim, (2016). Instrument development and validation using Rasch Model to

Measure student cognitive skills. International Research Conference on

Engineering, Science, and Humanities, 9-10 November 2016.

 

Khadijeh, B., & Amir, R. (2015). Importance of Teachers‟ Assessment Literacy.,

International Journal of English Language Education, 3(1), 139.

 

Lam, R. (2019). Teacher assessment literacy: Surveying knowledge, conceptions and

practices of classroom-based writing assessment in Hong Kong. System, 81, 78–

89.

 

Lan, C., & Fan, S. (2019). Developing classroom-based language assessment literacy

for in-service EFL teachers: The gaps. Studies in Educational Evaluation, 61,

112–122.

 

Lee, I. (2017). Classroom writing assessment and feedback in L2 school

contexts. Singapore: Springer.

 

Lian, L. H., Yew, W. T. (2016). A Framework for Examining Assessment Literacy of

Preservice Teachers. US-China Education Review A, Vol. 6 (5), 294-300.

 

Lian, L. H., Yew, W. T., & Meng, C. C. (2014). Enhancing Malaysian Teachers‟

Assessment Literacy. International Education Studies, 7(10).

 

Linacre. J. M., (2005). A user’s guide to Winsteps/Ministeps Rasch model programs.

Chicago, Illanois: MESA Press.

 

Linacre, J., M., (2007). A user’s guide to WINSTEPS Rasch-model computer

programs. Chicago, Illinois: MESA Press.

 

Malone, M. E. (2013). The essentials of assessment literacy: Contrasts between testers

and users. Language Testing, 30(3), 329–344.

 

Mellati, M., & Khademi, M. (2018). Exploring teachers‟ assessment literacy: Impact

on learners‟ writing achievements and implications for teacher

development. Australian Journal of Teacher Education, 43(6), 1–18.

 

Mertler, C. A., & Campbell, C. (2005). Measuring Teachers‟ Knowledge &

Application of Classroom Assessment Concepts: Development of the Assessment

Literacy Inventory. American Educational Research Association.

 

Ministry of Education (2011). Malaysia Education Blueprint 2013-2025, Retrieved

From https://www.moe.gov.my/menumedia/media-cetak/penerbitan/dasar/1207-

malaysia-education-blueprint-2013-2025/file

 

Miller, M., D., Linn, R., L., & Gronlund, N.E. (2013). Measurement and Assessment

In Teaching, United States of America: Pearson.

 

Mohd Kashfi Mohd Jailani (2011). Manual Pengenalan Pengukuran Rasch dan

Winsteps, Universiti Kebangsaan Malaysia. Selangor.

 

Mohamad Affi Yusri Mohamad Zaini & Nooraini Othman. (2016). Pengujian

Kebolehpercayaan Instrumen Sikap Dan Persepsi Terhadap Akademik Dan

Sahsiah: Pengaplikasian Model Rasch Sains Humanika 8(2), 27-37.

 

Muhamad Shazielan Sharif, Zaliza Hanapi, Irdayanti Mat Nashir, Che Ghani Che

Kob, and Arman Shah Abdullah. (2019). Construct Validity and Reliability of

Manufacturing Industry: A Rasch Measurement Model Approaches for Pilot

Study. International Journal of Academic Research in Business and Social

Sciences, 9(3), 654–665.

 

Mujumdar, A. (2017). Teaching English as A Second Language: Theory and Praxis,

India: Sage.

 

Norhasnida Che Mad Ghazali (2016). The implementation of School-Based

Assessment System in Malaysia: A study of teacher perceptions. Geografia

Online, Malaysia Journal of Society and Space 12(9), 104-117.

 

Normarina Abd Rahman. (2016). Pembinaan dan validasi instrument pengukuran

efikasi kendiri terhadap pentaksiran alternatif, Master‟s dissertation. Universiti

Pendidikan Sultan Idris. Tanjong Malim.

 

Opre, D., (2015). Teachers‟ Conceptions of Assessment. Procedia Social and

Behavioural Sciences 209, 229-233.

 

Pastore, S. & Andrade, H. L., (2019). Teacher assessment literacy: A threedimensional

model. Teaching and Teacher Education, Vol. 84, 128-138

 

Perera, C. J, Sumintono, B, Jiang Na, (2018). The Psychometric Validation of the

Principal Practices Questionnaire Based on Item Response Theory. International

Online Journal of Educational Leadership, 2(1), 21-38.

 

Popham, W. J. (2009). Assessment literacy for teachers: Faddish or

fundamental? Theory into Practice, 48(1), 4–11.

 

Popham, W. J. (2011). Assessment literacy overlooked: A teacher educator‟s

confession. Teacher Educator, 46(4), 265–273.

 

Rasch, G., (1980). Probabilistic Models for Some Intelligence and Attainment Test.

Chicago: University of Chicago.

 

Rohaya Talib, Mohd Najib Abd Ghafar, Hamimah Abu Naim., (2014), Assessment

Literacy: A Catalyst to the Success of School-Based Assessment in Malaysian

Schools.

 

Rohaya Talib, Mohd Zaki Kamsah, Mohd Najib Abd Ghafar, Megat Aman Zahiri

Megat Zakaria, and Hamimah Abu Naim. (2013), T-Assess: Assessment Literacy

Test For Malaysian Teachers. International Conference on Assessment for

Higher Education Across Domains and Skills (pg. 1-9).

 

Rozmi Ismail (2015), Metodologi Penyelidikan Teori dan Praktis. Bangi. Penerbit

Universiti Kebangsaan Malaysia.

 

Russell, M., K., & Airasian, P., W. (2012). Classroom Assessment: Concepts and

Application. New York: McGraw Hill.

 

Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding

the role of interpretation in assessment and in teacher learning. Language

Testing, 30(3), 309– 327.

 

Scarino, A. (2017), Developing assessment literacy of teachers of languages: A

Conceptual and interpretive challenge. Papers in Language Testing and

Assessment, Vol. 6(1), 18-39.

 

Sharifah Nurulhuda Tuan Mohd Yasin, Mohd Fauzi Mohd Yunus and Izwah Ismail

(2018). The use of rasch measurement model for the validity and reliability,

Journal of Counselling and Educational Technology, 1(2), 22-27.

 

Sinnema, C., Ludlow, L., & Robinson, V. (2016). Educational leadership

effectiveness: a Rasch analysis. Journal of Educational Administration, 54(3),

305 - 339.

 

Siti Eshah Mokhsein, Othman Lebar, Jamal@Nordin Yunus, Azali Rahmat, Mohd

Uzi Dollah, Azliza Muhammad, Nor Azah Mansor, Azma Mahmood & Norain

Md Noor. (2015). Development and Validation of Assessment Practice Inventory

for Teacher Educators. International Journal of Assessment and Evaluation in

Education (5), 25-43

 

Siti Sahirah Saidi & Nyet Moi Siew. (2019). Reliability and Validity Analysis of

Statistical Reasoning Test Survey Instrument using the Rasch Measurement

Model. International Electronic Journal of Mathematics Education, 14(3),

535-546.

 

Sultana, N. (2019). Language Assessment Literacy: An Uncharted Area for the

English Language Teachers in Bangladesh. Language Testing in Asia 9(1), 1-14.

 

Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch Pada Assessment

Pendidikan. Cimahi. Trim Komunikata Publishing House.

 

Wei, S., L., Haslinda Ismail. Costa, J., S., Hong, B., T., (2018). Assessment for

learning research in East Asian countries. Studies in Educational Evaluation

Vol.59, 270-277.

 

Taherdoost, H. (2016). Sampling Method in Research Methodology; How to Choose

Sampling Technique. International Journal of Academic Research in Management

5(2), 18-27.

 

Weigle. S., C., (2014). Considerations for Teaching Second Language Writing, in

Murcia, M., C., Brinton, D., M., Snow, M., A. (eds). Teaching English as a

Second or Foreign Language (4th Edition). United States of America: National

Geographic Learning.

 

Weigle, S., C. (2002). Assessing Writing. United Kingdom: Cambridge University

Press.

 

Wiliam, D. (2016). Foreword: Assessment Literacy. London Review of

Education, 13(3), 3–4.

 

Wright, B., D. (1991). Diagnosing misfit. Rasch Measurement Trans 5(2), 56.

 

Wu, M., & Adams, R. (2007). Applying the Rasch Model to psycho-social

measurement: A Practical Approach. Melbourne, Australia:Education

Measurement Solutions.

 

Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A

reconceptualization. Teaching and Teacher Education, 58, 149–162.

 

Yamtim, V., & Wongwanich, S. (2014). A Study of Classroom Assessment Literacy

of Primary School Teachers. Procedia - Social and Behavioral Sciences, 116,

2998–3004.

 

Zhang, L. & Soh. K.C., (2018), Teacher Assessment Literacy Scale:

Design and Validation. Teaching Chinese Language in Singapore, 179-191

 


This material may be protected under Copyright Act which governs the making of photocopies or reproductions of copyrighted materials.
You may use the digitized material for private study, scholarship, or research.

Back to previous page

Installed and configured by Bahagian Automasi, Perpustakaan Tuanku Bainun, Universiti Pendidikan Sultan Idris
If you have enquiries, kindly contact us at pustakasys@upsi.edu.my or 016-3630263. Office hours only.