Assessing the reliability of the framework for equitable and effective teaching with the many-facet rasch model

Priyalatha Govindasamy

QR Code Link :
Type :	article
Subject :	L Education
Main Author :	Priyalatha Govindasamy
Additional Authors :	Salazar, Maria del Carmen Lerner, Jessica Green, Kathy Ellen
Title :	Assessing the reliability of the framework for equitable and effective teaching with the many-facet rasch model

Place of Production :	Tanjong Malim
Publisher :	Fakulti Pembangunan Manusia
Year of Publication :	2019
Corporate Name :	Universiti Pendidikan Sultan Idris

Abstract : Universiti Pendidikan Sultan Idris

This manuscript reports results of an empirical assessment of a newly developed measure designed to assess apprentice teaching proficiency. In this study, Many Facets Rasch model software was used to evaluate the psychometric quality of the Framework for Equitable and Effective Teaching (FEET), a rater-mediated assessment. The analysis focused on examining variability in (1) supervisor severity in ratings, (2) level of item difficulty, (3) time of assessment, and (4) teacher apprentice proficiency. Added validity evidence showed moderate correlation with self-reports of apprentice teaching. The findings showed support for the FEET as yielding reliable ratings with a need for added rater training.

References

1. ATLAS.ti (2015). (Version 8) [Software]. Available at: atlasti.com (accessed June 4, 2019).

2. Barton, P. (2005). One-Third of a Nation: Rising Dropout Rates and Decliningopportunities. Policy Information Report. Available at: http: //eric.ed.gov/PDFS/ED485192.pdf (accessed June 4, 2019).

3. Boyd, D., Grossman, P., Lankford, H., Loeb, S., and Wyckoff, J. (2007). Who Leaves? Teacherattrition and Student Achievement. Available at: http://eric.ed.gov/PDFS/ED508275.pdf (accessed June 4, 2019).

4. Bracey, G. W. (2009). Education Hell: Rhetoric vs. Reality. Alexandria: Educational Research Service.

5. Clarke, S., Hero, R., Sidney, S., Fraga, L., and Erlichson, B. (2006). Multiethnic: The Politics of Urban Education Reform. Philadelphia, PA: Temple University Press.

6. Cochran-Smith, M. (2004). The problem of teacher education. J. Teach. Educ. 55, 295–299.

7. Daley, G., and Kim, L. (2010). A Teacher Evaluation System That Works. Working Paper at National Institute for Excellence in Teaching, Santa Monica, CA.

8. Danielson, C. (2007). Enhancing Professional Practice: A Framework for Teaching. Alexandria: ASCD.

9. Darling-Hammond, L. (2009). Recognizing and enhancing teacher effectiveness. Int. J. Educ. Psychol. Assess. 3, 1–24.

10. Downing, S. M. (2005). Threats to the validity of clinical teaching assessments: what about rater error? Med. Educ. 39, 350–355.

11. Eckes, T. (2015). Introduction to Many-Facet RASCH Measurement: Analyzing and Evaluatingrater-Mediated Assessments (2nd Edn.). Frankfurt: Peter Lang.

12. Farrokhi, F., Esfandiari, R., and Dalili, M. V. (2011). Applying the many facet rasch modelto detect centrality in self-assessment, peer assessment and teacher assessment. World Appl. Sci. J. 15, 70–77.

13. Hites, L. S., and Lundervold, D. A. (2013). Relation between direct observation of relaxationand self-reported mindfulness and relaxation states. Int. J. Behav. Consult. Ther. 7, 6–7.

14. Interstate New Teacher Assessment and Support Consortium. (2013). InTASC Model Core Teaching Standards and Learning Progressions. Available at: http://programs.ccsso.org/projects/interstate_new_teacher_assessment_and_ support_consortium/ (accessed May 1, 2019).

15. Korthagen, F. (2004). In search of the essence of a good teacher: towards a more holistic approach in teacher education. Teach. Teach. Educ. 20, 77–97.

16. Korthagen, F., Loughran, J., and Russell, T. (2006). Developing fundamental principles forteacher education programs and practices. Teach. Teach. Educ. 22, 1020–1041.

17. Linacre, J. M. (2013). A User’s Guide to Facets: Rasch Measurement Computer Program[Computer program manual]. Chicago, US: MESA Press.

18. Linacre, J. M. (2015). FACETS [Computer Program, Version 3.71.4]. Chicago, US: MESA Press.

19. Marzano Center. (2015). Marzano Teacher Evaluation Model. Available at: http: //www.marzanoevaluation.com (accessed June 4, 2019).

20. McGee, C. A., and Banks, J. (1995). Equity pedagogy: an essential component ofmulticultural education. Theory Prac. 34, 152–158. doi: 10.1080/00405849509543674

21. Medley, M. (1979). “The effectiveness of teachers,” in Research on Teaching: Concepts, Findings, and Implications, eds P. Peterson and H. Walberg (Berkley, CA: McCutchan).

22. Milanowski, A. (2011). Strategic measures of teacher performance. Phi Delta Kappan 92, 19–25.

23. Myford, C. M., and Wolfe, E. W. (2003). Detecting and measuring rater effects using manyfacet rasch measurement: part I. J. Appl. Measure. 4, 386–422.

24. Myford, C. M., and Wolfe, E. W. (2004). Detecting and measuring rater effects using many-facet rasch measurement: part II. J. Appl. Measure. 5, 189–227.

25. National Board of Professional Teaching Standards (2015). Five Core Propositions. Available at: http://www.nbpts.org/five-core-propositions (accessed June 4, 2019).

26. New Teacher Project (2011). Rating a Teacher Observation Tool: Five Ways to Ensure Classroom Observations are Focused and Rigorous. Available at: https://tntp.org/assets/documents/TNTP_RatingATeacherObservationTool_Feb2011.pdf (accessed June 3, 2019).

27. Papay, J. (2012). Refocusing the debate: assessing the purposes and tools of teacher evaluation. Harv. Educ. Rev. 82, 123–141.

28. Salazar, M. (2013). A humanizing pedagogy reinventing the principles and practice of education as a journey toward liberation. Rev. Res. Educ. 37, 121–148.

29. Seidel, K., Green, K., and Briggs, D. (2011). An Exploration of Novice Teachers’ Core Competencies: Impact on Student Achievement, and Effectiveness of Preparation. Washington, DC: IES.

30. Sleeter, C. E. (2000). Epistemological diversity in research on preservice teacher preparation for historically underserved children. Rev. Res. Educ. 25, 209–250.

31. Taylor, E. S., and Tyler, J. H. (2011). The Effect of Evaluation on Performance: Evidence from Longitudinal Student Achievement Data of Mid-Career Teachers. Cambridge, MA: National Bureau of Economic Research.

32. Teachscape. (2015). The Danielson Framework. Available at: https://www. teachscape.com/solutions/framework-for-teaching (accessed June 4, 2019).

33. Wagner, T. (2007). The Global Achievement Gap: Why Even Our Best Schools don’t Teach Thenew Survival Skills our Children Need and What we can do About it. New York, NY: PerseusBooks.

34. Welner, K. G., and Carter, P. L. (2013). “Achievement gaps arise from opportunity gaps,” in Closing the Opportunity gap: What America must do Togive Every Child an Even Chance, eds P. L. Carter and K. G. Welner (New York, NY: Oxford University Press).

35. Williams, A. (2011). A call for change: narrowing the achievement gap between white andminority students. Clear. House 84, 65–71.

This material may be protected under Copyright Act which governs the making of photocopies or reproductions of copyrighted materials.
You may use the digitized material for private study, scholarship, or research.

Back to previous page