Email the author 
.png)
.png)
Classroom Teachers' Bias in Assessing Disadvantaged Primary School Students' Reading Comprehension Skills
Abstract
It is known that the reading performance of disadvantaged students is lower when compared to non-disadvantaged students. It has always been discussed that being disadvantaged affects teachers' bias in scoring students' reading performance. Therefore, the existence and effect of the teacher factor in the low level of reading performance of students in disadvantaged groups is worth investigating. The reading comprehension skills of disadvantaged and non-disadvantaged fourth grade primary school students were assessed in this study. Moreover, whether the classroom teachers were biased in scoring the reading comprehension skills of the disadvantaged students were also investigated. The reading comprehension skills of 48 students, 13 of whom were disadvantaged and 35 were non-disadvantaged, were assessed by three classroom teachers (raters) using an analytical rubric. The data were analyzed using the Many-facet Rasch measurement model. It was found that the classroom teachers were biased in evaluating the reading comprehension skills of disadvantaged students. Likewise, the reading comprehension levels of the non-disadvantaged students were higher than the disadvantaged students.
Keywords
Full Text:
PDFReferences
Afflerbach, P., & Cho, B. (2011). The classroom assessment of reading. M. Kamil, P. Pearson, E. Moje, & P. Afflerbach içinde, Handbook of reading research. New York
American Educational Researchparticularation, American Psychological Association, & National Council on Measurement in Education (AERA). (2014). Standards for educational and psychological testing. Washington.
Akyol, H. (2019). Türkçe ilk okuma yazma öğretimi. Ankara.
Antoniazzi, D., Snow, P., & Swift, V. D. (2010). Teacher identification of children at risk for language impairment in the first year of school. International Journal of Speech-Language Pathology, 12(3), 244-252. https://doi.org/10.3109/17549500903104447
Arnold, D. H., & Doctoroff, G. (2003). The early education of socioeconomically disadvantaged children. Annual Review of Psychology, 54, 517–545. https://doi.org/10.1146/annurev.psych.54.111301.145442
Aytaş, G., & Kardaş, D. (2014). Dezavantajlı öğrencilerin okuma anlama gelişimleri. Turkish Studies, 9(1), 79-92. https://arastirmax.com/tr/system/files/dergiler/79199/makaleler/9/11/arastirmax-dezavantajli-ogrencilerin-okuma-anlama-gelisimleri.pdf
Baddour, J., Hipfner-Boucher, K., Janaideh, R. A., Paradis, J., Gottardo, A., & Chen, X. (2019). A Snapshot of progress: The development of English and Arabic language and literacy skills of Syrian refugee children and youth in Canada. Selected presentations form the 22nd Metropolis Canada Conference (s. 52-72). Canada.
Barton, P., & Coley, R. (2009, 10 01). Parsing the Achievement Gap II. Educational Testing Service, Princeton,NJ. http://www.ets.org/Media/Research/pdf/PICPARSINGII.pdf
Baştuğ, M., Hiğde, A., Çam, E., Örs, E., & Efe, P. (2019). Okuduğunu anlamayı becerilerini geliştirme: Stratejiler, teknikler, uygulamalar. Ankara.
Bergh, V. L., Denessen, E., Hornstra, L., Voeten, M., & Holland, R. (2010). The implicit prejudiced attitudes of teachers:Relations to teacher expectations and the ethnic achievement gap. American Educational Research Journal, 47(2), 497-527. https://doi.org/10.3102/0002831209353594
Bolat, Y. (2021). Primary school teachers' views on Syrian Students’ Turkish and math skills and the confronted challenges. International Journal of Modern Education Studies, 5(1), 92-117.http://dx.doi.org/10.51383/ijonmes.2021.84
Carlisle, J., & Rice, M. (2004). Assessment of reading comprehension . A. Stone, E. Silliman, B. Ehren, & K. Apel içinde, Handbook of language and literacy (s. 521-555). New York.
Clotfelter, C., Ladd, H. F., & Vigdor, J. L. (2005). Who teaches whom? Race and the distribution of novice teachers. Economics of Education Review, 24(4), 377–392. https://doi.org/10.1016/j.econedurev.2004.06.008
Cosgrove, J., Kellaghan, T., Forde, P., & Morgan, M. (2000). The 1998 national assessment of English reading. Dublin, Ireland.
Crawford, L., Tindal, G., & Steiber, S. (2001). Using oral reading rate to predict student performance on statewide achievement tests. Educational Assessment, 7(4), 303-323. https://doi.org/10.1207/S15326977EA0704_04
Dewulfİ, L., Braak, J. V., & Houtte, M. (2020). Examining reading comprehension in disadvantaged segregated classes. The role of class composition, teacher trust, and teaching-learning strategies. Research Papers in Education, 1-22. https://doi.org/10.1080/02671522.2020.1864766
Dovidio, J. F., Kawakami, K., & Gaertner, S. L. (2002). Implicit and explicit prejudice and interracial interaction. Journal of Personality and Social Psychology, 82, 62-68. https://doi.org/10.1037/0022-3514.82.1.62
Eckes, T. (2015). Introduction to many-facet Rasch measurement: Analyzing and evaluating rater-mediated assessments. Frankfurt.
Eivers, E., Shiel, G., & Shortt, F. (2004). Reading literacy in disadvantaged primary schools. Dublin.
Engelhard, G. (2002). Monitoring raters in performance assessments. In G. Tindal and T. Haladyna (Eds.), Large-scale assessment programs for ALL students: Development, implementation, and analysis (pp. 261-287). Mahway, NJ.
Esfandiari, R. (2015). Rater errors among peer-assessors: applying the many-facet Rasch measurement model. Iranian Journal of Applied Linguistics, 18(2), 77-107. https://doi.org/10.18869/acadpub.ijal.18.2.77
Farrokhi, F., Esfandiari, R., & Vaez Dalili, M. (2011). Applying the many-facet Rasch model to detect centrality in self-assessment, peer-assessment and teacher assessment. World Applied Sciences Journal, 15(11), 70-77. http://www.idosi.org/wasj/wasj15(IPLL)11/12.pdf
Flanagan, K. M., & Addy, H. (2019, 10 02). Introverts are not disadvantaged in group-based active learning classrooms. https://files.eric.ed.gov/fulltext/EJ1223951.pdf
Göçer, A. (2018). Süreç ve sonuç değerlendirme yöntem ve araçlarıyla: Türkçe eğitiminde ölçme ve değerlendirme. Ankara.
Grabe, W., & Stoller, F. L. (2002). Teaching and Researching Reading. New York. https://doi.org/10.4324/9781315833743
Guadagnoli, E., & Velicer, W. F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103(2), 265-275. https://doi.org/10.1037/0033-2909.103.2.265
Habib, M. (2016). Assessment of reading comprehension. Revista Romaneasca pentru Educatie Multidimensionala, 8(1), 125-147. DOI: http://dx.doi.org/10.18662/rrem/2016.0801.08
Isenberg, E., Max, J., Gleason, P., Potamites, L., Santillano, R., Hock, H., & Hansen, M. (2013). Access to effective teaching for disadvantaged students. Washington.
Haladyna, T. M. (1997). Writing test items in order to evaluate higher-order thinking. USA.
İlhan, M. (2015). Standart ve SOLO taksonomisine dayalı rubrikler ile puanlanan açık uçlu matematik sorularında puanlayıcı etkilerinin çok yüzeyli Rasch modeli ile incelenmesi. (Unpublished doctoral dissertation). https://tez.yok.gov.tr
Juel, C. (1991). Beginning reading. R. Barr, M. Kamil, P. Mosenthal, & P. Pearson içinde, Handbook of Reading Research (s. 759-788). White Plains, New York.
Kassim, N. L. A (2007). Exploring rater judging behaviour using the many-facet Rasch model. Paper Presented in the Second Biennial International Conference on Teaching and Learning of English in Asia: Exploring New Frontiers (TELiA2), Universiti Utara, Malaysia. http://repo.uum.edu.my/3212/
Kellaghan, T., & Fontes, P. (1989). Relative bias in teacher judgements and standardized tests in the identification of literacy problems. Irish Journal of Education, 23(2), 40-50. https://www.erc.ie/documents/vol23chp3.pdf
Kellaghan, T., Weir, S., Ó hUallacháin, S., & Morgan, M. (1995). Educational disadvantage in Ireland. Dublin: Department of Education.
Kennedy, E. (2008). Improving literacy achievement in a disadvantaged primary school: Empowering classroom teachers through professional development (Unpublished doctoral dissertation). Dublin, Ireland.
Kenny, D., & Chekaluck, E. (1993). Early reading performance: A comparison of teacher-based assessments. Journal of Learning Disabilities, 26, 227-236. https://doi.org/10.1177/002221949302600403
Klingner, J. K., Vaughn, S., & Boardman, A. (2007). Teaching Reading Comprehension to Students with Learning Difficulties. New York, NY.
Kyriakides, L. R., Campbell, J., & Gagatsis, A. (2000). The significance of the classroom effect in primary schools: An application of creemers comprehensive model of educational effectiveness. School Effectiveness and School Improvement, 11(4), 501–529. https://doi.org/10.1076/sesi.11.4.501.3560
Linacre, J. M. (1993). Rasch-based generalizability theory. Rasch Measurement Transaction, 7(1), 283-284. https://www.rasch.org/rmt/rmt71h.htm.
Linacre, J. M. (2017). A user’s guide to FACETS: Rasch-model computer programs. Chicago.
Lyons, R., Fives, A., Kearns, N., Canavan, J., Devaney, C., & Eaton, P. (2013). Exploring the utility of the simple view of reading in Irish children attending schools in areas designated as socially disadvantaged. Journal of Education and Training Studies, 1(1), 204-220. http://dx.doi.org/10.11114/jets.v1i1.107
Mason, B. A., Gunersel, A. B., & Ney, E. A. (2014). Cultural and ethnic bias in teacher ratings of behavior: A criterion-focused review. Psychology in the Schools, 51(10), 1017-1030. https://doi.org/10.1002/pits.21800
McAndrews, S. L. (2008). Diagnostic literacy assessments and instructional strategies. Newark, DE.
McDonald, E. (1998). Reading Achievement and Educational Disadvantage. Irish Educational Studies, 17(1), 208-221. http://dx.doi.org/10.1080/0332331980170119
McDonald, R. P. (1999). Test theory: A unified approach. Mahwah, NJ.
MEB. (2019). İlkokullarda yetiştirme programı (İYEP). Ankara.
Milanowski, A. (2017). Lower performance evaluation practice ratings for teachers of disadvantaged students: Bias or reflection of reality? AERA Open, 3(1), 1-16. https://doi.org/10.1177/2332858416685550
Mongkuo, M. Y., & Mongkuo, M. Y. (2017). Testıng the factorıal equıvalence of the collegıate learnıng assessment performatıon task dıagnostıc ınstrument across lower class and upper class predomınantly black college students. International Journal of Education and Practice, 5(6), 95-103. https://doi.org/10.18488/journal.61.2017.56.95.103
Mortimore, J., & Blackstone, T. (1982). Disadvantage and education. London.
Natriello, G., Pallas, A. M., & Riehl, C. (1991). Creating more responsive student evaluation systems for disadvantaged student. https://files.eric.ed.gov/fulltext/ED333042.pdf
Nel, C. (2011). Classroom assessment of reading comprehension: How are preservice foundation phase teachers being prepared? Per Linguam, 27(2), 41-66. http://dx.doi.org/10.5785/27-2-107
OECD. (2012). PISA 2012 results: Excellence through equity. OECD Publishing. https://doi.org/10.1787/19963777
OECD. (2017). Could learning strategies reduce the performance gap between advantaged and disadvantaged students? oecd.org/pisa/pisaproducts/pisainfocus/pisa%20in%20focus%20n30%20(eng)--Final.pdf
Peterson, E. R., Davies, C. R., Osborne, D., & Sibley, C. (2016). Teachers' explicit expectations and implicit prejudiced attitudes to educational achievement: Relations with student achievement and the ethnic achievement gap. Learning and Instruction, 42, 123-140.http://dx.doi.org/10.1016/j.learninstruc.2016.01.010
Osburn, H. G. (2000). Coefficient alpha and related internal consistency reliability coefficients. Psychological methods, 5(3), 343. http://dx.doi.org/10.1037/1082-989X.5.3.343
Phillips, B., & Lonigan, C. (2005). Social correlates of emergent literacy. M. Snowling, & C. Hulme içinde, Handbooks of developmental psychology. The science of reading: A handbook (s. 173-187). Malden.
Pressly, M. (2001). Effective beginning reading instruction. Executive summary and paper commissioned by the National Reading Conference. Chicago.
Quinn, D. (2020). Experimental evidence on teachers’ racial bias in student evaluation: The role of grading scales. Educational Evaluation and Policy Analysis, 1-64. https://doi.org/10.3102/0162373720932188
Report of the National Reading Panel (NRP). (2000). Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction: Reports of the subgroups. Washington,DC.
Sass, T., Hannaway, J., Xu, Z., Figlio, D., & Feng, L. (2012). Value-added of teachers in high-poverty schools and lower-poverty schools. Journal of Urban Economics, 72, 104-122. https://doi.org/10.1016/j.jue.2012.04.004
Romagnano, L. (2001). The myth of objectivity in mathematics assessment. Mathematics Teacher, 94(1), 31-37. http://peterliljedahl.com/wp-content/uploads/Myth-of-Objectivity2.pdf
Schacter, J., & Jo, B. (2005). Learning when school is not in session: A reading summer day-camp intervention to improve the achievement of exiting first-grade students who are economically disadvantaged. Journal of Research in Reading, 28(2), 158-169. https://doi.org/10.1111/j.1467-9817.2005.00260.x
Si, G., Lipper, A., Shubeck, K., Fang, Y., Chen, S., Pavlik, P., . . . Graesser, A. (2018). Exploring an intelligent tutoring system as a conversation-based assessment tool for reading comprehension. Behaviormetrika, 1-19. https://doi.org/10.1007/s41237-018-0065-9
Solari, E. J., Grimm, R. P., McIntyre, N. S., & Denton, C. A. (2018). Reading comprehension development in at-risk vs. not at-risk first grade readers: The differential roles of listening comprehension, decoding, and fluency. Learning and Individual Differences, 65, 195–206. https://doi.org/10.1016/j.lindif.2018.06.005
Strambler, M. J., & Weinstein, R. S. (2010). Psychological disengagement in elementary school among ethnic minority students. Journal of Applied Developmental Psychology, 31, 155–165. http://dx.doi.org/10.1016/j.appdev.2009.11.006
Taneri, P. (2019). Kuramdan uygulamaya kapsayıcı eğitim. Ankara
Taşdelen, H., Turhan, M., Erikci, M., & Özkan, S. (2014). Okullardaki dezavantajlı ve risk altındaki çocuklar. Konya
van Ewijk, R., & Sleegers, P. (2010). Peer ethnicity and achievement: A meta-analysis into the compositional effect. School Effectiveness and School Improvement, 21(3), 237-265. https://doi.org/10.1080/09243451003612671
Van Keer, H. (2004). Fostering reading comprehension in fifth grade by explicit instruction in reading strategies and peer tutoring. British Journal of Educational Psychology, 74(1), 37-70. https://doi.org/10.1348/000709904322848815
Wesolowski, B. C., Wind, S. A., & Engelhard Jr, G. (2015). Rater fairness in music performance assessment: Evaluating model-data fit and differential rater functioning. Musicae Scientiae, 19(2), 147-170. https://doi.org/10.1177/1029864915589014
Whitehead, U. O. (2007). African-American students’ perceptions of teacher attitudes on academic achievement and discipline sanctions. ProQuest Information & Learning, 68. https://aquila.usm.edu/theses_dissertations/954/
Yue, H., Rico, R. S., Vang, M. K., & Giuffrida, T. A. (2018). Supplemental instruction: Helping disadvantaged students reduce performance gap. Journal of Developmental Education, 41(2), 18-25.https://files.eric.ed.gov/fulltext/EJ1200705.pdf.
DOI: https://doi.org/10.53400/mimbar-sd.v10i1.51312
Refbacks
- There are currently no refbacks.
Copyright (c) 2023 Mimbar Sekolah Dasar
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
View Mimbar Sekolah Dasar Stats