The Implementation of Cooperative Problem-Solving Rubric Towards Turkish Fourth Grade Students

Gülçin Karakus, Gürbüz Ocak

Abstract


This study aimed to develop an analytical rubric for teachers to observe and evaluate students’ performance in showcasing the cooperative problem-solving process. Thus, a rubric was prepared. Angles to evaluate the student performance were included and a quad rank scale was used in the rubric. Dimensions used in the rubric were based on the PISA 2015 cooperative problem-solving dimensions. The weighted kappa coefficient was calculated for reliability. The validity of the rubric was provided by taking into the opinions of experts. The dimensions used were; common understanding, communication, respect, solving problems together, discussion, and finding common solutions. The weighted kappa coefficient of the rubric was 660 on common understanding; 644 on communication; 835 on respect; 829 on solving problems together; 825 on discussion, and 822 on finding common solutions. Additionally, the rubric was validated by controlling the content, structure, and validity criteria. The results showed that the cooperative problem-solving rubric was reliable and valid to evaluate cooperative problem-solving skills. The rubric presented a comprehensive assessment and scoring for cooperative problem-solving skills.

Keywords


cooperative learning; cooperative problem-solving; performance evaluation; problem-solving; rubric

Full Text:

PDF

References


Açıkgöz, K. Ü. (1992). İşbirlikçi öğrenme: Kuram, araştırma ve uygulama [Cooperative learning: Theory, research and practice]. Uğurel Matbaası.

Adeyemi, B. A. (2008). Effects of cooperative learning and problem-solving strategies on junior secondary school students’ achievement in social studies. Electronic Journal of Research in Educational Psychology, 6(16), 691–708. https://doi.org/10.25115/ejrep.v6i16.1294

Ames, C. (1992). Classrooms: Goals, structures, and student motivation. Journal of Educational Psychology, 84(3), 261–271. https://doi.org/10.1037/0022-0663.84.3.261

Anderman, E. M., & Young, A. J. (1994). Motivation and strategy use in science: Individual differences and classroom effects. Journal of Research in Science Teaching, 31(8), 811–831. https://doi.org/10.1002/tea.3660310805

Andrade, H. G. (2005). Teaching with rubrics: The good, the bad, and the ugly. College Teaching, 53(1), 27–31. https://doi.org/10.3200/CTCH.53.1.27-31

Arhin, A. K. (2015). The effect of performance assessment-driven instruction on the attitude and achievement of senior high school students in mathematics in Cape Coast Metropolis, Ghana. Journal of Education and Practice, 6(2), 109–116.

Arıcı, Ö. (2019). PISA 2015 sonuçlarına göre Türkiye’deki öğrencilerin işbirlikli problem çözme becerileriyle ilişkili faktörlerin aracılık modelleriyle incelenmesi [Examination of the factors related to the collaborative problem solving skills of students in Turkey by mediation model] (Order No. 535097) (Unpublished doctoral dissertation). Ankara Üniversitesi.

Aslanoğlu, A. E. (2017). Grup içinde bireyin değerlendirilmesi: Akran ve Öz Değerlendirme [Evaluation of the individual within the group: Peer and Self-Assessment]. Boğaziçi Üniversitesi Eğitim Dergisi, 34(2), 35–50.

Bergin, S. D., Murphy, C., & Shuilleabhain, A. N. (2018). Exploring problem-based cooperative learning in undergraduate physics labs: student perspectives. European Journal of Physics, 39(2), 025703. https://doi.org/10.1088/1361-6404/aa9585

Birel, A. S., & Albuz, A. (2014). Viyolonsel öğretiminde performansı değerlendirmeye yönelik hazırlanan dereceli puanlama anahtarının (Rubrik) Sınanması ve Değerlendirilmesi [Testing and Evaluation of the rubric prepared to evaluate the performance in cello teaching]. Atatürk Üniversitesi Sosyal Bilimler Enstitüsü Dergisi, 18(3), 281–207. https://dergipark.org.tr/tr/download/article-file/32493

Cankoy, O., & Özder, H. (2017). Generalizability theory research on developing a scoring rubric to assess primary school students’ problem posing skills. EURASIA Journal of Mathematics, Science and Technology Education, 13(6). https://doi.org/10.12973/eurasia.2017.01233a

Carbonaro, C. M., Zurru, A., Fanti, V., Tuveri, M., & Usai, G. (2020). Cooperative problem solving: an experience of high-school teaching updating. http://arxiv.org/abs/2003.07731

Care, E., Scoular, C., & Griffin, P. (2016). Assessment of collaborative problem solving in education environments. Applied Measurement in Education, 29(4), 250–264. https://doi.org/10.1080/08957347.2016.1209204

Chiu, M. M. (2000). Group problem-solving processes: Social interactions and individual actions. Journal for the Theory of Social Behaviour, 30(1), 26–49. https://doi.org/10.1111/1468-5914.00118

Dey, I. (1993). Qualitative data analysis: A user friendly guide for social scientists (Routledge).

Docktor, J., & Heller, K. (2009). Robust assessment instrument for student problem-solving. Proceedings of the NARST 2009 Annual Meeting, 1–19.

Docktor, J. L., Dornfeld, J., Frodermann, E., Heller, K., Hsu, L., Jackson, K. A., Mason, A., Ryan, Q. X., & Yang, J. (2016). Assessing student written problem solutions: A problem-solving rubric with application to introductory physics. Physical Review Physics Education Research, 12(1), 010130. https://doi.org/10.1103/PhysRevPhysEducRes.12.010130

Dunne, T. (2014). Conducting cooperative problem-solving activities in communities. https://www.sfcg.org/wp-content/uploads/2014/02/community.pdf

Egodawatte, G. (2010). A rubric to self-Assess and peer-assess mathematical problem solving tasks of college students. Acta Didactica Napocensia, 3(1), 75–88.

Ev Çimen, E. (2008). Matematik öğretiminde, bireye" matematiksel güç" kazandirmaya yönelik ortam tasarimi ve buna uygun öğretmen etkinlikleri geliştirilmesi [In mathematics teaching, environment design and development of appropriate teacher activities to give the individual "mathematical power"] (Unpublished doctoral dissertation). Dokuz Eylül Üniversitesi.

Fiore, S. M., Graesser, A., Greiff, S., Griffin, P., Gong, B., Kyllonen, P., Massey, C., O’Neil, H., Pellegrino, J., Rothman, R., Soulé, H., & von Davier, A. (2017). Collaborative problem-solving: Considerations for the national assessment of educational progress. National Center for Education Statistics. http://hdl.handle.net/10993/31897

Ghalib, T. K., & Al-Hattami, A. A. (2015). Holistic versus analytic evaluation of EFL writing: A case study. English Language Teaching, 8(7), 225–236. https://doi.org/10.5539/elt.v8n7p225

Gömleksiz, M. N., & Ayhan, K. O. Ç. (2012). Bilgisayar kullanımı öğretiminde akran değerlendirme [Peer assessment in teaching computer use]. Education Sciences, 7(1), 148–154.

González-Fernández, M. J., García-Alonso, J. M., & Montero, E. (2014). The use of a rubric-based method to assess teamwork skill development: A case study in science and engineering courses. Conference Proceedings: New Perspectives in Science Education, 409–413.

Graesser, A. C., Cai, Z., Morgan, B., & Wang, L. (2017). Assessment with computer agents that engage in conversational dialogues and trialogues with learners. Computers in Human Behavior, 76, 607–616. https://doi.org/10.1016/j.chb.2017.03.041

Green, D. A. (2002). Last one standing: Creative, cooperative problem-solving. Teaching Children Mathematics, 9(3), 134–140.

Griffin, P. (2017). Assessing and teaching 21st century skills: Collaborative problem solving as a case study. In A. Von Davier, M. Zhu, & P. Kyllonen (Eds.), Innovative Assessment of Collaboration (pp. 65–80). Springer. https://doi.org/10.1007/978-3-319-33261-1_8

Gür, S. (2019). Istanbul ıli trafik sıkışıklığı ve park probleminin fizik dersleri bağlamında ışbirlikli problem çözme sürecinde ıncelenmesi [Investıgatıon of the traffic conjection and parking problem in Istanbul in the context of physics lessons in the process of collaborative problem solving] (Doctoral dissertation). Marmara University.

Hamann, K., Warneken, F., & Tomasello, M. (2012). Children’s developing commitments to joint goals. Child Development, 83(1), 137–145. https://doi.org/10.1111/j.1467-8624.2011.01695.x

Harskamp, E., Ding, N., & Suhre, C. (2008). Group composition and its effect on female and male problem-solving in science education. Educational Research, 50(4), 307–318. https://doi.org/10.1080/00131880802499688

Harwell, M. (2014). Research design in qualitative/quantitative/mixed methods. In C. F. Conrad & R. C. Serlin (Eds.), The SAGE Handbook for Research in Education: Pursuing Ideas as the Keystone of Exemplary Inquiry (pp. 147–164). SAGE Publications, Inc. https://doi.org/10.4135/9781483351377.n11

Heller, P., Keith, R., & Anderson, S. (1992). Teaching problem solving through cooperative grouping. Part 1: Group versus individual problem solving. American Journal of Physics, 60(7), 627–636. https://doi.org/10.1119/1.17117

Henderson, C., Yerushalmi, E., Kuo, V. H., Heller, P., & Heller, K. (2004). Grading student problem solutions: The challenge of sending a consistent message. American Journal of Physics, 72(2), 164–169. https://doi.org/10.1119/1.1634963

Heppner, P. P., & Petersen, C. H. (1982). The development and implications of a personal problem-solving inventory. Journal of Counseling Psychology, 29(1), 66–75. https://doi.org/10.1037/0022-0167.29.1.66

Hickman, M., & Wigginton, E. O. (2008). Cooperative problem-solving activities for social studies, grades 6-12. Corwin Press.

Hoang, T. N. (2006). Social problem solving in cooperative and problematic contexts in students with and without attention deficit hyperactivity disorder. International Journal of Special Education, 21(2), 1–7.

Jackson, C. W., & Larkin, M. J. (2002). Rubric: Teaching students to use grading rubrics. Teaching Exceptional Children, 35(1), 40–45.

Jayasinghe, U., Dharmaratne, A., & Atukorale, A. (2015). Students’ performance evaluation in online education system Vs traditional education system. Proceedings of 2015 12th International Conference on Remote Engineering and Virtual Instrumentation (REV), 131–135. https://doi.org/10.1109/REV.2015.7087277

Jin, M. (2018). Preschool children’s cooperative problem solving during play in everyday classroom contexts: China and the US (Doctoral dissertation) [University of Tennessee]. https://trace.tennessee.edu/utk_graddiss/4940/

Johnson, D. W., Johnson, R. T., & Smith, K. A. (1998). Cooperative learning returns to college what evidence is there that it works? Change: The Magazine of Higher Learning, 30(4), 26–35. https://doi.org/10.1080/00091389809602629

Johnston, C. G., James, R. H., Lye, J. N., & McDonald, I. M. (2000). An evaluation of collaborative problem solving for learning economics. The Journal of Economic Education, 31(1), 13. https://doi.org/10.2307/1183337

Jolliffe, W. (2007). Cooperative learning in the classroom: putting it into practice. Paul Chapman Publishing Ltd.

Jönsson, A., & Panadero, E. (2017). The use and design of rubrics to support assessment for learning. In D. Carless, S. M. Bridges, C. K. Y. Chan, & R. Glofcheski (Eds.), Scaling up Assessment for Learning in Higher Education (pp. 99–111). Springer. https://doi.org/10.1007/978-981-10-3045-1

Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130–144. https://doi.org/10.1016/j.edurev.2007.05.002

Kagan, S., & Kagan, M. (2009). Kagan Cooperative Learning. Kagan.

Karataş, İ. (2008). Problem çözmeye dayalı öğrenme ortamının bilişsel ve duyuşsal öğrenmeye etkisi [The effect of problem-solving based learning environment on cognitive and affective learning] (Unpublished doctoral dissertation). Karadeniz Teknik Üniversitesi Eğitim Bilimleri Enstitüsü.

Kaya, S. (2013). Işbirlikli öğrenme ve akran değerlendirmenin akademik başarı, biliş üstü yeti ve yardım davranışlarına etkisi [The effect of cooperative learning and peer assessment on academic achievement, metacognition and helping behaviours] (Unpublished doctoral dissertation). Cumhuriyet Üniversitesi.

Klang, N., Karlsson, N., Kilborn, W., Eriksson, P., & Karlberg, M. (2021). Mathematical problem-solving through cooperative learning—The importance of peer acceptance and friendships. Frontiers in Education, 6. https://doi.org/10.3389/feduc.2021.710296

Kourmousi, N., Xythali, V., Theologitou, M., & Koutras, V. (2016). Validity and reliability of the problem-solving inventory (PSI) in a nationwide sample of Greek educators. Social Sciences, 5(2), 25. https://doi.org/10.3390/socsci5020025

Law, N., & Wong, E. (2003). Developmental trajectory in knowledge building: An investigation. In B. Wasson, S. Ludvigsen, & U. Hoppe (Eds.), Designing for change in networked learning environments (pp. 57–66). Springer. https://doi.org/10.1007/978-94-017-0195-2

Luckin, R., Baines, E., Cukurova, M., Holmes, W., Mann, M., Berg, E., Cocker, N., Goumagias, N., Jameson, S., Jewkes, K., Jones, P., Lawler, M., Pepper, S., Price, A., Reddington, C., Santos, H., & Story, A. (2017). Solved! Making the case for collaborative problem-solving About Nesta. https://www.nesta.org.uk/report/solved-making-the-case-for-collaborative-problem-solving/

MacArthur, C. A., Graham, S., & Fitzgerald, J. (2008). Handbook of Writing Research (C. A. MacArthur, S. Graham, & J. Fitzgerald (eds.)). Guilford Press.

Madaus, G. F., & O’Dwyer, L. M. (1999). A short history of performance assessment: Lessons learned. Phi Delta Kappan, 80(9), 688–695.

Malloy, C. E., & Jones, M. G. (1998). An investigation of African American students’ mathematical problem-solving. Journal for Research in Mathematics Education, 143–163.

MoNE. (2007). Ortaöğretim 9. Sınıf Biyoloji Dersi Öğretim Programı [Secondary Education 9th Grade Biology Curriculum].

Mulrey, B. C. (2016). Increasing social problem-solving skills in early childhood.

OECD. (2017). Education at a Glance 2017 (Education at a Glance). OECD Publishing. https://doi.org/10.1787/eag-2017-en

Önder, F. (2012). Işbirlikli gruplarda öğrenme stillerinin fizik dersi başarısı ile hatırda tutma düzeyine etkisinin incelenmesi [Investigation of the effect of learning styles on success in physics course and retention level in cooperative groups] (Unpublished doctoral dissertation). Dokuz Eylül Üniversitesi .

Razali, S. N., Shahbodin, F., Bakar, N., & Hussin, H. (2018). Measuring validity and reliability of collaborative learning rubric using rasch model. The Social Sciences, 13(4), 787–791. https://doi.org/10.3923/sscience.2018.787.791

Sefer, G. D. (2006). Matematik dersinde problem çözme becerilerinin dereceli puanlama anahtarı kullanılarak değerlendirilmesi [Evaluation of problem-solving skills in mathematics lesson using rubric] (Unpublished doctoral dissertation). Hacettepe Üniversitesi.

Şencan, H. (2005). Güvenilirlik ve geçerlilik [Reliability and validity]. Seçkin Yayıncılık.

Smith, K. A. (1998). Grading cooperative projects. New Directions for Teaching and Learning, 1998(74), 59–67. https://doi.org/10.1002/tl.7406

Steiner, S., Stromwall, L. K., Brzuzy, S., & Gerdes, K. (1999). Using cooperative learning strategies in social work education. Journal of Social Work Education, 35(2), 253–264. https://doi.org/10.1080/10437797.1999.10778964

Tadeu, P., Kaya, M., Arslan, S., & Demir, S. (2013). Problem-solving scale (PSSPT): A study of validity and reliability of the Portuguese version. Procedia - Social and Behavioral Sciences, 106, 2119–2124. https://doi.org/10.1016/j.sbspro.2013.12.241

Turner, J. C., Thorpe, P. K., & Meyer, D. K. (1998). Students’ reports of motivation and negative affect: A theoretical and empirical analysis. Journal of Educational Psychology, 90(4), 758–771. https://doi.org/10.1037/0022-0663.90.4.758

Uysal, G. (2010). Ilköğretim sosyal bilgiler dersinde işbirlikli öğrenmenin erişiye, problem çözme becerilerine, öğrenme stillerine etkisi ve öğrenci görüşleri [The effect of cooperative learning on achievement, problem-solving skills, learning styles in primary school social studies class and student views] (Unpublished doctoral dissertation). Dokuz Eylül Üniversitesi.

Wolf, K., & Stevens, E. (2007). The role of rubrics in advancing and assessing student learning. Journal of Effective Teaching, 7(1), 3–14. https://uncw.edu/jet/articles/vol7_1/wolf.htm

Wren, D. G. (2009). Performance Assessment : a Key Component of a Balanced Assessment System. Research Brief, 2, 1–12.

Yücel, Ü. A. (2013). Çevrimiçi işbirlikli öğrenme ortamlarında gerçekleşen bilgi yapılandırma süreçlerinde etkileşim ve katılım [Interaction and participation in knowledge construction processes that take place in online collaborative learning environments] (Unpublished doctoral dissertation). Hacettepe Üniversitesi.

Yücel, Ü. A., & Usluel, Y. K. (2013). The Quality of Interaction and Participation in Knowledge Building Processes within the Online Collaborative Learning Environments. International Academic Conference on Education, Teaching and E-Learning.

Yurdabakan, İ., & Olğun, M. (2011). Öz ve akran değerlendirmenin öğrenme ve bilişüstü bilgi üzerindeki etkisi: Sonuçsal geçerlik [The effect of self and peer assessment on learning and metacognitive knowledge: Consequential validity]. 2nd International Conference on New Trends in Education and Their Implications.




DOI: https://doi.org/10.53400/mimbar-sd.v9i1.39390

Refbacks

  • There are currently no refbacks.


Bookmark and Share


Copyright (c) 2022 Mimbar Sekolah Dasar

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

View Mimbar Sekolah Dasar Stats