Examination of Problems in Middle School Mathematics Textbooks in Relation to the PISA Mathematical Literacy Framework

Year 2025, Volume: 12 Issue: 1, 195 - 212

Sedef Çelik Demirci , Ümit Kul , Samet Korkmaz

Abstract

This research examines the extent to which mathematics problems in middle school textbooks for grades 5 through 8 align with the PISA mathematical literacy framework. The analysis emphasizes key dimensions, including content, context, cognitive processes, proficiency levels, and problem types. Utilizing document and descriptive analyses, the research evaluates textbooks published by Türkiye’s Ministry of National Education for the 2023–2024 academic year. Results reveal significant imbalances in the distribution of content areas, with “change and relationships” dominating, while “quantity” is underrepresented. Contextual analysis shows a predominance of “personal” contexts, with limited occupational, social, and scientific scenarios, which restrict students’ engagement with real-world applications. Regarding mathematical processes, the emphasis is on procedural tasks, while higher-order cognitive skills are insufficiently represented. Furthermore, the majority of problems correspond to PISA proficiency levels 2 and 3, with minimal representation of levels 5 and 6, highlighting a scarcity of tasks designed to foster advanced mathematical competencies. These findings underscore the necessity for a more equitable integration of content areas, a broader spectrum of real-life contexts, and tasks targeting higher proficiency levels. Recommendations propose a redesign of textbooks to incorporate a wider range of cognitive demands and contextual scenarios, with the aim of enhancing students’ mathematical literacy and preparedness for international assessments such as PISA.

Keywords

PISA, matematical literacy, textbook, question type.

Ethical Statement

Fakülteniz Matematik ve Fen Bilimleri Eğitimi Bölümü öğretim üyelerinden Doç.Dr. Ümit KUL ile araştırma ekibinde yer alan Dr. Öğr. Üyesi Samet KORKMAZ ve Dr. Öğr. Üyesi Sedef ÇELİK DEMİRCİ'nin "Ortaokul Matematik Ders Kitaplarındaki Soruların PISA Matematik Okuryazarlık Çerçevesi Bağlamında İncelenmesi" başlıklı çalışmaları Üniversitemiz Bilimsel Araştırma ve Yayın Etiği Kurulunun 12 Şubat 2024 tarihinde yapmış olduğu toplantısında incelenmiş olup, çalışmada bilimsel araştırma ve yayın etiğine uygunluk onayına gerek olmadığına oybirliği ile karar verilmiştir.

References

• Alajmi, A. H. (2012). How do elementary textbooks address fractions? A review of mathematics textbooks in the USA, Japan, and Kuwait. Educational Studies in Mathematics, 79(2), 239–261. doi:10.1007/s10649-011-9342-1
• Altun, M. (2020). Matematik okuryazarlığı el kitabı: Yeni nesil soru yazma ve öğretim düzenleme teknikleri [Mathematical literacy handbook: New generation question writing and teaching organization techniques]. Bursa: Alfa Aktüel.
• Altun, M., Ülger, T. K., Bozkurt, I., Akkaya, R., Arslan, Ç., Demir, F., Karaduman, B., & Özaydın, Z. (2022). Integration of mathematical literacy with school mathematics. Journal of Uludag University Faculty of Education, 35(1), 126-149. doi:10.19171/uefad.1035381
• Bingölbali, E., & Özdiner, M. (2022). İlkokul ve ortaokul matematik ders kitabı etkinliklerinin gerçek hayatla ilişkilendirme açısından incelenmesi [Examination of primary and secondary school mathematics textbook activities in terms of real-life connections]. Afyon Kocatepe Üniversitesi Sosyal Bilimler Dergisi, 24(1), 45–65.
• Böge, H., & Akıllı, R. (2021). 8. Sınıf matematik ders kitabı [Middle school 8th grade mathematics textbook]. Ankara: Talim ve Terbiye Kurulu Başkanlığı.
• Brousseau, G. (1986). Fondements et méthodes de la didactique des mathématiques. Recherches en Didactique des Mathématiques, 7(2), 33–115.
• Bozkurt, A., & Yılmaz, Ş. (2020). An examination of the activities in 8th-grade mathematics textbooks based on the levels of cognitive demand. Elementary Education Online, 19, 133–146. doi:10.17051/ilkonline.2020.647122 Çağlayan, N., Dağıstan, A., & Korkmaz, B. (2021). 6. Sınıf matematik ders kitabı [Middle school 6th grade mathematics textbook]. Ankara: Talim ve Terbiye Kurulu Başkanlığı
• Çelik Demirci, S., & Kul, Ü. (2021). Türkiye ve Kanada Matematik ders kitaplarında yer alan problem kurma etkinliklerinin incelenmesi: Bir karşılaştırma araştırması [Examination of problem-posing activities in Turkish and Canadian mathematics textbooks: A comparative study]. Studies in Educational Research and Development, 5(2), 148–179.
• Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37-46. doi:10.1177/001316446002000
• Erbaş, A., Alacacı, C., & Bulut, M. (2012). A comparison of Turkish, Singaporean, and American mathematics textbooks. Kuram ve Uygulamada Eğitim Bilimleri, 12(3), 2324–2330.
• Erkoç Özçetin, E. (2022). Sekizinci sınıf matematik ders kitabı ve eba’daki matematiksel görevlerin bilişsel istem düzeylerine göre incelenmesi [Examination of the cognitive demand levels of mathematical tasks in the 8th-grade mathematics textbook and EBA] [Master’s thesis, Eskişehir Osmangazi Üniversitesi].
• Fan, L., Cheng, J., Xie, S., Luo, J., Wang, Y., & Sun, Y. (2021). Are textbooks facilitators or barriers for teachers’ teaching and instructional change? An investigation of secondary mathematics teachers in Shanghai, China. ZDM Mathematics Education, 53, 1313-1330. doi:10.1007/s11858-021-01306-6
• Fan, L., Zhu, Y., & Miao, Z. (2013). Textbook research in mathematics education: development status and directions. ZDM, 45(5), 633-646.
• Gravemeijer, K. P. E. (2014). Transforming mathematics education: The role of textbooks and teachers. In Y. Li, E. Silver, & S. Li (Eds.), Transforming mathematics instruction (pp. 333–348). Springer. doi:10.1007/978-3-319-04993-9_10
• Gravemeijer, K. P. E., & Doorman, L. M. (1999). Context problems in realistic mathematics education: A calculus course as an example. Educational Studies in Mathematics, 39(1–3), 111–129.
• Haggarty, L., & Pepin, S. (2002). An investigation of mathematics textbooks and their use in English, French and German classrooms: who gets an opportunity to learn what? British Educational Research Journal, 28(4), 567-590
• Herbel-Eisenmann, B. A. (2007). From intended curriculum to written curriculum: Examining the “voice” of a mathematics textbook. Journal for Research in Mathematics Education, 38(4), 344–369. doi:10.2307/30034878
• Höfer, T., & Beckmann, A. (2009). Supporting mathematical literacy: examples from a cross-curricular project. ZDM, 41(1-2), 223-230. doi:10.1007/s11858-008-0117-9
• Hopkins, D., Pennock, D., Ritzen, J., Ahtaridou, E., & Zimmer, K. (2008). External evaluation of the policy impact of PISA (OECD doc. EDU/PISA/GB(2008)35/REV1). OECD.
• Huang, R., Tlili, A., Zhang, X., Sun, T., Wang, J., Sharma, R. C., Afouneh, S., Salha, S., Altinay, F., Altinay, Z., & Olivier, J. (2022). A comprehensive framework for comparing textbooks: Insights from the literature and experts. Sustainability, 14(11), 6940. doi:10.3390/su14116940
• Incikabi, S., Sadak, M., & Incikabi, L. (2023). Identifying mathematical literacy demands in Turkish, Singaporean and Australian textbooks. Acta Educationis Generalis, 13(2), 147–169. doi:10.2478/atd-2023-0008
• İskenderoğlu, T., & Baki, A. (2011). Classification of questions in 8th-grade mathematics textbooks according to PISA mathematical proficiency levels. Education and Science, 36(161), 287-301.
• Işık, C. (2008). İlköğretim ikinci kademesinde matematik öğretmenlerinin matematik ders kitabı kullanımını etkileyen etmenler ve beklentileri [Factors affecting the use of mathematics textbooks by middle school mathematics teachers and their expectations]. Kastamonu Eğitim Dergisi, 16(1), 163–176.
• Kabael, T. (2019). Matematik okuryazarlığı ve PISA [Mathematical literacy and PISA]. In T. Kabael (Ed.), Matematik okuryazarlığı ve PISA (pp. 11–43). Ankara: Anı Yayıncılık.
• Korkmaz, B., Yiğit Meşe, D., & Arslan, H. T. (2023). 5. Sınıf matematik ders kitabı [Middle school 5th grade mathematics textbook]. Ankara: Talim ve Terbiye Kurulu Başkanlığı.
• Korkmaz, S., Çelik Demirci, S., & Kul, Ü. (2024). Evaluation of problems in middle school mathematics textbooks in terms of problem solving strategies. Kastamonu Faculty Journal, 32(4), 554–567. doi:10.24106/kefdergi.1574325
• Krippendorff, K. (2019). Content Analysis: An Introduction to Its Methodology (4th Ed.). SAGE Publications. doi:10.4135/9781071878781
• Kul, Ü., Sevimli, E., & Aksu, Z. (2018). A Comparison of mathematics problems in Turkish and Canadian school textbooks in terms of synthesized taxonomy. Turkish Journal of Education, 7(3), 136-155.
• Külköylüoğlu, A., Güneş, M., Selçuk, M., & Tuğrul, Y. (2023). 7. Sınıf matematik ders kitabı [Middle school 7th grade mathematics textbook]. Ankara: Talim ve Terbiye Kurulu Başkanlığı.
• Miles, B., M., & Huberman, A., M. (1994). Qualitative data analysis (21 Ed.). London: Sage Publication Ministry of National Education [MoNE]. (2019). PISA 2018 Türkiye ön raporu [PISA 2018 Turkey preliminary report]. Eğitim Analiz ve Değerlendirme Raporları Serisi, Milli Eğitim Bakanlığı. Retrieved from https://www.meb.gov.tr/meb_iys_dosyalar/2019_12/03105347_pisa_2018_turkiye_on_raporu.pdf
• Ministry of National Education [MoNE] (2023). PISA 2022 Türkiye Raporu [PISA 2022 Türkiye Report]. Ankara: MEB Yayınları. Retrieed from https://odsgm.meb.gov.tr/meb_iys_dosyalar/2024_01/26152404_pisa2022_rapor.pdf
• NCTM. (2000). Principles and standards for school mathematics. Reston, VA: NCTM.
• O’Keeffe, L., & O’Donoghue, J. (2015). A role for language analysis in mathematics textbook analysis. International Journal of Science and Mathematics Education, 13(3), 605-630. doi:10.1007/s10763-013-9463-3
• OECD. (2013). PISA 2012 assessment and analytical framework. OECD Publishing. doi:10.1787/9789264190511-en
• OECD. (2018). PISA 2018 assessment and analytical framework: Reading, mathematics and science. OECD Publishing. Retrieved from https://www.oecd.org/education/pisa-2018-assessment-and-analytical-framework-b25efab8-en.htm
• OECD. (2019). PISA 2018 assessment and analytical framework. OECD Publishing. doi:10.1787/b25efab8-en
• OECD. (2023a). PISA 2022 assessment and analytical framework. Paris: OECD Publishing. Retrieved from https://www.oecd-ilibrary.org/education/pisa-2022-assessment-and-analyticalframework_dfe0bf9c-en
• OECD. (2023b). PISA 2022 mathematics framework. In PISA 2022 assessment and analytical framework. Paris: OECD Publishing. doi:10.1787/7ea9ee19-en
• Patton, M. Q. (2014). Nitel araştırma ve değerlendirme yöntemleri [Qualitative research and evaluation methods] (M. Bütün & S. B. Demir, Trans.). Pegem Akademi.
• Pepin, B., & Haggarty, L. (2001). Mathematics textbooks and their use in English, French and German classrooms: a way to understand teaching and learning cultures. ZDM: The International Journal on Mathematics Education, 33(5), 158-175. doi:10.1007/BF02656616
• Sevimli, E., Çelik, S., & Kul, Ü. (2022). Comparison of the frequency of mathematics teachers’ use of mathematics textbooks in face-to-face and distance education. Turkish Journal of Education, 11(1), 16–35. doi:10.19128/turje.896355
• Son J.W. (2012). A cross-national comparison of reform curricula in Korea and the US in terms of cognitive complexity: The case of fraction addition and subtraction. ZDM: The International Journal on Mathematics Education, 44(2), 161-174.
• Stein, M., Remillard, J., & Smith, M. (2007). How curriculum influences students’ learning. In F. Lester (Ed.), Second handbook of research on mathematics teaching and learning (pp. 557–628). Charlotte: Information Age.
• Tarim, K., & Tarku, H. (2022). Investigation of the problems in 8th grade mathematics textbook in terms of mathematical literacy. International Electronic Journal of Mathematics Education, 17(2), em0682. doi:10.29333/iejme/11819
• Törnroos, J. (2005). Mathematics textbooks, opportunity to learn and student achievement. Studies in Educational Evaluation, 31(4), 315-327.
• Valverde, G. A., Bianchi, L. J., Wolfe, R. G., Schmidt, W. H., & Houang, R. T. (2002). According to the book: Using TIMSS to investigate the translation of policy into practice through the world of textbooks. Dordrecht, Netherlands: Kluwer Academic Publisher.
• Wu, X., Wu, R., Chang, H.-H., Kong, Q., & Zhang, Y. (2020). International comparative study on PISA mathematics achievement test based on cognitive diagnostic models. Frontiers in Psychology, 11, Article 2230. doi:10.3389/fpsyg.2020.02230
• Yıldırım, A., & Şimşek, H. (2008). Sosyal bilimlerde nitel araştırma yöntemleri [Qualitative research methods in the social sciences]. Ankara: Seçkin Yayınları.
• Yıldırım, İ. (2019). An investigation of 5–8th grade mathematics textbooks according to PISA change and relationships scale [Master’s thesis, Bartın University].
• Yılmaz, N., Ay, Z., & Aydın, Ş. (2021). An investigation of tasks in the mathematics textbooks and objectives in mathematics curriculum from 4th to 8th grade related with data content domain according to TIMSS 2019 cognitive domains. Çukurova Üniversitesi Eğitim Fakültesi Dergisi, 50(2), 1397-1436. doi:10.14812/cuefd.745164
• Zhu, Y., & Fan, L. (2006). Focus on the representation of problem types in intended curriculum: A comparison of selected mathematics textbooks from Mainland China and the United States. International Journal of Science and Mathematics Education, 4(4), 609-626.