uu.seUppsala University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
The test structure of TIMSS’ algebra varies between years and may influence the interpretability of Swedish students’ test scores over time
Uppsala University, Disciplinary Domain of Humanities and Social Sciences, Faculty of Educational Sciences, Department of Education.ORCID iD: 0000-0002-6618-2615
(English)Manuscript (preprint) (Other academic)
Abstract [en]

Results on large-scale assessments are often used as a rationale for development and reform of mathematics curricula. To examine this rationale, the case of Swedish students’ achievements on 197 algebra test items from four consecutive TIMSS tests are studied. The test items are characterized with social-semiotic and algebraic frameworks adapted from previous textbook studies to understand the test structure of each TIMSS assessment. The relationship between the test structure and student achievements is explored. A study of test structure changes over time suggest that the TIMSS’ algebra test scores are not comparable between assessments, and hence not a valid basis for estimation of knowledge trends.

Keywords [en]
algebra, international assessment, test validity, knowledge trend, TIMSS, secondary school
National Category
Didactics
Research subject
Curriculum Studies
Identifiers
URN: urn:nbn:se:uu:diva-395256OAI: oai:DiVA.org:uu-395256DiVA, id: diva2:1361495
Available from: 2019-10-16 Created: 2019-10-16 Last updated: 2019-10-16
In thesis
1. International large-scale assessments and mathematics textbooks in a curriculum reform process: Changes in lower secondary school algebra in Sweden 1995–2015
Open this publication in new window or tab >>International large-scale assessments and mathematics textbooks in a curriculum reform process: Changes in lower secondary school algebra in Sweden 1995–2015
2019 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Reforming a curriculum entails more than simply launching new steering documents: it includes the development of new materials, evaluation of reform and identification of needs for further action. Drawing from algebra material surrounding the 2011 Swedish curriculum reform, this thesis contributes to understanding the process of curriculum reform concerning mathematics textbooks and international large-scale assessments.

Two analytical frameworks are applied to algebra tasks in six mathematics textbooks from three series, published in 1995–2015, and algebra items from four consecutive TIMSS tests in 2003, 2007, 2011 and 2015. These frameworks are a Systemic Functional Linguistics-framework based on a social-semiotic perspective and a framework adapted from different views on school algebra. They are used in order to understand algebra characteristics in terms of school algebra discourses and algebraic activities. Additionally, the relationship between Swedish students’ results on TIMSS’ algebra-items and algebra characteristics of the test items is explored statistically. The findings are viewed against the test structure over time.

The results show that five school algebra discourses are identified in both materials: the symbolic, arithmetical, geometrical, (un)realistic and scientific discourse. However, in the TIMSS tests, a relational discourse was further identified. The materials comprise the same algebraic activities, although in somewhat different proportions. The major change in textbooks is conservative since it is an increase of the (un)realistic discourse, which concerns features that may have been prevalent in the Swedish syllabus already a hundred years ago. This discourse may also be interpreted as a transformation of a reform idea in the syllabus, on mathematical literacy, into quite superficial everyday connections.

A comparison of the materials show that the algebra characteristic which increases most in textbooks, decreases in TIMSS. Further, students with high achievements on TIMSS perform significantly better on test items with algebra characteristics that decrease in proportion, compared with those which increase in proportion. Relatively seen, the difficulty of the tests for these students thus increases over time. This implies that the validity of interpreting TIMSS results as a knowledge trend is lessened. It is therefore less relevant to use TIMSS results for evaluating and identifying needs for further action. It is suggested that conclusions about student achievements in algebra should not be drawn based on the validity of interpreting and using the aggregate of TIMSS results in mathematics. Also, policy makers should pay more attention to how TIMSS results are used as a base for curricular reform and evaluation.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2019. p. 151
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Educational Sciences ; 16
Keywords
curriculum reform, algebra, textbooks, international assessment, TIMSS, secondary school, test validity, student achievement.
National Category
Educational Sciences Didactics
Research subject
Curriculum Studies
Identifiers
urn:nbn:se:uu:diva-395267 (URN)978-91-513-0786-2 (ISBN)
Public defence
2019-12-06, sal Bertil Hammer 24:K104, Blåsenhus, von Kraemers allé 1, Uppsala, 13:15 (Swedish)
Opponent
Supervisors
Available from: 2019-11-11 Created: 2019-10-16 Last updated: 2019-11-11

Open Access in DiVA

No full text in DiVA

Authority records BETA

Palm Kaplan, Kristina

Search in DiVA

By author/editor
Palm Kaplan, KristinaLönnstedt, Ingrid
By organisation
Department of Education
Didactics

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 20 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf