Library / Glossary / The context glossary
Comparative education and international benchmarks glossary
23 terms from C20, Comparative education and international benchmarks — each defined in the primer's own words. Every term the primer teaches links to the slide that teaches it.
C20 · Schools and systems
Comparative education and international benchmarks
“Copy the top-performing system.”
Every term below is defined in the words of comparative education and international benchmarks, primer C20 of understanding the context of education, and opens the primer at the slide where it is taught. The whole context glossary holds all of them together.
| Term | Definition | Referred to in | Read further |
|---|---|---|---|
| C | |||
| Coverage and exclusion | The share of the target age group a sample actually represents. PISA requires overall estimated exclusions "under 5 percent of the PISA target population" (National Center for Education Statistics, n.d.), but coverage of the wider age group varies: in 2022, 13 of 81 systems covered less than 75% of their 15-year-olds and two covered less than half. |
| |
| Cross-sectional survey | A study that samples a population, measures skill on a common scale and reports distributions. It supports strong statements about how much and for whom, and does not support causal statements about why. |
| |
| Cultural context | The arrangements around a classroom practice that are not part of the practice: what families expect, what examinations reward, what a teaching career offers, what employers do with results. Used loosely it becomes a name for whatever is left unexplained; used well it names things a borrower can check. |
| |
| E | |||
| Externalisation | Reaching outward to an external reference to settle an internal argument. Steiner-Khamsi (2016) found "it is precisely at a moment of heightened policy contestation that externalization occurs". |
| |
| F | |||
| Four stages of policy borrowing | A model of how a policy travels in four stages: cross-national attraction, decision, implementation, and internalisation or indigenisation. The decision may be theoretical, practical, a quick fix or phoney (Phillips & Ochs, 2003). |
| |
| G | |||
| Global Education Reform Movement (GERM) | Sahlberg’s (2012) name for five features of education reform spreading since the 1980s: standardisation, a focus on core subjects, low-risk pedagogy, corporate management models and test-based accountability. A polemical term as well as an analytical one. |
| |
| H | |||
| High-performing education systems | The small group of systems repeatedly near the top of the international tables, and the body of consultancy and policy literature that explains their success in terms of teacher quality, leadership, system design and reform (Deng & Gopinathan, 2016). |
| |
| I | |||
| ICILS | The IEA’s International Computer and Information Literacy Study. It assesses eighth-grade students’ "ability to use computers to investigate, create, and communicate", in cycles from 2013 (International Association for the Evaluation of Educational Achievement, n.d.). |
| |
| International large-scale assessment (ILSA) | A survey that measures the skills of a defined population across many systems on a common scale, using sampled students and sampled test items. PISA, TIMSS, PIRLS, ICILS and PIAAC are ILSAs; TALIS is a questionnaire study rather than a test. |
| |
| M | |||
| Matrix sampling | Splitting the item pool so that "each student saw only a small subset of the test material and was thus assessed on only a selection of the skills and competencies that comprise each domain" (National Center for Education Statistics, n.d.). It lets a study cover a wide domain without a long test. |
| |
| P | |||
| Paradox of the East Asian learner | The observation that students in Confucian-heritage classrooms appeared to Westerners to be "rote learning massive amounts of information in fierce exam-dominated classrooms" and yet "greatly outperformed western students learning in ‘progressive’ western classrooms" (Chan & Rao, 2010). The resolution lay in how memorisation and understanding were related, not in a hidden method. |
| |
| PIAAC | The OECD’s Survey of Adult Skills, which measures "adults’ literacy, numeracy, and adaptive problem solving skills". Thirty-one countries and economies took part in the 2023 survey (OECD, 2024). |
| |
| PIRLS | The IEA’s Progress in International Reading Literacy Study, run every five years in the fourth year of schooling. Its scale centrepoint of 500 "was set to correspond to the mean of overall achievement in 2001, with 100 points set to correspond to the standard deviation" (Mullis et al., 2023). |
| |
| PISA | The OECD’s Programme for International Student Assessment, which "measures 15-year-olds’ ability to use their reading, mathematics and science knowledge and skills to meet real-life challenges" (OECD, n.d.-a). It has run every three years since 2000, with a one-year delay in the 2022 cycle. |
| |
| PISA shock | A public crisis of confidence triggered by a disappointing international result. The 2014 open letter noted that lack of progress "has led to declarations of crisis and ‘Pisa shock’ in many countries, followed by calls for resignations, and far-reaching reforms" (Andrews et al., 2014). Germany after 2000 is the usual example (Ertl, 2006). |
| |
| Plausible values | Imputed scores drawn for each student, since no student answers enough items to be scored individually. PISA estimates "ten plausible values… for each student for each scale", representing "the distribution of potential scores for all students in the population with similar characteristics" (National Center for Education Statistics, n.d.). Valid for populations, invalid for individuals. |
| |
| Policy borrowing and lending | The movement of educational policy between systems, studied as a political process rather than a technical one. Steiner-Khamsi (2016) frames the research question as "why traveling reforms resonate in a given context and at a specific moment, and how they are subsequently translated or locally adapted". |
| |
| R | |||
| Range of ranks | The band of positions a system's mean could occupy in an ordered table, because every published mean is an estimate with a sampling error and the order moves more than the scores do. |
| |
| Rankings and their uncertainty | Every published mean is estimated from a sample and carries a standard error. Ordering the means discards that information. The IEA notes "considerable overlapping of confidence intervals" between countries (Mullis et al., 2023), and the OECD prints 95% intervals on its own country figures (OECD, 2023b). |
| |
| Reference society | A system repeatedly invoked in another country’s debate as an authority. Steiner-Khamsi (2016) describes references to a "league leader" used as "a quasi-external source of authority to certify certain, possibly controversial reforms in the domestic context". |
| |
| T | |||
| TALIS | The OECD’s Teaching and Learning International Survey of teachers and school leaders. TALIS 2024 was "the fourth cycle of the study since its inception in 2008", with 55 systems taking part (Ministry of Education, 2025; OECD, n.d.-b). |
| |
| TIMSS | The IEA’s Trends in International Mathematics and Science Study, at the fourth and eighth grades. It was "inaugurated in 1995" and has run every four years since; TIMSS 2023 covered 64 countries and six benchmarking systems (TIMSS & PIRLS International Study Center, 2024). |
| |
| Travelling policies | Reforms that move readily between systems because they are easy to name, easy to legislate and compatible with many contexts, as against reforms that stay home. Which ones travel is a separate question from which ones work (Steiner-Khamsi, 2014). |
| |
No term matches. Try fewer letters.
Nearby