Blog

An Important New Dataset Asks: “Are Children Really Learning?”

A new source of global learning data shines a timely light on the size and dynamics of the learning crisis.

Authors

Image of Michelle Kaffenberger

Michelle Kaffenberger

RISE Directorate

Blavatnik School of Government, University of Oxford

Image of Jason Silberstein

Jason Silberstein

RISE Directorate

Blavatnik School of Government, University of Oxford

Are children really learning?” A new source of foundational learning data gives a fresh perspective on this question. The answer (and the data) are explored in a new UNICEF report, which finds that, tragically, children are not learning nearly enough. We contributed to the report, using the new data to analyse learning trajectories and potential learning loss resulting from Covid-induced school closures. Here we highlight our five main takeaways from the report on the depth of the learning crisis and how to tackle it. 

1. Foundational learning requires our urgent attention

The report draws on the Multiple Indicator Cluster Surveys (MICS) from 32 low- and middle-income countries. MICS began assessing children’s reading and numeracy in the surveys’ most recent/6th round of data collection (dubbed MICS6). The surveys are household-based, which means the assessments include both in- and out-of-school children and youth.

The assessments are calibrated to measure progress on SDG 4.1, assessing reading and numeracy skills that the SDGs—and many national curricula—expect children to master by Grade 2. Figure 1 shows the percentage of Grade 3 students in each country who have actually mastered these skills:

Figure 1: Share of children attending Grade 3 with foundational reading and numeracy skills

Source: UNICEF

In the median country, only 30 percent of children have reached early grade reading targets, and only 18 percent have mastered basic math. This reaffirms data from elsewhere showing that children often do not gain even foundational skills in the early primary school grades. Low learning in early grades suggests a need for education systems, including politicians, policymakers, administrators, teachers, families, and donors alike, to prioritise foundational learning.

2. Learning per year needs to accelerate, beginning in the early grades

The report analyses learning trajectories which visualise learning as children progress from one grade to the next (Figure 2). The learning trajectories from the MICS6 data show slow progress. At the current rate of learning per year, it would take a child in the average county more than seven years to learn the skills they are expected to master by Grade 2.

Figure 2: Years needed for children to be in primary school to reach threshold of 70 percent having foundational reading and numeracy skills

Source: UNICEF

This echoes other policy simulations (by Kaffenberger and Pritchett and Pritchett and Sandefur) showing that more years of schooling alone will be insufficient to address the learning crisis—learning per year is just too shallow. Instead, children must learn more in each year they spend in school. This is especially critical in the early grades since this is when the data show children start to fall behind. As the report says: “Greater investment is needed, therefore, to steepen the learning trajectories so that children enter Grade 3 knowing how to read and handle basic numeracy, thereby enabling them to fully engage in increasingly complex curriculum as they advance through school.”

3. Learning losses from the pandemic could accumulate over time – unless we realign instruction

The need to think about learning as a cumulative process is driven home by the simulations of COVID-19 related learning loss. These simulations, applying a methodology from earlier RISE work, show how small initial losses caused by school closures—which thus far have ranged from a few weeks to two full school years—can continue to grow even after children return to school. The intuition is that as children fall further and further behind the level assumed by the curriculum, they have an increasingly difficult time benefitting from instruction.

Figure 3: Modelling long-term loss in foundational reading skills from Covid-19 school closures and mitigation strategies.

Graph showing Grade 9 foundational reading for current Grade 1 students under different mitigation scenarios, ranging from no shock at 55 percent to remediation at 78 percent

4. How much a child learns depends more on the education system than their gender or household wealth

The report also does a thorough analysis of differences in learning between groups within countries, such as comparisons between the rich and poor and girls and boys. For us, the most striking results are the relatively small gaps between demographic groups. When 70 percent of all children cannot read by Grade 3, it puts in perspective the fact that children from the richest quintile are 16 percentage points more likely to be able to read than their peers in the poorest quintile (p.21). In a similar vein, the results for gender show that “in most countries there is not a notable difference in learning outcomes by gender” (p.28).1

Figure 4: Gap between share of girls and boys with foundational numeracy skills, among children currently attending Grade 3 to 8

Bar scraph showing boys' or girls' advantage in a long list of countries, with more countries showing advantage for girls

Next to the modest differences in learning within countries, the differences in learning between countries are huge.  For example, Bangladesh and Ghana have similar GDP per capita, and Ghana has historically spent more on education. However, nearly five times as many children in Bangladesh learn to read and twice as many gain numeracy by Grade 3 than in Ghana (Figure 1). This does not mean that Ghana should simply do what Bangladesh does, but it does show that very different outcomes are often possible even at similar levels of development.

5. MICS6 is a rich new dataset for research on foundational skills

Make no MICS-take, the 6th MICS survey round is a much-needed boost to globally scarce data on learning.  MICS6:

  • Has covered 32 countries and regions since 2017 (with more surveys underway);
  • Is open source;
  • Is nationally representative of children ages 7-14;
  • Covers multiple grades, beginning with lower primary, and includes out-of-school children.

Like any dataset, it also has certain limitations in keeping with how it was designed. For example, its test for foundational skills is relatively stringent (to pass the reading test, students had to correctly read aloud 90 percent of the words in an approximately 70-word story, and then correctly answer all five comprehension questions). It was also designed to be a binary measure—pass/fail —rather than allowing for more fine-grained analysis of different student learning levels. However, we have already found the dataset to yield rich insights (which we set out in a working paper and Insight Note), and we hope it will receive increasing scholarly and policy attention in the years to come.                                      

Footnotes

  • 1While differences between groups are small for wealth and gender on average, there may be larger differences in individual countries that demand contextualised analysis. The differences may also be larger for extremely marginalised groups covered in other sections of the report, such as children with functional difficulties or children involved in child labour.

RISE blog posts and podcasts reflect the views of the authors and do not necessarily represent the views of the organisation or our funders.