Blavatnik School of Government, University of Oxford
What Do Effective Instructional Materials Look Like?
Earlier this year, in pre-lockdown days, my RISE colleague Michelle Kaffenberger and I visited educational NGOs Funda Wande in South Africa and Young 1ove in Botswana. These site visits taught us a lot about these NGOs’ strategies for influencing education at the system level.
The visits also helped us to reflect on the role of instructional materials in improving learning. By instructional materials, we mean the materials that support classroom lessons—whether textbooks, workbooks, worksheets, lesson plans, activity guides, posters, or hands-on manipulatives.
1. To ensure an adequate supply of high-quality instructional materials, low-resourced education systems may benefit from new approaches, such as open licensing.
In well-resourced education systems, teachers and students can usually take for granted a wide selection of high-quality instructional materials. This may not true in low-resourced systems. For example, in a recent study of remote school districts in Indonesia, only 39% of surveyed schools reported having enough textbooks.
To remedy local shortcomings in the supply of instructional materials, South African not-for-profit Funda Wande, directed by RISE fellow and University of Stellenbosch RESEP research fellow Nic Spaull, has borrowed a strategy from public health. Here is Spaull’s view, from a blog about their new mathematics programme, Bala Wande:
The aim is to develop fully bilingual learner activity booklets and video-based teacher guides for Grade 1-3 in all South Africa’s official languages. The big aim is to delink price and quality, and offer “best in the world”, in African languages, openly-licensed and widely available. If the pharmaceutical industry can create ‘generic drugs’ (same quality but MUCH cheaper), we can do the same with early learning resources!”
Open licensing may be gaining traction as a way of addressing supply shortfalls of instructional materials in low- and middle-income countries. At the recent the virtual conference of the Comparative and International Education Society, one panel saw presentations on open licensing in countries spanning Cambodia, Guatemala, and Rwanda, among others.
2. Instructional materials should suit their users’ circumstances—which can vary.
t’s not just the quantity of instructional materials that matters, but also their quality. In order to facilitate learning gains, instructional materials must suit the particular challenges and circumstances facing their users, both students and teachers. For example, Glewwe, Kremer, and Moulin (2009) found that providing textbooks to Kenyan students only raised the test scores of higher-achieving children, partly because the textbooks were too difficult for most children’s skill levels, and partly because they were in English, which was most children’s third language. Given these mismatches, the standalone quality of the textbook content was immaterial, because textbooks were incoherent with the linguistic context and with students’ current learning levels.
More broadly, instructional materials for early-grade literacy must fit the linguistic and orthographic structure of the language in question, which may differ from that of English and the other European languages that predominate in pedagogical research on reading. Also, instructional materials should be calibrated to match and build on students’ prior knowledge, whether for learning languages or for other subjects.
Crafting instructional materials that meet real classroom needs is challenging—but worthwhile. High-quality and well-calibrated instructional materials can substantially improve both learning outcomes and teacher motivation. This was evident in Tongan schools under the Pacific Early Age Readiness and Learning (PEARL) programme, which involved “instructional materials for teachers and students, including a teacher guide, student workbooks and readers, and assessment tools for teachers to track student progress during the school year, all in Tongan language” (PEARL Operational Guide, p. 9). An RCT of PEARL found that the percentage of students able to read with comprehension by the end of grade 2 increased from 18% to 29%. Similar effects have been seen elsewhere, as in Kenya’s nationwide Tusome early-grade reading programme.
In Botswana, Young 1ove’s implementation of Teaching at the Right Level (TaRL) numeracy caters not only to children’s preferences—using hands-on activities, dances, and games—but also to their learning needs. Young 1ove’s TaRL instructional materials are designed to support facilitators in tailoring each day’s lesson to the group’s learning level. At the end of each session, each child completes a checkpoint maths problem to test their mastery of the day’s content. If approximately 70% of children complete the problem correctly, the next day’s lesson will move on to the next topic. If fewer than 70% are correct, the topic is re-taught the next day. If all children answer the checkpoint correctly, this may indicate that the day’s material was too easy, and facilitators will adjust the rate of progress accordingly.
3. Judging the quality of instructional materials is a burdensome process that shouldn’t fall solely on individual teachers.
Evaluating the quality of instructional materials is a demanding process. Besides using developmentally and contextually appropriate pedagogy, instructional materials should be aligned to match curricular standards as well as the standards implicit in national exams (which is even less straightforward when curricula and exams are themselves misaligned).
This goes beyond individual subjects: an internally coherent grade 1 numeracy exercise that matches the progression of the mathematics curriculum may nevertheless trigger confusion if it assumes a level of literacy that the grade 1 language curriculum has yet to reach. Given all of these considerations—to say nothing of the numerous other demands on frontline providers’ time—it can be difficult for school heads and teachers to judge whether or not to invest time, thought, and money into a particular set of instructional materials.
Unfortunately, this burden of evaluating instructional materials often falls disproportionately on frontline providers, especially in under-resourced education systems that may lack quality-promotion mechanisms such as government-led textbook approval criteria or a critical mass of trusted and trustworthy educational publishers.
This is not to suggest that teachers shouldn’t have the freedom to modify existing materials, create their own materials, or judge which materials are best for their classrooms. But they shouldn’t have to do this in a vacuum. Novice chefs learn to cook by following tried-and-tested recipes; while experiences chefs can tweak old recipes or draw on their stock of knowledge to create new ones. Similarly, teachers should be given access to a range of high-quality pedagogical resources. They should not have to design new materials for every lesson from scratch.
When instructional materials don’t make the grade
All of these factors matter: adequate supply, contextual suitability, pedagogical quality, and coherence with other aspects of learning. When I was teaching English at a high-need secondary school in Malaysia, local bookshops offered shelf upon shelf of commercially published workbooks. To cut costs, many teachers would buy a single workbook and distribute photocopied pages to their students, rather than buying a full set of workbooks for the class.
I had a different problem: both the workbooks and the government-issued textbook were geared toward the secondary school exit exam—which, for English, expected students to write 350-word essays. But most of the students in my classrooms struggled to write a single grammatically correct sentence. The internet offered an abundance of English lesson materials, but quality was highly variable. Also, the materials that matched my students’ learning levels typically used reading texts that were far too juvenile to engage restless 16- and 17-year-olds. I spent hours writing simple passages based on movie plots and current events, and then developing comprehension questions that matched the format of the exit exam, even if they fell far short of its difficulty level. But on some days, I simply didn’t have the time and energy for that. Frankly, my students deserved better. And so do their peers everywhere.
RISE blog posts reflect the views of the authors and do not necessarily represent the views of the organisation or our funders.