Response to the Economist on OLPC in Peru

From OLPC Association CEO Rodrigo Arboleda

The recent Economist article on the Inter-American Development Bank’s recent report on the OLPC project in Peru simply takes the IDB report at face value and rushes to judgment that the project “does not accomplish anything in particular.” Other media have also focused on the negative and pronounced OLPC a failure. But has anyone really read the entire IDB report and discussed its positive findings? Has anyone really examined the government of Peru’s priorities in implementing the project?

OLPC has provided XO laptops to nearly 2.5 million children in more than 40 countries around the world. Across these countries, we have seen significant improvements in children’s enthusiasm for learning and a greater sense of optimism about their future, increased parental involvement in children’s education, and higher levels of teacher motivation and engagement. These outcomes are documented in the OLPC project in Uruguay and other countries.

That said, change management on a large scale is challenging. Most of these countries lack ubiquitous electricity and Internet connectivity. School facilities are substandard. Many of the teachers face educational challenges themselves. In Peru the objectives and the operating conditions are particularly challenging and the following factors need to be noted:

• The government of Peru deliberately established social inclusion as a top priority. It focused the OLPC project on serving the poorest and most remote schools that are the most difficult to serve and are usually left for the last stages of most projects.
• In many of these schools a single teacher has to teach first to sixth graders in the same classroom.
• Although the evaluation focused on schools with electricity, most of the schools lack electricity and Internet connectivity or if they have it, it is quite erratic.
• A January 2007 census evaluation of 180,000 Peruvian teachers showed that 62% did not reach reading comprehension levels compatible with elementary school (PISA level 3); 92% of the teachers evaluated did not reach acceptable performance in math.
• Given these challenges, miracles are not going to happen overnight and progress will occur gradually over a number of years.

The IDB report notes significant change in the development of cognitive skills (a 5-6 months advancement over the 15 months of the study). This goes to the core of OLPC’s mission to develop critical thinking, creativity, collaboration and communication. These skills provide the foundation for academic achievement in other subjects. This positive result, measured in four different ways, is of significance and your article totally overlooked it.

In addition, the IDB report notes that children really know how to use the laptops and are using them to explore and create things, i.e., learning by doing. Digital fluency is a de facto requirement in the 21st century and a child in the mountains of Peru should have the same access to digital learning tools as a child in San Jose, Berlin or Tokyo.
The Peruvian government understands that overhauling its educational system will take time. It continues to invest in interventions to improve teacher and infrastructure quality because it believes that educational progress is the key to a better future for all its citizens.

The government of Peru should be lauded for its efforts to reach out to the most marginalized segment of its population. The OLPC project in Peru has touched the lives of almost one million children who would not otherwise have had an opportunity to expand their horizons. Perhaps we should watch the continuing efforts of the government of Peru to expand and improve the project outcomes, recognize the particular challenges they face and refrain from premature judgments of one of the largest education projects in the world.

Is traditional testing failing?

The Economist recently published a brief and pessimistic summary of the IDB Peru study. Their writer looked only at standardized math and reading tests as measures of success, ignoring large improvements in cognitive skills. Or maybe, as Richard Jennings suggests, they didn’t read to the sixth sentence of the study:

picked up on a 40-day-old report from the Inter-American Development Bank (IDB), and interpreted it as saying the program was failing in Peru. The anonymous Economist writer summarizes IDB’s findings thus:

GIVING a child a computer [does not] accomplish anything in particular… Peruvians’ test scores remain dismal. Only 13% of seven-year-olds were at the required level in maths and only 30% in reading… the children receiving the computers did not show improvement in maths… reading… motivation, or time devoted to homework or reading.

That’s depressing… I suppose there might be some intangible benefit, but it rather looks like there’s no quantitative gain.

But hang on a minute. It appears that The Economist has missed a key point from the report. IDB’s working paper, entitled Technology and Child Development: Evidence from the One Laptop per Child Program, also says:

The results indicate that the program… translated into substantial increases in use both at school and at home… Some positive effects are found… in general cognitive skills as measured by Raven’s Progressive Matrices, a verbal fluency test and a Coding test.

So, instead of a “disappointing return,” or “not accomplish[ing] anything in particular,” IDB did actually find a measurable benefit.

Could it be that the disparity between test scores and actual measured achievement means that it’s the tests that are lacking, rather than the laptops? It certainly wouldn’t be the first time that academic testing was shown to be seriously wanting.

And is it too much to ask for The Economist’s journalists and fact-checkers to actually get as far as the sixth sentence in the report’s abstract, before writing the story? I know that many of today’s workers exhibit short attention-spans, but really!

Too right. Unlike traditional standardized tests, cognitive studies tests are more likely to demonstrate the sort of growth envisioned by constructionist approaches to learning: exploration, empowered learning, and creativity.

There were three separate cognitive skills tests measured by the IDB. All four showed large improvements – equivalent to 5-6 months of cognitive development. As the report notes, “these are sizable effects under this metric considering that the treatment group had an average exposure of 15 months” — that’s like getting an extra 3 years of cognitive development by the start of highschool; something worth further study.

Pixel Qi ships its 3 millionth display

Pixel Qi has shipped over 3 million displays in over fifteen laptop and tablet models; and XOs are becoming a minority of the worldwide usage of the robust low-power designs.

Their new displays continue to drop their power requirements; we would be able to save over half of the power our current displays draw by upgrading to the newest Qi design.  I have always loved this best of all of the tech innovations in the XO, and am delighted to see it take off as its own force for constructive change.

 

 

IADB studies OLPC in Peru

The Inter American Development Bank recently published the results of a study of the Peruvian schools that received OLPCs in rural primary schools in Peru, over the first 15 months of the program.

The methodology of the study was quite good, with a randomized study of over 300 schools.  But the measurements and focus were not aligned with the goals of Peru’s program, and there is no clear way to compare these results with the other detailed results available from Plan Ceibal’s program in Uruguay.  The after-analysis of their work has tended to focus on short-term math and reading results, whereas the goals of the program were access to knowledge, improvements in pedagogy, and access to computing – which might be expected to show up in the short term only in the abstract cognitive results.

The measured improvement in abstract thinking – roughly 5 additional months of cognitive development, over a 15-month period – is tremendous. It is interesting to note how this result is downplayed in parts of the world where schools live by less abstract standardized testing.

Some recent comments from OLPC staff and implementers, paraphrased for brevity:

Claudia Urrea:

‘The OLPC program in Peru, or any other place, has to be evaluated according to its initial goal. “math, language, and cognitive test results” showed outputs, but have no clear connection to Peru’s 2007 stated objectives, which targeted pedagogical training and application.’

Oscar Becerra, who oversaw OLPC in Peru’s government:

‘We succeeded in giving access to technology to 100% (220,000) of children and teachers at one-teacher schools, who otherwise would have had no opportunity to use ICT.  Most had the option to take laptops home with them.’

Oscar has published other comments that are a good representation of the OLPC perspective.

 

Free Universal Construction – LEGOs and more

The Free Art and Technology Lab today announced a Free Univeral Construction Kit consisting of blueprints for 3D printing of 80 blocks and connectors that allow you to connect a varity of existing building kits.

Currently the kit interfaces with Lego, Duplo, Fischertechnik, Gears! Gears! Gears!, K’Nex, Krinkles / Bristle Blocks, Lincoln Logs, Tinkertoys, Zome, and Zoob pieces.  Individual adapters can be found on Thingiverse.com or downloaded as a package of STL files.

Three cheers for easier and better building experiences.  We are big fans of building things as a component of learning and as motivation, and have done extensive work with LEGO over the years including making the XO easy to connect with LEGO WeDo kits and other robotic tools.

Nagorno-Karabakh deployes 3,300 OLPCs to connected schools

Nagorno-Karabakh is a landlocked region which seceded from Azerbaijan in 1991, and has been engaged in a  low-grade military conflict involving Azerbaijan and Armenia ever since.  Recently they have launched a New Education Project to improve primary education across the region.

Many of the children in the region have schools, and some have internet access.  This week, they launched a small OLPC project, deploying laptops to 3,300 students in 16 connected primary schools in the cities of Stepanakert (the region’s capital), Shushi, and Karin Tak.

Vladik Khachatryan, Minister of Education and Science of Nagorno-Karabakh, was present at the launch.  He announced,

This program will improve the quality of education of elementary school students in the NKR, and what is more important, will make more information available to them and their families… within a short period of time we will be able to establish equal educational opportunities in all NKR.

Rodrigo added,

Education is a key factor to breaking the vicious cycle of ethnic hatred and violence for children who live in conflict zones.

I look forward to seeing the project develop, and hope that the recent focus on children and education brings stability and peace to the region.