Can Online Off-the-Shelf Lessons Improve Student Outcomes? Evidence from a Field Experiment
Kirabo Jackson and Alexey Makarin
American Economic Journal: Economic Policy.
Aug 2018, Vol. 10, No. 3:
Pages 226-254
Can Online Off-the-Shelf Lessons Improve Student Outcomes? Evidence from a Field Experiment†
KiraboJackson1 and AlexeyMakarin2
1School of Education and Social Policy, Northwestern University, 2120 Campus Drive, Room 204, Evanston, IL 60208 (email: [email protected])
2Department of Economics, Northwestern University, 2211 Campus Drive, Room 3464, Evanston, IL 60208 (email: [email protected])
Abstract
Many websites now warehouse instructional materials designed to be taught by teachers in a traditional classroom. What are the potential benefits of the new resources? We analyze an experiment in which we randomly give middle school math teachers access to existing high-quality, off-the-shelf lessons, and in some cases, support to promote their use. Teachers receiving access alone increased students’ math achievement by a marginally significant 0.06 of a standard deviation. Teachers who received access and support increased students’ math achievement by 0.09 of a standard deviation. Weaker teachers experience larger gains, suggesting that these lessons substitute for teacher skill or efforts. The online materials are more scalable and cost effective than most policies aimed at improving teacher quality, suggesting that, if search costs can be overcome, there is a real benefit to making high-quality instructional materials available to teachers on the Internet. (JEL C93, I21, J24, J45)