Document details

A Roadmap for Measuring Distance Learning: A Review of Evidence and Emerging Practices

USAID (2021), v, 79 pp.

Contains glossary pp. 70-74

"The purpose of this review is to support education practitioners, host country government representatives, donors, implementers, non-governmental organizations (NGOs), civil society organizations, and other stakeholders in applying best practices to monitor and evaluate distance learning initiatives designed for diverse learners and implemented both within and outside of learning institutions. This review covers the four key distance learning modalities: radio/audio, television/video, mobile phone, and online learning. Printed texts, which are often developed to accompany these first four modalities, can also be a fifth modality in contexts where technology is not used. Most of the data sources were drawn from work in the primary education sub-sector. However, much of the guidance can be applied to secondary and tertiary-level distance learning. This review is also applicable to data collection in both crisis and non-crisis contexts. This review presents a roadmap that guides users through four steps of planning and designing how distance learning delivered through any of these modalities can be monitored and evaluated. Step 1: Determine the Objectives of Monitoring and Evaluating Distance Learning; Step 2: Determine What Will Be Measured (Reach, Engagement, and Outcomes); Step 3: Determine How Data Will Be Collected (In-Person or Remotely); Step 4: Determine the Methods and Approaches for Measurement. Based on emerging global evidence, this review guides users through the process of measuring the reach, engagement, and outcomes of distance learning initiatives. In addition to providing step-by-step guidance, this review provides three overarching recommendations for developing and implementing evidence-based monitoring, evaluation, and learning (MEL) plans for distance learning initiatives." (Executive summary)
INTRODUCTION, 1
THE ROADMAP FOR MEASURING DISTANCE LEARNING
Step 1: Determine the Objectives of Monitoring and Evaluating Distance Learning, 4
Step 2: Determine What Will Be Measured (Reach, Engagement, and Outcomes), 6
Step 3: Determine How Data Will Be Collected (In Person or Remotely), 22
Step 4: Determine the Methods and Approaches for Measurement (Quantitative and Qualitative), 27
CONCLUSION, 37
EVALUATIONS REVIEWED
Radio Evaluations Reviewed, 40
Video and Television Evaluations Reviewed, 42
Mobile Phone Evaluations Reviewed, 44
Online and Computer Evaluations Reviewed, 45
Other Evaluations and Sources Reviewed, 46
ANNEXES
Annex A: Evidence Base, 52
Annex B: Examples of Formative and Summative Evaluations, 53
Annex C: Definitions of the Strength of Evidence, 54
Annex D: Case Studies, 55
Annex E: Key Terms, 70