"This nuts-and-bolts introduction to program evaluation is also applicable to evaluation of policies and evaluation of organizational performance. It is rich with over 40 examples from public policy, public health, non-profit management, social work, arts management, education, international assista
...
nce, and labor, which illustrate the books step-by-step introduction to the process and methods of program evaluation." (Publisher description)
more
"This book is written to provide detailed, rigorous guidance on how to conduct impact evaluations of government and nongovernment programs and projects. It covers all the leading quantitative impact evaluation methods, explaining the assumptions required for them to provide unbiased estimates and th
...
e data required to implement them. It also provides many examples of how these methods have been applied in developing economies. The book’s contents are based on lectures given by the authors, and their collaborators, as part of a two-week intensive course conducted in China, Peru, South Africa, and Uganda between 2012 and 2017. The courses in China, South Africa, and Uganda were administered and supported by the Centers for Learning on Evaluation and Results (CLEAR) Initiative, a multidonor partnership program for evaluation capacity development with its secretariat at the World Bank and centers located in universities in different parts of the world; in 2020, the program and centers became part of the Global Evaluation Initiative. The presentation of the material in this book is at a high technical level. It assumes that the reader is very comfortable with algebra and has an intermediate knowledge of statistical theory. It is essentially a graduate-level textbook for use in economics, public policy, or related academic programs, although it may also be useful for a course designed for advanced undergraduate students." (Preface)
more
"This text provides a solid foundation in program evaluation, covering the main components of evaluating agencies and their programs, how best to address those components, and the procedures to follow when conducting evaluations. Different models and approaches are paired with practical techniques,
...
such as how to plan an interview to collect qualitative data and how to use statistical analyses to report results. In every chapter, case studies provide real world examples of evaluations broken down into the main elements of program evaluation: the needs that led to the program, the implementation of program plans, the people connected to the program, unexpected side effects, the role of evaluators in improving programs, the results, and the factors behind the results. In addition, the story of one of the evaluators involved in each case study is presented to show the human side of evaluation." (Publisher description)
more
"In a Randomised Control Trial (RCT) different units are randomly assigned to separate groups. One group receives a development intervention and the other does not. Changes in the two groups over time are then compared to accurately measure the effect of the intervention. RCTs have been much debated
...
over the past 10 years. Some see them as the ‘gold standard’ for impact assessment." (Introduction)
more
"Experimental approaches work by comparing changes in a group that receives a development intervention with a group that does not. The difference is then attributed to the intervention. In a full experimental approach, units are randomly allocated to two groups – one that receives the intervention
...
and one that does not. In a quasi-experimental approach non-random methods of assignment are used instead." (Introduction)
more
"The Handbook of Practical Program Evaluation provides tools for managers and evaluators to address questions about the performance of public and nonprofit programs. Neatly integrating authoritative, high-level information with practicality and readability, this guide gives you the tools and process
...
es you need to analyze your program's operations and outcomes more accurately. This new fourth edition has been thoroughly updated and revised, with new coverage of the latest evaluation methods, including: culturally responsive evaluation; adopting designs and tools to evaluate multi-service community change programs; using role playing to collect data; using cognitive interviewing to pre-test surveys; coding qualitative data. You'll discover robust analysis methods that produce a more accurate picture of program results, and learn how to trace causality back to the source to see how much of the outcome can be directly attributed to the program. Written by award-winning experts at the top of the field, this book also contains contributions from the leading evaluation authorities among academics and practitioners to provide the most comprehensive, up-to-date reference on the topic. Valid and reliable data constitute the bedrock of accurate analysis, and since funding relies more heavily on program analysis than ever before, you cannot afford to rely on weak or outdated methods. This book gives you expert insight and leading edge tools that help you paint a more accurate picture of your program's processes and results, including: obtaining valid, reliable, and credible performance data; engaging and working with stakeholders to design valuable evaluations and performance monitoring systems; assessing program outcomes and tracing desired outcomes to program activities; providing robust analyses of both quantitative and qualitative data" (Publisher description)
more
"A randomized controlled trial (RCT) is a way of doing impact evaluation in which the population receiving the programme or policy intervention is chosen at random from the eligible population, and a control group is also chosen at random from the same eligible population. It tests the extent to whi
...
ch specific, planned impacts are being achieved. In an RCT, the programme or policy is viewed as an ‘intervention’ in which a treatment – the elements of the programme/policy being evaluated – is tested for how well it achieves its objectives, as measured by a predetermined set of indicators. The strength of an RCT is that it provides a very powerful response to questions of causality, helping evaluators and programme implementers to know that what is being achieved is as a result of the intervention and not anything else [...] The distinguishing feature of an RCT is the random assignment of members of the population eligible for treatment to either one or more treatment groups (who receive the intervention treatment or variations of it) or to the control group (who receive either no intervention or the usual intervention, if the treatment is an innovation to an existing intervention). The effects on specific impact areas for the different groups are compared after set periods of time." (Page 1)
more
This book provides a comprehensive yet accessible guide to running randomized impact evaluations of social programs. Drawing on the experience of researchers at the Abdul Latif Jameel Poverty Action Lab, which has run hundreds of such evaluations in dozens of countries throughout the world, it offer
...
s practical insights on how to use this powerful technique, especially in resource-poor environments. This step-by-step guide explains why and when randomized evaluations are useful, in what situations they should be used, and how to prioritize different evaluation opportunities. It shows how to design and analyze studies that answer important questions while respecting the constraints of those working on and benefiting from the program being evaluated. The book gives concrete tips on issues such as improving the quality of a study despite tight budget constraints, and demonstrates how the results of randomized impact evaluations can inform policy. With its self-contained modules, this one-of-a-kind guide is easy to navigate. It also includes invaluable references and a checklist of the common pitfalls to avoid. Provides the most up-to-date guide to running randomized evaluations of social programs, especially in developing countries Offers practical tips on how to complete high-quality studies in even the most challenging environments Self-contained modules allow for easy reference and flexible teaching and learning Comprehensive yet nontechnical
more
"This paper focuses attention on randomised field experiments in the developing world that explicitly address the use of media to achieve democracy and governance (DG) outcomes [...] The first section describes the growth of DG assistance and the increasing interest in DG field experiments. The seco
...
nd section describes the domain of media assistance targeted at DG outcomes. The third provides an overview of current experimental and quasi-experimental studies on the intersection between media, democracy and governance. The fourth and fifth sections describe some of the challenges to successfully employing field experiments to inform media assistance programmes. The final section concludes by arguing for the benefits of practitioner-academic collaborations that provide experimental evidence about the influences on as well as the effects of media content related to democracy and governance." (Page 4)
more
"This book offers an accessible introduction to the topic of impact evaluation and its practice in development. Although the book is geared principally toward development practitioners and policy makers, we trust that it will be a valuable resource for students and others interested in impact evalua
...
tion. Prospective impact evaluations assess whether or not a program has achieved its intended results or test alternative strategies for achieving those results. We consider that more and better impact evaluations will help strengthen the evidence base for development policies and programs around the world [...] The three parts in this handbook provide a nontechnical introduction to impact evaluations, discussing what to evaluate and why in part 1; how to evaluate in part 2; and how to implement an evaluation in part 3. These elements are the basic tools needed to successfully carry out an impact evaluation." (Preface)
more
"This book off ers an accessible introduction to the topic of impact evaluation and its practice in development. Although the book is geared principally toward development practitioners and policy makers, we trust that it will be a valuable resource for students and others interested in impact evalu
...
ation. Prospective impact evaluations assess whether or not a program has achieved its intended results or test alternative strategies for achieving those results. We consider that more and better impact evaluations will help strengthen the evidence base for development policies and programs around the world. Our hope is that if governments and development practitioners can make policy decisions based on evidence—including evidence generated through impact evaluation—development resources will be spent more eff ectively to reduce poverty and improve people’s lives. The three parts in this handbook provide a nontechnical introduction to impact evaluations, discussing what to evaluate and why in part 1; how to evaluate in part 2; and how to implement an evaluation in part 3. These elements are the basic tools needed to successfully carry out an impact evaluation. The approach to impact evaluation in this book is largely intuitive, and we attempt to minimize technical notation. We provide the reader with a core set of impact evaluation tools—the concepts and methods that underpin any impact evaluation—and discuss their application to real-world development operations. The methods are drawn directly from applied research in the social sciences and share many commonalities with research methods used in the natural sciences. In this sense, impact evaluation brings the empirical research tools widely used in economics and other social sciences together with the operational and political-economy realities of policy implementation and development practice.
From a methodological standpoint, our approach to impact evaluation is largely pragmatic: we think that the most appropriate methods should be identified to fit the operational context, and not the other way around. This is best achieved at the outset of a program, through the design of prospective impact evaluations that are built into the project’s implementation. We argue that gaining consensus among key stakeholders and identifying an evaluation design that fits the political and operational context are as important as the method itself. We also believe strongly that impact evaluations should be candid about their limitations and caveats. Finally, we strongly encourage policy makers and program managers to consider impact evaluations in a logical framework that clearly sets out the causal pathways by which a program works to produce outputs and influence final outcomes, and to combine impact evaluations with monitoring and complementary evaluation approaches to gain a full picture of performance." (Preface)
more
"This book reviews quantitative methods and models of impact evaluation, presenting an analysis of the quantitative research underlying recent programme evaluations and case studies prepared for a series of impact evaluation workshops in different countries, sponsored by the World Bank Institute (WB
...
I). The handbook also details challenges and goals in other realms of evaluation, including monitoring and evaluation, operational evaluation, and mixed-methods approaches combining quantitative and qualitative analyses. It is designed to put theory on evaluation methods and practices into practice in a hands-on fashion for practitioners, especially researchers new to the evaluation field and policymakers involved in implementing development programmes worldwide." (Publisher description)
more
"This book provides a comprehensive review of the available techniques for monitoring and evaluating social programs. Specifically the book discusses: (a) methods of evaluating social and economic projects; (b) methods for participatory and rapid assessment; (c) quasi-experimental designs; and (d) t
...
he relationship between qualitative and quantitative evaluation. The authors also cover new developments in: (a) qualitative evaluation; (b) stakeholder analysis; (c) sustainability analysis; and (c) the politics of evaluation. While paying special attention to the organization of monitoring and evaluation at the project, sectoral, and national levels, this book also reviews cost-effective methods of estimating a project's impact, identifies potential beneficiaries and their information needs, and discusses the role of nongovernmental organizations in evaluating social development programs." (Publisher description)
more