"Too often evaluations are shelved, with very little done to bring about change within organisations. This guide will explain how you can make your evaluations more useful. It will help you to better understand some conceptual issues and appreciate how evaluations contribute to empowering stakeholde
...
rs. This practical guide brings together evaluation concepts, methods and tools that work well in the field and presents core principles for guiding evaluations that matter; provides a framework for designing and facilitating evaluations; shows you how to get your primary intended users and other key stakeholders to contribute effectively to the evaluation process; offers ideas for turning evaluations into learning processes. Making evaluations matter to the primary intended users of development programmes is at the heart of this book – a must-read for evaluators, commissioners, monitoring and evaluation officers and key stakeholders within the international development sector." (Back cover)
more
"This book off ers an accessible introduction to the topic of impact evaluation and its practice in development. Although the book is geared principally toward development practitioners and policy makers, we trust that it will be a valuable resource for students and others interested in impact evalu
...
ation. Prospective impact evaluations assess whether or not a program has achieved its intended results or test alternative strategies for achieving those results. We consider that more and better impact evaluations will help strengthen the evidence base for development policies and programs around the world. Our hope is that if governments and development practitioners can make policy decisions based on evidence—including evidence generated through impact evaluation—development resources will be spent more eff ectively to reduce poverty and improve people’s lives. The three parts in this handbook provide a nontechnical introduction to impact evaluations, discussing what to evaluate and why in part 1; how to evaluate in part 2; and how to implement an evaluation in part 3. These elements are the basic tools needed to successfully carry out an impact evaluation. The approach to impact evaluation in this book is largely intuitive, and we attempt to minimize technical notation. We provide the reader with a core set of impact evaluation tools—the concepts and methods that underpin any impact evaluation—and discuss their application to real-world development operations. The methods are drawn directly from applied research in the social sciences and share many commonalities with research methods used in the natural sciences. In this sense, impact evaluation brings the empirical research tools widely used in economics and other social sciences together with the operational and political-economy realities of policy implementation and development practice.
From a methodological standpoint, our approach to impact evaluation is largely pragmatic: we think that the most appropriate methods should be identified to fit the operational context, and not the other way around. This is best achieved at the outset of a program, through the design of prospective impact evaluations that are built into the project’s implementation. We argue that gaining consensus among key stakeholders and identifying an evaluation design that fits the political and operational context are as important as the method itself. We also believe strongly that impact evaluations should be candid about their limitations and caveats. Finally, we strongly encourage policy makers and program managers to consider impact evaluations in a logical framework that clearly sets out the causal pathways by which a program works to produce outputs and influence final outcomes, and to combine impact evaluations with monitoring and complementary evaluation approaches to gain a full picture of performance." (Preface)
more
"Developmental evaluation offers a powerful approach to monitoring and supporting social innovations by working in partnership with program decision makers. In this book, eminent authority Michael Quinn Patton shows how to conduct evaluations within a developmental evaluation framework. Patton draws
...
on insights about complex dynamic systems, uncertainty, nonlinearity, and emergence. He illustrates how developmental evaluation can be used for a range of purposes: ongoing program development, adapting effective principles of practice to local contexts, generating innovations and taking them to scale, and facilitating rapid response in crisis situations. Students and practicing evaluators will appreciate the book's extensive case examples and stories, cartoons, clear writing style, "closer look" sidebars, and summary tables." (Publisher description)
more
"This book reviews quantitative methods and models of impact evaluation, presenting an analysis of the quantitative research underlying recent programme evaluations and case studies prepared for a series of impact evaluation workshops in different countries, sponsored by the World Bank Institute (WB
...
I). The handbook also details challenges and goals in other realms of evaluation, including monitoring and evaluation, operational evaluation, and mixed-methods approaches combining quantitative and qualitative analyses. It is designed to put theory on evaluation methods and practices into practice in a hands-on fashion for practitioners, especially researchers new to the evaluation field and policymakers involved in implementing development programmes worldwide." (Publisher description)
more
"Agency-based Program Evaluation: Lessons from Practice, by Stephen A. Kapp and Gary R. Anderson, serves as a core textbook in the advanced undergraduate and graduate social work program evaluation courses. It combines the methodology of program evaluation with the reality of working with agencies a
...
nd organizations to describe the effectiveness of their services and programs. Students will gain an understanding of the political and social context and pressures in which a program is developed, implemented and evaluated. This book offers a practice-oriented approach to evaluation. While many program evaluation methods texts often add a or brief sections that describe organizational and political factors, this book begins with the context of an agency-based evaluation and describes the method within that context. Students will gain a more complete understanding of this contextual challenge and will learn techniques for operating in the face of these challenges." (Publisher description)
more
"This document outlines basic steps in planning monitoring and evaluation for advocacy and covers: distinctive features of monitoring and evaluation for advocacy; five questions for planning advocacy monitoring and evaluation; special focuses on equity, humanitarian advocacy monitoring and evaluatio
...
n, and knowledge management; aeventeen data collection tools for measuring advocacy outputs, outcomes and impacts; dour case studies from Kenya, Nigeria, Tanzania, Mexico, Tajikistan and Iceland; following up with next steps. This is the full version of Chapter 4 in UNICEF’s Advocacy Toolkit." (Page 1)
more
"The paper is divided into two parts: Part One describes a methodology for designing an M&E system. This covers a number of stages from defining the scope and purpose of the system to its eventual roll out. However, it does not cover the implementation of the M&E system. Part Two addresses many of t
...
he technical issues that need to be considered when designing M&E systems for complex organisations. The information in Part Two may be useful to M&E system designers whether or not the basic methodology in Part One is followed." (Page 1)
more
"This 2009 version of the ‘Handbook on Planning, Monitoring and Evaluating for Development Results’ aims to support UNDP in becoming more results-oriented and to improve its focus on development changes and real improvements in people’s lives. It replaces and updates the previous Handbook from
...
2002. It was a breakthrough in driving the effective application of the results-based management approach in programming and performance management. The Handbook recognizes that planning, monitoring and evaluation require a focus on nationally owned development priorities and results, and should reflect the guiding principles of national ownership, capacity development and human development. Globally, there has been a significant shift away from the project approach in favour of programme and national approaches." (Preface, page III)
more
"Teil I erläutert Begriffe und Hintergründe wirkungsorientierter Projektplanung und verortet Wirkungsorientierung im Projektzyklus der Welthungerhilfe. Teil II stellt eine praxisorientierte Handreichung bereit, in der das wirkungsorientierte Vorgehen in den einzelnen Projektphasen Schritt für Sch
...
ritt anhand eines konkreten Projektbeispiels erläutert wird. Mögliche Methoden, die – in Abhängigkeit vom Projekttyp – bei der Durchführung des jeweiligen Schrittes angewandt werden können, sind nur aufgeführt, aber nicht im Einzelnen näher erläutert. Teil III enthält eine Sammlung von Instrumenten und Methoden zur Wirkungsorientierung und benennt Vorteile und Grenzen der jeweiligen Werkzeuge. Die Auswahl basiert zum überwiegenden Teil auf den Erfahrungen, die in den Projekten der Welthungerhilfe gemacht wurden." (Seite 4)
more
"This guide helps you gather input at the beginning of your activities to shape your communication strategy. It also gives you the tools to monitor progress and make corrections during implementation. It was not designed as a means for looking back on past work to determine if it was successful. Ins
...
tead, the idea is to prepare up front and evaluate as you go along, so that you may adjust your tactics to ensure success. This guide is an evaluation strategy tool – not a communication planning tool. It will be most useful for those who already have a communication plan in place with clear objectives, messages, strategies and tactics. However, even if you are still in the beginning stages of designing a communication plan, it is never too early to start thinking about evaluation." (About this guide, page 1)
more
"Essentials for Excellence is not comprehensive but it does equip you with sufficient know-how to be able to plan and manage useful RM&E for your AI/PI strategic communication. For those seeking further information, web-links and key references are included. The guide is aimed at users who want stra
...
ightforward answers to often quite complex questions (including sampling, research design and pre-testing) who need handy tips, and who are looking for practical rather than academic advice. To be of any use, the guide is highly dependent upon your ability and willingness to adapt the suggestions offered to suit your circumstances and needs. This is also a useful basic reference for researching, monitoring and evaluating other Strategic Communication initiatives whether you are conducting an initial assessment for a child protection communication programme or a final evaluation of a hygiene promotion project." (Foreword)
more
"Hauptfunktion des wirkungsorientierten Monitoring ist es, die Steuerung von Entwicklungsmaßnahmen zu unterstützen sowie den Dialog über die eingeschlagene Strategie im Management- bzw. Projektteam und deren Aufsichtsgremien anzuregen – insbesondere im Hinblick auf die regelmäßige Operationsp
...
lanung. Es fördert darüber hinaus Lernprozesse (Wissensmanagement) und legt die Grundlage für eine verlässliche Rechenschaftslegung [...] Das Monitoring organisiert die Prozesse der Sammlung, Analyse- und Bewertung von Daten zu den Wirkungen eines Projektes und den Veränderungen in seinem Umfeld. Es liefert kontinuierlich Hinweise darüber, ob der eingeschlagene Weg Erfolg verspricht, die Strategie angepasst werden sollte oder die gesetzten Ziele zu überprüfen sind. Ebenso geht es um die Beobachtung der indirekten Wirkungen. Sie stellen den eigentlichen Grund für die Durchführung des Projektes dar. Sie sind in der Regel Ziele nationaler oder sektoraler Strategien und Programme des Partners, des Schwerpunkts der deutschen EZ in einem Land oder ähnlicher Zielsysteme, z. B. von „country assistance“-Programmen der EU oder von Multi-Geber-Programmen. Wirkungen auf dieser Ebene können zwar einer Entwicklungsmaßnahme nicht mehr eindeutig, d. h. kausal zugeordnet werden, jedoch trägt sie durch ihre Leistungen plausibel zu deren Zielerreichung bei." (Aufgaben des wirkungsorientierten Monitoring, Seite 9)
more
"Am Beispiel eines von den Autoren realisierten Evaluationsprojektes führt dieses Buch in die Planung und praktische Durchführung von qualitativer Evaluation ein. Anhand einer detaillierten Schritt-für-Schritt-Anleitung werden die Bestandteile eines Evaluationsprozesses von der Gegenstandsbestimm
...
ung, Erhebung und Codierung der Daten bis hin zur computergestützten, kategorienbasierten Auswertung mit Hilfe der Software MAXQDA und der Verfassung des Berichts nachvollziehbar dargestellt. Die im Buch beschriebene computergestützte Vorgehensweise lässt sich auch bei knappen zeitlichen und finanziellen Ressourcen umsetzen. Eine Checkliste und weitere Arbeitshilfen unterstützen die Gestaltung eigener qualitativer Evaluationsprojekte." (Verlagsbeschreibung)
more
"Este libro recupera parte de lo ya escrito y dicho sobre la evaluación en diferentes textos y espacios de reflexión y de diálogo. Si se nos pregunta sobre su aporte diríamos que, sumada a la convencional y necesaria presentación de argumentos conceptuales y herramientas metodológicas que sust
...
enten cómo hacer evaluación –quizá incorporando énfasis y estilos de alguna manera particulares–, su valor está en juntar en una misma propuesta cuatro propósitos de cambio para la evaluación, que si bien se encuentran aún en proceso de consolidación, tienen una presencia emergente en la reflexión actual sobre el tema. Estos propósitos son los siguientes: transitar de una evaluación centrada en la observación de actividades (qué y cuánto se ha hecho), a una que pone énfasis en la observación del cambio (qué ha cambiado con la intervención); transitar de una evaluación entendida como un servicio externo a los proyectos a cargo de especialistas también externos, a una concebida como una experiencia participativa, basada en la confianza y la corresponsabilidad en el manejo de los procesos, la emisión de juicios y la toma de decisiones; transitar de una evaluación operada como mecanismo de control y enfocada en la observación de defectos, a una entendida y organizada como espacio de aprendizaje y de desarrollo de capacidades; Transitar de una idea de la evaluación como práctica instrumental neutra (libre de valores), a entenderla como una práctica intencional, cargada de ideología y utopía, que no se limita a la verificación del cambio sino que apuesta a facilitarlo, haciendo jugar concepciones e intereses particulares." (Introducción)
more
"The overall purpose of this guide is twofold. To help grantmakers think about and talk about measurement of advocacy and policy, this guide puts forth a framework for naming outcomes associated with advocacy and policy work as well as directions for evaluation design. The framework is intended to p
...
rovide a common way to identify and talk about outcomes, providing philanthropic and non-profit audiences an opportunity to react to, refine and adopt the outcome categories presented. In addition, grantmakers can consider some key directions for evaluation design that include a broad range of methodologies, intensities, audiences, timeframes and purposes." (Introduction, page 1)
more