"This guide aims to provide practitioners with a broad framework for carrying out project level Participatory Impact Assessments (PIA) of livelihoods interventions in the humanitarian sector. Other than in some health, nutrition, and water interventions in which indicators of project performance sho
...
uld relate to international standards, for many interventions there are no ‘gold standards’ for measuring project impact. For example, the Sphere handbook has no clear standards for food security or livelihoods interventions. This guide aims to bridge this gap by outlining a tried and tested approach to measuring the impact of livelihoods projects. The guide does not attempt to provide a set of standards or indicators or blueprint for impact assessment, but a broad and flexible framework which can be adapted to different contexts and project interventions. Consistent with this, the proposed framework does not aim to provide a rigid or detailed step by step formula, or set of tools to carry out project impact assessments, but describes an eight stage approach, and presents examples of tools which may be adapted to different contexts. One of the objectives of the guide is to demonstrate how PIA can be used to overcome some of the inherent weaknesses in conventional humanitarian monitoring evaluation and impact assessment approaches, such as; the emphasis on measuring process as opposed to real impact, the emphasis on external as opposed to community based indicators of impact, and how to overcome the issue of weak or non-existent baselines. The guide also aims to demonstrate and provide examples of how participatory methods can be used to overcome the challenge of attributing impact or change to actual project activities. The guide will also demonstrate how data collected from the systematic use of participatory tools can be presented numerically, and can give representative results and provide evidence based data on project impact." (Introduction, page 6)
more
"This guide helps you gather input at the beginning of your activities to shape your communication strategy. It also gives you the tools to monitor progress and make corrections during implementation. It was not designed as a means for looking back on past work to determine if it was successful. Ins
...
tead, the idea is to prepare up front and evaluate as you go along, so that you may adjust your tactics to ensure success. This guide is an evaluation strategy tool – not a communication planning tool. It will be most useful for those who already have a communication plan in place with clear objectives, messages, strategies and tactics. However, even if you are still in the beginning stages of designing a communication plan, it is never too early to start thinking about evaluation." (About this guide, page 1)
more
"Am Beispiel eines von den Autoren realisierten Evaluationsprojektes führt dieses Buch in die Planung und praktische Durchführung von qualitativer Evaluation ein. Anhand einer detaillierten Schritt-für-Schritt-Anleitung werden die Bestandteile eines Evaluationsprozesses von der Gegenstandsbestimm
...
ung, Erhebung und Codierung der Daten bis hin zur computergestützten, kategorienbasierten Auswertung mit Hilfe der Software MAXQDA und der Verfassung des Berichts nachvollziehbar dargestellt. Die im Buch beschriebene computergestützte Vorgehensweise lässt sich auch bei knappen zeitlichen und finanziellen Ressourcen umsetzen. Eine Checkliste und weitere Arbeitshilfen unterstützen die Gestaltung eigener qualitativer Evaluationsprojekte." (Verlagsbeschreibung)
more
"Este libro recupera parte de lo ya escrito y dicho sobre la evaluación en diferentes textos y espacios de reflexión y de diálogo. Si se nos pregunta sobre su aporte diríamos que, sumada a la convencional y necesaria presentación de argumentos conceptuales y herramientas metodológicas que sust
...
enten cómo hacer evaluación –quizá incorporando énfasis y estilos de alguna manera particulares–, su valor está en juntar en una misma propuesta cuatro propósitos de cambio para la evaluación, que si bien se encuentran aún en proceso de consolidación, tienen una presencia emergente en la reflexión actual sobre el tema. Estos propósitos son los siguientes: transitar de una evaluación centrada en la observación de actividades (qué y cuánto se ha hecho), a una que pone énfasis en la observación del cambio (qué ha cambiado con la intervención); transitar de una evaluación entendida como un servicio externo a los proyectos a cargo de especialistas también externos, a una concebida como una experiencia participativa, basada en la confianza y la corresponsabilidad en el manejo de los procesos, la emisión de juicios y la toma de decisiones; transitar de una evaluación operada como mecanismo de control y enfocada en la observación de defectos, a una entendida y organizada como espacio de aprendizaje y de desarrollo de capacidades; Transitar de una idea de la evaluación como práctica instrumental neutra (libre de valores), a entenderla como una práctica intencional, cargada de ideología y utopía, que no se limita a la verificación del cambio sino que apuesta a facilitarlo, haciendo jugar concepciones e intereses particulares." (Introducción)
more
"The overall purpose of this guide is twofold. To help grantmakers think about and talk about measurement of advocacy and policy, this guide puts forth a framework for naming outcomes associated with advocacy and policy work as well as directions for evaluation design. The framework is intended to p
...
rovide a common way to identify and talk about outcomes, providing philanthropic and non-profit audiences an opportunity to react to, refine and adopt the outcome categories presented. In addition, grantmakers can consider some key directions for evaluation design that include a broad range of methodologies, intensities, audiences, timeframes and purposes." (Introduction, page 1)
more
"The purpose of the manual is to introduce peacebuilding practitioners to the concepts, tools, and methods needed to incorporate better design, monitoring, and evaluation practices into peacebuilding programming. As an introductory volume, the target audience is front-line peacebuilding practitioner
...
s from around the world with minimal formal training in design, monitoring, and evaluation. It assumes the audience has experience, training, and access to resources on conflict assessments, which are a prerequisite to participating in conflict transformation program design [...] The manual offers general information on learning and change in addition to chapters dedicated to specific issues such as baselines, indicators, monitoring, and evaluation. It is organized so that readers can easily jump from one chapter to another. However, we strongly urge jumpy readers to start with the chapter on understanding change because it frames the thinking for most of the discussions in the other chapters." (Page 2)
more
"This publication addresses the monitoring and evaluation of development results. It is intended to support country offices in aligning their monitoring and evaluation systems with results-based management (RBM) methodology—specifically in tracking and measuring the performance of UNDP interventio
...
ns and strategies and their contributions to outcomes. It aims to provide simple, flexible and forward-looking tools." (Preface)
more
"Peu d'acteurs du développement, que ce soient des ONGN, des bailleurs de fonds publics, des institutions du Sud ont une idée claire de ce qu'est une évaluation. Peu connaissent la grande variété des évaluations, que ce soit au niveau des finalités, des différents acteurs concernés ou encor
...
e des modalités de mise en oeuvre. Les connaissances sont parcellaires, floues, voire erronées et souvent sources d'attentes inadaptées et de malentendus. C'est pourquoi le guide est composé d'une première partie qui éclaircit les différents concepts ainsi que les conditions et implications pour une ONGN qui veut se lancer dans l'évaluation. La deuxième partie, plus opérationnelle, reprend pas à pas les différentes démarches pratiques qui incombent à l'ONGN durant le processus d'évaluation réalisée par des évaluateurs externes à celle-ci." (Page 8)
more
"L’évaluation, enfin considérée comme un outil irremplaçable pour améliorer la qualité des actions, devient une pratique courante dans les milieux du développement. Mais elle reste un exercice délicat, et génère souvent plus de frustrations que de progrès. Comment en accroître l’effi
...
cacité ? En s’adressant à la fois aux commanditaires d’évaluations, aux évaluateurs et aux évalués, pour qu’ils se comprennent mieux, malgré les enjeux qui parfois les opposent, pour qu’ils partagent le langage et les méthodes de l’évaluation, et surtout pour qu’ils s’approprient plus complètement cet outil. Ils doivent l’utiliser sur mesure en fonction des spécificités de l’action évaluée, à l’opposé d’un exercice académique reproduit indépendamment de son contexte. Mais le sur mesure n’exclut pas certaines règles." (Page 1)
more
"This manual is intended as an introduction to the theory and concepts of Outcome Mapping and as a guide to conducting an Outcome Mapping workshop. Although Outcome Mapping may be appropriate in various contexts, it has primarily been tested by development research organizations and programs working
...
in Canada, Africa, Latin America, and Asia. This manual reflects that perspective and Outcome Mapping may have to be adapted to be used with groups other than our constituency of researchers, scientific organizations, government officials, policymakers, and NGOs (for example, communities). Outcome Mapping has been developed in organizations where monitoring and evaluation are primarily intended to help with program learning and improvement. The tenor of a program’s approach to Outcome Mapping will necessarily be influenced by its own and its donor’s perspectives on monitoring and evaluation. Outcome Mapping will only be as empowering, participatory, and learning-oriented as the program that implements it. Outcome Mapping takes into consideration the threats and anxiety that can be associated with planning, monitoring and evaluation, especially in a donor/recipient relationship. It offers a participatory methodology that can help programs develop a system that can meet both accountability and learning needs." (Preface)
more
"The most important point for all types of workshops is that the participation of the representatives of all relevant stakeholder groups is ensured. This goes beyond mere discussion: at some stage there is always the necessity to make binding decisions. At this point, the workshop participants must
...
be empowered by their respective organisations and/or groups (constituencies) to make such binding decisions (commitments concerning the use of people, materials, equipment, time, and money).
A second important point for all types of workshops is the recommended use of a team of two facilitators. Years of experience in the context of organisations in the field of development have clearly demonstrated the advantage of having two facilitators rather than only one: a single facilitator simply cannot keep track of all the details of the group processes and, at the same time, keep the discussion focussed along the lines of the previously agreed agenda. Therefore, it is essential that the two facilitators compare their perceptions in the breaks between sessions and take turns in facilitating. Their perceptions thus gain in objectivity and their activity is less influenced by the emotional and cognitive strain that group processes invariably produce.
It should also be obvious that the less the facilitators are directly involved in the project under discussion, the more efficiently they will work. The more they are "outsiders," the more impartial they can be towards the expression of (sometimes diverging) interests in the processes of discussion and negotiation that are the essence of the MAPA-PROJECT workshops. This will not only increase the trust of all participants in the results of the workshop (i.e. the project plan), it will also enhance the credibility of this plan in the eyes of outside organisations, such as a funding organisation. For the same reason it is often advisable to conduct the workshop on "neutral grounds" (i.e., in a location different from that of the organisation which will be running the project)." (Overview, page 21)
more
"This book is the most comprehensive and accessible short guide to evaluations available. It explains clearly what evaluations are, how they can be used most effectively, and outlines the strengths and pitfalls of different evaluation methods. Each chapter comes with tasks to demonstrate the practic
...
al importance of the issues covered and to lead the reader through the steps necessary to carry out a successful evaluation [...] Stakeholder models are compared and contrasted with other models of involvement, such as participatory evaluation and practitioner-centred action research. Ethical and political considerations are placed in context. Designs for different purposes are systematically considered [...] The book is aimed at anyone who is faced with the task of doing small-scale evaluations for the first time, wether or not they have a professional background in the field." (Cover)
more