"Too often evaluations are shelved, with very little done to bring about change within organisations. This guide will explain how you can make your evaluations more useful. It will help you to better understand some conceptual issues and appreciate how evaluations contribute to empowering stakeholde
...
rs. This practical guide brings together evaluation concepts, methods and tools that work well in the field and presents core principles for guiding evaluations that matter; provides a framework for designing and facilitating evaluations; shows you how to get your primary intended users and other key stakeholders to contribute effectively to the evaluation process; offers ideas for turning evaluations into learning processes. Making evaluations matter to the primary intended users of development programmes is at the heart of this book – a must-read for evaluators, commissioners, monitoring and evaluation officers and key stakeholders within the international development sector." (Back cover)
more
"This book off ers an accessible introduction to the topic of impact evaluation and its practice in development. Although the book is geared principally toward development practitioners and policy makers, we trust that it will be a valuable resource for students and others interested in impact evalu
...
ation. Prospective impact evaluations assess whether or not a program has achieved its intended results or test alternative strategies for achieving those results. We consider that more and better impact evaluations will help strengthen the evidence base for development policies and programs around the world. Our hope is that if governments and development practitioners can make policy decisions based on evidence—including evidence generated through impact evaluation—development resources will be spent more eff ectively to reduce poverty and improve people’s lives. The three parts in this handbook provide a nontechnical introduction to impact evaluations, discussing what to evaluate and why in part 1; how to evaluate in part 2; and how to implement an evaluation in part 3. These elements are the basic tools needed to successfully carry out an impact evaluation. The approach to impact evaluation in this book is largely intuitive, and we attempt to minimize technical notation. We provide the reader with a core set of impact evaluation tools—the concepts and methods that underpin any impact evaluation—and discuss their application to real-world development operations. The methods are drawn directly from applied research in the social sciences and share many commonalities with research methods used in the natural sciences. In this sense, impact evaluation brings the empirical research tools widely used in economics and other social sciences together with the operational and political-economy realities of policy implementation and development practice.
From a methodological standpoint, our approach to impact evaluation is largely pragmatic: we think that the most appropriate methods should be identified to fit the operational context, and not the other way around. This is best achieved at the outset of a program, through the design of prospective impact evaluations that are built into the project’s implementation. We argue that gaining consensus among key stakeholders and identifying an evaluation design that fits the political and operational context are as important as the method itself. We also believe strongly that impact evaluations should be candid about their limitations and caveats. Finally, we strongly encourage policy makers and program managers to consider impact evaluations in a logical framework that clearly sets out the causal pathways by which a program works to produce outputs and influence final outcomes, and to combine impact evaluations with monitoring and complementary evaluation approaches to gain a full picture of performance." (Preface)
more
"The Nonprofit Outcomes Toolbox identifies stages in the use of outcomes and shows you how to use specific facets of existing outcome models to improve performance and achieve meaningful results. Going beyond the familiar limits of the sector, this volume also illustrates how tools and approaches lo
...
ng in use in the corporate sector can be of great analytical and practical use to nonprofit, philanthropic, and governmental organizations." (Publisher description)
more
"This paper explores why measuring the impacts of information and communication technology (ICT) is important for development – and why it is statistically challenging. Measuring impacts in any field is difficult, but for ICT there are added complications because of its diversity and rapidly chang
...
ing nature. A number of impact areas are identified in section 1, and their relationships explored, in the context of their place in the social, economic and environmental realms. The result is a complex web of relationships between individual impact areas, such as economic growth and poverty alleviation, and background factors, such as a country’s level of education and government regulation.
Existing measurement frameworks are described in section 1, and relevant statistical standards examined. The latter includes internationally agreed standards for the ICT sector, ICT products and ICT demand. The contribution of the Partnership on Measuring ICT for Development and its member organizations to ICT measurement, and its goals for measuring ICT impacts are outlined. Methodologies used in the measurement of ICT are discussed and compared in section 2 of the paper, and empirical evidence reviewed, in section 3. Most research conducted has found positive effects of ICT in the impact areas investigated. However, research has tended to focus on positive, rather than negative impacts; therefore, the latter tend to be indicated by anecdotal evidence. There is relatively little evidence from developing countries and there are indications that findings in respect of developed countries may not apply to developing countries. In respect of both developed and developing countries, there are few studies that provide internationally comparable evidence. The difficulties of ICT impact measurement, major data gaps and the lack of clear statistical standards suggest several issues for consideration. These are presented in the final section of the paper." (Abstract)
more
"Developmental evaluation offers a powerful approach to monitoring and supporting social innovations by working in partnership with program decision makers. In this book, eminent authority Michael Quinn Patton shows how to conduct evaluations within a developmental evaluation framework. Patton draws
...
on insights about complex dynamic systems, uncertainty, nonlinearity, and emergence. He illustrates how developmental evaluation can be used for a range of purposes: ongoing program development, adapting effective principles of practice to local contexts, generating innovations and taking them to scale, and facilitating rapid response in crisis situations. Students and practicing evaluators will appreciate the book's extensive case examples and stories, cartoons, clear writing style, "closer look" sidebars, and summary tables." (Publisher description)
more
"This book reviews quantitative methods and models of impact evaluation, presenting an analysis of the quantitative research underlying recent programme evaluations and case studies prepared for a series of impact evaluation workshops in different countries, sponsored by the World Bank Institute (WB
...
I). The handbook also details challenges and goals in other realms of evaluation, including monitoring and evaluation, operational evaluation, and mixed-methods approaches combining quantitative and qualitative analyses. It is designed to put theory on evaluation methods and practices into practice in a hands-on fashion for practitioners, especially researchers new to the evaluation field and policymakers involved in implementing development programmes worldwide." (Publisher description)
more
"The organizations that conduct country rankings should continue to increase technical sophistication, cultural neutrality, and transparency. In particular, continued attention must be paid to digital media, notably the Internet and mobile phones, which now number approximately 4.6 billion worldwide
...
. Donors and implementers of media assistance, meanwhile, should keep up efforts to find better ways to monitor and evaluate specific programs and to share the resulting information with other aid organizations. At a time of financial shortfalls, foundations and other funding bodies should assure that assessment of media quality at both the national and the program level receives the attention (and the money) that it deserves." (Executive summary, page 5)
more
"Agency-based Program Evaluation: Lessons from Practice, by Stephen A. Kapp and Gary R. Anderson, serves as a core textbook in the advanced undergraduate and graduate social work program evaluation courses. It combines the methodology of program evaluation with the reality of working with agencies a
...
nd organizations to describe the effectiveness of their services and programs. Students will gain an understanding of the political and social context and pressures in which a program is developed, implemented and evaluated. This book offers a practice-oriented approach to evaluation. While many program evaluation methods texts often add a or brief sections that describe organizational and political factors, this book begins with the context of an agency-based evaluation and describes the method within that context. Students will gain a more complete understanding of this contextual challenge and will learn techniques for operating in the face of these challenges." (Publisher description)
more
"This document outlines basic steps in planning monitoring and evaluation for advocacy and covers: distinctive features of monitoring and evaluation for advocacy; five questions for planning advocacy monitoring and evaluation; special focuses on equity, humanitarian advocacy monitoring and evaluatio
...
n, and knowledge management; aeventeen data collection tools for measuring advocacy outputs, outcomes and impacts; dour case studies from Kenya, Nigeria, Tanzania, Mexico, Tajikistan and Iceland; following up with next steps. This is the full version of Chapter 4 in UNICEF’s Advocacy Toolkit." (Page 1)
more
"There has been a great deal written on why peace operations succeed or fail [...] But how are those judgments reached? By what criteria is success defined? Success for whom? Paul Diehl and Daniel Druckman explore the complexities of evaluating peace operation outcomes, providing an original, detail
...
ed framework for assessment. The authors address both the theoretical and the policy-relevant aspects of evaluation as they cover the full gamut of mission goals—from conflict mitigation, containment, and settlement to the promotion of democracy and human rights. Numerous examples from specific peace operations illustrate their discussion." (Publisher description)
more
"The Standards aim to improve quality and ultimately to strengthen the contribution of evaluation to improving development outcomes. Specifically, the Standards are intended to: improve the quality of development evaluation processes and products, facilitate the comparison of evaluations across coun
...
tries, support partnerships and collaboration on joint evaluations, and increase development partners’ use of each others’ evaluation findings [...] This document is structured in line with a typical evaluation process: defining purpose, planning, designing, implementing, reporting, and learning from and using evaluationresults. The Standards begin with some overall considerations to keep in mind throughout the evaluation process." (Introduction)
more
"This report discusses the state of media development indicators in relation to a new Results Framework (RF) drafted by USAID in 2009. There were three aims for the report: To collect and screen the strongest indicators developed by different organizations or individuals for measuring meso-level obj
...
ectives or results related to media development; Compile an annotated list of indicator sources reviewed; Determine the extent to which the indicators available for the given results met set criteria; Provide recommendations for USAID investment in improving indicators for media development." (Introduction, page 1)
more
"United Nations agencies currently do not have commonly agreed tools for assessing the impact of Communication for Development (C4D) programmes. This paper is designed to help them explore the key issues surrounding C4D, consider case studies and best practice methodology and propose a set of draft
...
indicators for monitoring and evaluation (M&E). Nevertheless, this publication is also of value for anybody interested in M&E. It presents in a clear and succinct way the principal tools and approaches, from conventional, quantitative research techniques to more intricate, participatory processes, and it summarises the challenges to communication for development M&E. Case studies are used to illustrate how initiatives have used a variety of approaches to gather informative results and feed these back into programme design. The authors emphasise that a tailored toolkit approach is necessary in order to deal with the many complexities of C4D evaluation. They highlight the need for flexibility within any evaluation and discuss the strengths of Most Significant Change, Outcome Mapping and the Logframe as state of the art evaluation techniques. Qualitative and quantitative tools should be used as complementary strategies for providing the most comprehensive, clear and pragmatic assessment and reporting of C4D." (CAMECO Update 4-2009)
more