"In this brochure – and in the ‘evaluiert’ textbook to which it refers – evaluation is understood as a scientific service that describes and valuates objects of evaluation (especially programmes and measures) for clarified purposes and on the basis of justified criteria. Moreover, the valuat
...
ion carried out within the context of an evaluation is systematic, transparent and comprehensible, based on data and information gathered using social science methods. According to this understanding, persons must be specifically qualified for this activity. Evaluators follow a ten-step procedure when carrying out evaluations. These steps do not have to be followed rigidly, but must be adapted to the specific conditions of the specific evaluation at hand. This brochure presents the ten steps of the evaluation process, as a summary of the ‘evaluiert’ textbook. This brochure is also intended for people who wish to gain an overview of what evaluations are, for those who intend to carry out an evaluation or for those who are currently undergoing one. A detailed presentation with further explanations and numerous examples can be found in the ‘evaluiert’ textbook." Introduction, page 3)
more
"The resource provides a guide for the expected costs of various evaluative activities in an Australian context. The main purpose for commissioners of evaluative activity to have a sense of the budget they should set aside for these activities. However, the guide also alerts potential users to the r
...
ange of possible evaluative activities. 'Scale' in the guide refers to a combination of the following interrelated factors: how many people or other units of analysis are the 'target' of the program; whether the project is made up of a variety of sub-programs/projects that are distinct; the geographic spread of the program; the range of key evaluation questions that need to be answered and the range of data collection methods that this implies; whether the evaluative activities will include any 'hard-to-reach' populations; whether the evaluation will involve particular skill-sets, e.g. culturally sensitive evaluation team members." (https://www.betterevaluation.org)
more
"Addresses the challenges of conducting program evaluations in real-world contexts where evaluators and their clients face budget and time constraints. The book is organized around the authors’ seven-step model that has been tested in workshops and practice environments to help the evaluation impl
...
ementers and managers make the best choices when faced with real world constraints. The Third Edition includes a new chapter on gender equality and women’s empowerment and discussion of digital technology and data science." (Publisher description)
more
"The 3+5 framework consists of three core RBM principles plus five supporting principles. Each principle has an associated set of standards that capture the essential elements of RBM for generating and using results information. The primary focus of the 3+5 framework is to enhance the availability o
...
f results information and to manage adaptively through continuous learning. The 3+5 framework helps UNFPA and its partners to assess their status in terms of results-based management and to identify areas for improvement. The RBM standards are assessed on a four-point scale that is intended to provide a rating of the extent to which the RBM standard has been met." (Page 2)
more
"This text provides a solid foundation in program evaluation, covering the main components of evaluating agencies and their programs, how best to address those components, and the procedures to follow when conducting evaluations. Different models and approaches are paired with practical techniques,
...
such as how to plan an interview to collect qualitative data and how to use statistical analyses to report results. In every chapter, case studies provide real world examples of evaluations broken down into the main elements of program evaluation: the needs that led to the program, the implementation of program plans, the people connected to the program, unexpected side effects, the role of evaluators in improving programs, the results, and the factors behind the results. In addition, the story of one of the evaluators involved in each case study is presented to show the human side of evaluation." (Publisher description)
more
"Evaluation: A Systematic Approach is the best-selling comprehensive introduction to the field of program evaluation, covering the range of evaluation research activities used in appraising the design, implementation, effectiveness, and efficiency of social programs. Evaluation domains are presented
...
in a coherent framework that not only explores each, but recognizes their interrelationships, their role in improving social programs and the outcomes they are designed to affect, and their embeddedness in social and political context. Relied on as the “gold standard” by professors, students, and practitioners for 40 years, the new Eighth Edition includes a new practical chapter on planning an evaluation, entirely new examples throughout, and a major re-organization of the book’s content to better serve the needs of program evaluation courses." (Publisher description)
more
"Demystifying the evaluation journey, this is the first evaluation mentoring book that addresses the choices, roles, and challenges that evaluators must navigate in the real world. Experienced evaluator and trainer Donna R. Podems covers both conceptual and technical aspects of practice in a friendl
...
y, conversational style. She focuses not just on how to do evaluations but how to think like an evaluator, fostering reflective, ethical, and culturally sensitive practice. Extensive case examples illustrate the process of conceptualizing and implementing an evaluation--clarifying interventions, identifying beneficiaries, gathering data, discussing results, valuing, and developing recommendations. The differences (and connections) between research, evaluation, and monitoring are explored. Handy icons identify instructive features including self-study exercises, group activities, clarifying questions, facilitation and negotiation techniques, insider tips, advice, and resources." (Publisher description)
more
"Systemic evaluation design continuously addresses six questions: 1. What are the intervention purposes? 2. What is the scope and focus of the intervention and evaluation? 3. What ought to be the consequences of the evaluation and what evaluation purposes promote those consequences? 4. What are the
...
criteria (or values) that should underpin the judgment of merit, worth and significance? 5. What questions inform the collection of data so that judgments can be made using those criteria? 6. How can the evaluation be feasible? A systemic approach can be summarised as: understanding inter-relationships, engaging with multiple perspectives and reflecting on boundary choices. Systemic evaluation design flows from three key principles: 1. Systemic evaluation design is a process and a product. Evaluation design is a process that occurs throughout the evaluation, not just a product of the first stage of an evaluation. 2. Systemic evaluation design focuses on consequences. And by that I mean the consequences of the evaluation. Some might call it outcomes. 3. Systemic evaluation design emphasises what to leave out rather than what to put in. It is not possible to include everything that happened in the intervention, nor possible to include every single perspective or viewpoint or framing of the intervention." (Page ii)
more
"Evaluation Practice for Collaborative Growth highlights the approaches, tools, and techniques that are most useful for evaluating educational and social service programs. This book walks the reader through a process of creating answerable evaluations questions, designing evaluation studies to answe
...
r those questions, and analyzing, interpreting, and reporting the evaluation's findings so they are useful and meaningful for key stakeholders. The text concludes with a devoted to the shifting landscape of evaluation practice as it faces complex systems and issues that are shaped by society. Additionally, the author provides a list of knowledge and skills needed to adapt to a changing landscape and encourages organizations to use evaluation as a mechanism for learning and adapting to change. Her orientation toward community-based approaches and social justice prevail throughout the book's content and align well with a reader's desire to be inclusive and accountable in programing efforts. Nonprofit leaders, social science professionals, and students will find this book helpful for understanding basic program evaluation concepts, methods, and strategies." (Publisher description)
more
"Demystifying Evaluation is an accessible introductory guide explaining the options open to evaluators and how to make appropriate choices of research methods, covering issues such as managing expectations of evaluation, quantitative and qualitative methods, engaging stakeholders and providing actio
...
n-orientated approaches to help end-users." (Publisher description)
more
"This guide is designed for anyone who wants to learn how communication can more effectively support evaluation: evaluation consultants, communication consultants, evaluation commissioners and programme/project staff participating in evaluations. The guide is structured around three broad phases of
...
the evaluation process: before, during and after. The guide aims to provide advice and practical hints on how to use communication for each of these phases. A communication plan of action template adapted for evaluation is provided at annex 1. Examples of innovative communication tools for evaluation are found at annex 2. A case study is included at annex 3 that can be used for learning purposes. Links to extra resources are found at annex 4. The guide explains how to use communication to support evaluation and readers can adapt and use these approaches depending upon the stage of the evaluation process, their own context and available resources." (Page 4)
more
"In order for evaluations to satisfy both the requirements of the implementing organisation and donors’ requirements, it is important that the process is properly planned and supported and that the scheduled timescale is adequate. When do I start planning? What constitutes high-quality Terms of Re
...
ference? How do I assess whether a report is good or bad? These are typical questions that arise during an evaluation process. These guides have been produced to provide employees and partner organisations of Brot für die Welt – Evangelischer Entwicklungsdienst (Bread for the World – Protestant Development Service) with practical assistance during the evaluation process. The evaluation process has been divided into ten steps. A guide has been produced for each of these process steps. The guides can be used independently of one another. There is also an introductory guide that contains basic information about the topic of evaluation. The data-collection step is performed by the external evaluators, meaning that there is no guide for this step. Each guide explains what needs to be considered during this step, why it is important and who needs to be involved. The aim is to provide important tips and assistance as to how the individual steps can be implemented. The guides are specifically tailored to external evaluations, but they also contain relevant information for other evaluation forms." (Foreword)
more
"At the W.K. Kellogg Foundation, we believe that evaluation is an effective management tool to both inform strategy development and track the progress and impact of strategy implementation. We have long been committed to supporting our grantees’ ability to derive and share lessons learned from the
...
ir work. To that end, the foundation published the first Evaluation Handbook (The Kellogg Foundation, 1998) almost two decades ago to guide evaluation for our grantees. Since that time, as the discipline of evaluation grew and expanded, the demand for evaluation has risen. More and more nonprofit leaders and practitioners strive to design evidence-based programs, and more and more funders require their grantees to provide evidence to demonstrate the success of their funded work. The democratization of evaluation makes it necessary that evaluation is both rigorous and practical. How to achieve the balance motivated us to update the handbook. Over the years, the foundation has learned a lot from our grantees about the challenges of evaluation. This handbook is our continuous effort to demystify evaluation and facilitate its use, for the foundation’s grantees and for all organizations committed to learning and strengthening their work. It is designed for people who have little to no exposure to formal evaluation training and provides a starting point for them as they consider evaluating their work. It is intended to help them become more informed consumers of evaluation. Evaluations can be simple or extensive depending on the scope and complexity of the work being evaluated. The scope of the evaluation could potentially include a single program, a multi-site initiative, or a multifaceted strategy aimed at systems and community change. Regardless of the complexity of the effort, the basics for evaluating it remain the same and this handbook was written to impart information about these basics." (Foreword)
more
"As part of our ongoing work to strengthen our support for communities, the trustees and staff of the Otto Bremer Trust engaged in a series of learning seminars on evaluation. In order to make the core concepts easily accessible and retrievable, we asked Michael Quinn Patton, who led the seminars, t
...
o create a set of basic reference cards. These became the Evaluation Flash Cards presented here, with the idea that a core concept can be revisited “in a flash.”
more
"The goal of this handbook is to provide guidance to practitioners and organizations interested in evaluating mental health prevention and early intervention (PEI) programs. In the course of developing an evaluation plan for a series of PEI programs implemented statewide by the California Mental Hea
...
lth Services Authority (CalMHSA), we found many resources that discussed general approaches to evaluating mental health programs and policies but few that discussed how to tailor an evaluation approach to mental health PEI activities in particular. PEI activities may require different evaluation strategies than treatment interventions do. First, the activities being administered are different in that they are not clinical interventions. Indeed, PEI activities are highly diverse and provided in many different types of nonclinical settings. Thus, the process outcomes that are used as indicators of successful implementation tend to look different for PEI interventions." (Introduction)
more
"There are many different types of evaluation. Each type has its own set of processes and/or principles. Many factors influence decisions over what type of evaluation to use. Evaluations can be categorised according to their purpose, who conducts them, when they are carried out, the broad approach u
...
sed, and cross-cutting themes. Many CSO evaluations don’t use any particular methodology or approach." (Introduction)
more
"Utilisation-focused evaluations (UFEs) are based on the principle that an evaluation should be judged according to how useful it is. UFEs should be planned and implemented in a way that increases the likelihood of the findings being used. This normally means identifying the primary users of an eval
...
uation and ensuring that they are engaged in decision-making throughout the process." (Introduction)
more