"Sections of the book engage in critical reflection on what peacebuilding effectiveness is and who gets to decide, provide practical examples and case studies of the successes and failures of assessing peacebuilding work, and support innovative strategies and tools to move the field forward. Chapter
...
s reflect a variety of perspectives on peacebuilding effectiveness and methods—quantitative, qualitative, and participatory—to evaluate peacebuilding efforts, with particular attention to approaches that center those local to the peacebuilding process. Practitioners and policymakers alike will find useful arguments and approaches for evaluating peacebuilding activities and making the case for funding such efforts." (Publisher description)
more
"The Learning Power of Listening guide is intended for those who wish to coordinate, participate in, or support the use of SenseMaker—a complexity-aware, narrative-based method—in conducting assessments, monitoring progress, and carrying out evaluations or research. The guide can be used for per
...
sonal reference or for training others involved in a SenseMaker process. The experiences on which the guide is based, as well as the examples used, focus mainly on development programs, and particularly on efforts that focus on poverty reduction, social justice, peacebuilding, resilience, behavioral change, and restoring and protecting natural resources. They come from organizations and programs that have used SenseMaker over the last decade. The guide starts with considerations for judging the suitability of the method, followed by descriptions of the four phases of any SenseMaker process. Besides detailed guidance on preparing for and implementing a SenseMaker process, examples, and advice are offered for each phase. Despite its practical focus, this is not a do-it-yourself guide: there is no shortcut to learning SenseMaker. Mastering its practice requires deep, hands-on involvement in at least one to two processes from start to finish. Guidance from an experienced SenseMaker practitioner is also recommended. The guide summarizes practices that have evolved in international development, providing practical tips and examples of context-specific adaptations." (About this guide, page 9)
more
"While social media offer an unprecedented opportunity for orchestrating large-scale communication campaigns, it is often difficult to track audience responses on various digital platforms over time and to ascertain if their engagement is aligned with the original intention. In this article, we shar
...
e a promising solution—the purposive embedding and tracking of unique content elements as “markers” using text analytics techniques. Four markers were introduced in an Indian melodramatic television serial, Main Kuch Bhi Kar Sakti Hoon (I, A Woman, Can Achieve Anything), which was part of a larger transmedia edutainment initiative in India to promote sanitation, family planning, and gender equality. These markers served as anchors for audience engagement with the originally intended messaging embedded in the narratives as well as for program monitoring and evaluation. We applied various web-based tools to systematically track marker-related engagement on Facebook, Twitter, and YouTube across eight months. We also conducted semantic network analysis to better understand how marker-related social media comments evolved over time. Our investigation of using markers for digital engagement and narrative exchange in MKBKSH makes an important and timely methodological contribution to the scholarship and praxis of social and behavior change communication." (Abstract)
more
"This glossary provides conceptual clarity on common terms used in results based management, monitoring and evaluation. This 2nd Edition includes new terms, as well as updates and improvements to the original Glossary published in 2002. It is intended to support thoughtful approaches to results-base
...
d management, monitoring and evaluation, which in turn support better progress on sustainable development through learning and accountability." (Page 1)
more
"The Footprint Evaluation Initiative aims to ensure that all evaluations consider environmental sustainability, regardless of whether this is an explicit objective of the project, policy or program being evaluated. This report describes four ‘thought experiments’ undertaken as part of this proje
...
ct. The thought experiments explored whether it is relevant, feasible and useful to consider environmental sustainability in evaluation, how this might be done, what challenges and issues it raises, and what is needed to address these. This report aims to document and share what we learned during this process, provide concrete examples of how environmental sustainability might be considered in an evaluation, and share details of our thought experiment process that others might find helpful." (Summary)
more
"Network results can be divided into different categories, such as network vibrancy, network connectivity and network effects. Monitoring and evaluation tools and methods need to be chosen to assess each of these areas separately, depending on the need. Network surveys and social network analysis ar
...
e two of the most common methods used to monitor and evaluate networks." (Introduction)
more
"Advantages and disadvantages of remote evaluations: Advantages: environmentally friendly and applicable in case of travel restrictions; a cost-effective and more efficient implementation is possible; reduction of the project staff's workload; flexibility in scheduling the data collection, interview
...
s, group discussions; integration of interviewees from different locations; online connection with interviewees facilitates second contact; flexible employment of interpreters; making use of digital tools. Disadavantages: making it difficult to develop a common understanding within the team of evaluators; lack of observations (e. g. equipment in laboratories, interviewees in the working environment); poorer contact quality with interviewees; risk that the momentum of the evaluation is lost and impressions disappear; less informal communication with interviewees and project team; strong focus on facts and more difficult consideration of the emotional level; more difficult assessment of the accuracy of recommendations; dependence on technology." (Background, page 4)
more
"Big data can contribute to the evidence base in development sectors where evaluations are often infeasible due to data issues. Given the rapidly increasing availability of big data and improving computation capacity, there is a great potential for using big data in future impact evaluations. Big da
...
ta can also contribute to evaluations through providing new ways to identify control groups and establish counterfactuals, and can strengthen the analysis with data on pre-programme trends, covariates, and sub-groups, as well as enabling better robustness analyses. However, there are several analytical, ethical, and logistical challenges that may hinder the use of big data in impact evaluations. Standards should be set for the reporting of data quality issues, data representativeness, and data transparency. More interaction is needed between big data analysts, remote sensing scientists, and evaluators." (Conclusion)
more
"Many systematic reviews are solely concerned with effectiveness or impact. While a review which tells you what works can help you decide what to do, it is of less use in telling you how to do it. Causal chain analysis-based systematic reviews, which analyse the working of a logic model or a theory
...
of change for an intervention, can give useful information on programme design and implementation. Causal chain analysis is not yet common in systematic reviews. This brief lays out what causal chain analysis is, the benefits of using it, and how to do so. The causal chain analysis approach is based on specifying the logic model for an intervention. A logic model provides the basis for the questions to be answered in the systematic review, the types of studies to be reviewed, coding forms, and analysis. The causal chain analysis identifies weak and missing links in the causal chain, and thus which assumptions in the logic model may not hold. Programme designers and implementers can learn from these lessons to achieve better development outcomes." (Box 1: Highlights, page 2)
more
"Training can take different forms. It can be carried out as a one-off exercise, or can be combined with other types of support, such as coaching or mentoring. The most well-known model for monitoring and evaluating training is the Kirkpatrick model, developed in the 1950s. A number of other models
...
are also used by CSOs. Most of these are variants of the Kirkpatrick model." (Introduction)
more
"This book presents five cases that reflect on the experiences of using practices consistent with the 'Evaluating C4D framework' [published by June Lennie and Jo Tacchi in 2013]. Case studies are important to help move from a set of ideal principles to an understanding of how the framework may be op
...
erationalized within the actual realities of development institutions, organizations, and communities. The authors of each chapter focus on a few key principles from the framework and contextualize how they interpreted those principles in relation to various methods, models, and projects. As well as showing the usefulness and opportunities, they illustrate the challenges of balancing the various principles as well as real-world practical needs." (Overview of the book, page 10)
more
"Spatially and temporally relevant ‘big data’ that does not require data collection in the field has the potential to provide insights into people’s economic, social, behavioural and political lives, and hence could be used in measuring key development outcomes. Big data consists of humangener
...
ated data including online searches, social media, citizen reporting or crowdsourced data, process-mediated data such as mobile phone call record details (CRD), commercial transactions data and machine-generated data from satellites, sensors or drones. The primary value of big data is that it is possible to measure outcomes that could not previously be measured using household surveys at the required temporal and spatial scale. The potential of big data to answer causal attribution, however, is still not widely understood, especially in low- and middle-income countries (L&MICs). The report is based on a map of the studies using big data and its objective is to discuss methodological, ethical and practical constraints relating to the use of big data. The systematic map includes impact evaluations (IEs) that use big data to evaluate development outcomes, systematic reviews (SRs) of big data IEs and other measurement studies that innovatively use big data to measure and validate any development outcomes. This study also explores the sectoral and geographical spread of big data's use in international development. This map includes studies written in English and published between 2005 and 2019, regardless of the target country's income level or population's status. We provide detailed breakdowns on the map for different country income classifications, fragile contexts and population characteristics. From the initial list of 17,393 studies we arrived at a final list of 437 studies, which included 48 IEs, 381 measurement studies and 8 SRs." (Executive summary)
more
"Many different tools and methodologies can be used to support advocacy work. Some are designed specifically for monitoring and evaluation (M&E) purposes. Others are designed to support the planning and management of advocacy interventions, but can be used or adapted for M&E purposes. CSOs often emp
...
loy several different tools and methodologies over the course of an advocacy intervention." (Introduction)
more
"Using a randomized encouragement design, we assigned 2,064 people to listen to either 'Ina Mafita' or to a control program (professional soccer matches) each week over the course of two months. Recruitment and engagement were conducted remotely via short message service (short message system [SMS]
...
or text message). The results indicate that the radio show 'Ina Mafita' had a positive effect on listeners’ beliefs about the importance of being a role model and a positive but not significant effect on the belief in local committees’ value in reintegrating at-risk youth. Results were more pronounced for high complier subsample and for those who reported liking the show’s story line. The authors found no effect on listeners’ views of kidnap victims. The researchers found no or possibly negative effects on listeners’ value of diversity, however, it must be noted that the show did not explicitly address this theme. Listeners also enjoyed the show and many continued to listen to the show after the incentivized exposure had concluded." (Key findings)
more
"CSOs sometimes need to summarise or aggregate information across multiple interventions. This can be a difficult and challenging task, especially for large non-governmental organisations (NGOs) working in many different countries and/or sectors. Summarisation and aggregation can be achieved through
...
a variety of methods. However, all come with associated costs." (Introduction)
more
"Evaluation: A Systematic Approach is the best-selling comprehensive introduction to the field of program evaluation, covering the range of evaluation research activities used in appraising the design, implementation, effectiveness, and efficiency of social programs. Evaluation domains are presented
...
in a coherent framework that not only explores each, but recognizes their interrelationships, their role in improving social programs and the outcomes they are designed to affect, and their embeddedness in social and political context. Relied on as the “gold standard” by professors, students, and practitioners for 40 years, the new Eighth Edition includes a new practical chapter on planning an evaluation, entirely new examples throughout, and a major re-organization of the book’s content to better serve the needs of program evaluation courses." (Publisher description)
more
"The idea of using mixed methods has a long tradition in social research. But it is also recognized that mixed methods are often poorly applied. In quantitative analysis, the qualitative component, if any, is often poorly designed, integrated or reported. These guidelines are to support the design,
...
conduct and reporting of mixed-methods in quantitative impact evaluations. That is, impact studies using a large statistical design with a qualitative component. The guidelines are based largely on the CEDIL inception paper by Jimenez et al. (2018), ‘Mixing and matching: using qualitative methods to improve quantitative impact evaluations (IEs) and systematic reviews (SRs) of development outcomes’, supplemented by a review of other relevant guidelines e.g. the CONSORT extension for development effectiveness (Bose, 2010)." (Page 1)
more
"Surveys and questionnaires are designed to collect and record information from multiple people, groups or organisations in a consistent way. Surveys and questionnaires can be used on their own as data collection tools. They are also an essential part of some more complex data collection and analysi
...
s methodologies. They can be used at any time within a project or programme cycle." (Introduction)
more