"The Monitoring and Evaluation Capacity Assessment Toolkit (MECAT) is a set of tools that guide organizations1 through a process to assess their current monitoring and evaluation (M&E) capacity, identify gaps, and plan ways to strengthen their M&E systems. MECAT uses four methods and supporting tool
...
s in the assessment process: (1) a group assessment, (2) an individual assessment, (3) key informant interviews, and (4) a desk review. With this approach, organizations, national health programs, and subnational health teams can accurately assess program strengths and weaknesses and plan the steps needed to strengthen the M&E functions." (Introduction)
more
"Some programme indicators are designed to be collected at programme level. Others are designed to capture, summarise or aggregate information collected at project or partner level. It is important to clarify how information on indicators is transmitted between different levels of a programme." (Int
...
roduction)
more
"This report described a pilot study using the VOTO Interactive Voice Response (IVR) platform to 1) distribute content and 2) collect quantitative and qualitative monitoring and evaluation data regarding a media program in Rwanda. In addition to showing that the VOTO system worked well as a distribu
...
tion tool (though expensive) – our findings suggest great potential for the use of IVR as an M&E tool. Unfortunately, we cannot recommend a particular system as yet having the capacity to offer an efficient and cost-effective system for NGOs looking to collect qualitative and quantitative data cheaply and accurately." (Discussion, page 13)
more
"This guide shows, besides other things, how to implement the traffic light function of Excel. Aside from this function, it is in general very easy to visualize information with Excel. In this respect, the progress of indicators along the results chain of a project, but also the cash flow can be gra
...
phically presented [...] Another goal of this manual is to stress the point that Excel is much more than a static tool in which data can be handled in tabular format. By means of cross-linking data, the whole monitoring system becomes dynamic so that the whole data processing works nearly automated. Time and resource intensive double entries of information can be avoided, since the majority of data can be updated, calculated and visualized automatically." (Introduction)
more
"Monitoring and evaluation of advocacy for development is an emerging field. Many civil society organisations, donors and evaluators are now involved with advocacy. Questions of how to understand and assess programmes are urgent. This e-book seeks to contribute to practical capacity on this front on
...
the basis of lessons learned during the largest evaluation of advocacy for development in history." (Preface)
more
"The handbook is based on the authors’ varied experiences from consulting the implementation of media mappings in several transitional countries and it will focus on two of these projects: a. mapping the Mongolian media landscape initiated in 1999 ten years after the break down of Communism and b.
...
the mapping of the Libyan media landscape initiated in 2012 one year after the Libyan revolution in 2011 and the ouster of Muammar Qaddafi. Developing on the experiences from these two projects and subsequent reflections the authors investigate why the Mongolian project was a success and still operating and in turn why the Libyan was far less successful despite similar methodological approaches. On the basis of these experiences the authors provide a description of a number of general circumstances that the authors recommend should be taken into account before and during the process of setting up a media mapping capacity." (IMS website)
more
"This report presents an evaluation of the utility of social media for conducting research, monitoring and evaluation in the MENA region, using a case study approach. The Twitter based reaction to the reported cancellation/reduction of food provision by World Food Programme (WFP) for Syrian Refuges
...
was taken as the case study [...] The application of frequency analysis to the case study showed that information regarding ebb and flow of the popularity or awareness of the cuts to the WFP could be obtained from Twitter. Spikes in popularity or awareness on Twitter related to key reports in the media relating to the cuts. These spikes were subjected to further analysis using topic classification. Simple topic classification was performed on the spikes identified in the frequency analysis. Wordclouds are simple but effective methods for viewing the high-level discussion on social media. Words are sized in the wordcloud based on their frequency – the bigger the word, the more frequently it is used. The accounts @60Minutes and @bbcworld were dominant in the visualizations, confirming the broadcast reaction on Twitter. To further refine the analysis these Twitter accounts were visualised in retweet networks. Social Network graphs were used to visualise interactions between accounts posting about cuts to the WFP on Twitter. The size of nodes (accounts) in the graphs corresponded to amount of interactions with other nodes (accounts), indicating their relative importance in propagating information about the cuts to the WFP on Twitter. The graphs also identified nodes (accounts) that acted as bridges for information to travel from one Twitter community to another." (Executive summary)
more
"This toolkit is designed for development practitioners, government officials, academics, monitoring and evaluation specialists, and researchers who are interested in measuring empowerment. The learning objectives of this toolkit are: Users gain a general understanding of empowerment and empowerment
...
indices, the importance of measuring empowerment and how a framework can help to measure empowerment. Users understand the various dimensions of COL’s Three-Dimensional Empowerment Framework and how it aligns with the definition of empowerment. Users learn what Likert questions are and some best practices for developing them. Users are able to use the framework to develop a range of Likert questions that address the various facets of empowerment. Users are able to enter data, calculate the index scores and do basic preliminary/ descriptive analysis in Microsoft Excel." (Page 1)
more
"The IDEAS Guide is for organisations and people who are doing small media and communication projects. It is designed to cater for a range of different skill levels in evaluation. It is ideal for project managers and team members responsible for reporting and evaluation, as well as any other partici
...
pants who are interested in evaluation. The IDEAS Guide leads you through the process of designing a project, and thinking about the project’s evaluation. The guide is focused on how to do useful evaluation for learning and continual project improvement. To achieve this, it is important to think about the evaluation of the project as you design it, and to learn from evaluation during the implementation of the project. Focusing on what you can learn by carrying out a project is especially important when the project idea is new and innovative." (Introduction, page 5)
more
"The IDEAS Facilitators’ Guide provides briefing notes on how you, as a facilitator, can support small-grant recipients to use the IDEAS Guide to clarify their project design, and to plan and manage their evaluation. The Facilitators’ Guide is best used in conjunction with the IDEAS Guide. These
...
guides are designed to be used together in the planning and implementation of a workshop. Facilitators can also adapt the steps to suit the mode and length of delivery. The Facilitators’ Guide was developed to accompany the IDEAS Guide to help facilitators to effectively support capacity development for individuals working in grassroots and community organisations who might have little or no experience of evaluation. It may also be helpful for more experienced practitioners. The approach integrates evaluation into the design of projects." (Page 4)
more
"This one-of-a-kind book fills a gap in the literature by providing readers with a systematic approach to monitoring and evaluation (M&E) training for programs and projects. Bridging theoretical concepts with practical, how-to knowledge, the authors draw upon the scholarly literature, applied resour
...
ces, and over 50 years of combined experience to provide expert guidance that can be tailored to different M&E training needs and contexts, including those for novices, professionals, organizations and their staff, community members, and other groups with a desire to learn and sustain sound M&E practices." (Publisher description)
more
"El presente artículo aborda la construcción del Índice de Rentabilidad Social en Comunicación (IRSCOM), que pretende recoger valores ligados al funcionamiento de los medios audiovisuales, eludiendo la visión mercantilista, potenciando la participación ciudadana y la transparencia en su gesti
...
n. Este indicador es una propuesta que persigue corregir las deficiencias en la rentabilidad social de los medios para consolidar modelos mediáticos que respondan a lógicas centradas en la construcción democrática, la fortaleza de la pluralidad y la diversidad." (Resumen)
more
"This paper on behavior change constitutes one of two methodology papers (the other being on service delivery) that establish a new lens through which to understand the World Bank’s portfolio in IEG (Independent Evaluation Group) evaluations. The paper outlines the economic and psychosocial theori
...
es that have led to an array of frameworks for helping policy makers design behaviorally conscious interventions. After establishing criteria for an evaluative behavior change framework suitable for World Bank projects and finding that none of the existing frameworks fits that set of criteria, this paper proposes a new framework, CrI2SP, which categorizes elements of World Bank projects, and introduces an evaluative framework for capturing the degree to which behavioral considerations have been integrated into World Bank projects. The CrI2SP framework and the coding template have been developed and refined as they have been applied to 33 World Bank projects." (Summary)
more
"Robust monitoring, evaluation, reporting, and learning (MERL) are critical components of successful programming. The MERL components enable program stakeholders to monitor progress and evaluate the achievement of expected results. Reporting processes and timelines should be clearly defined and tail
...
ored to meet the needs of key audiences and stakeholders, and provision should be made for the program to continually reflect and learn from experiences gained during implementation. Measuring the success of peacebuilding programs poses specific challenges that are unique to this program area. This module was developed to guide PEACE III local program partners—peacebuilding practitioners—through the development and implementation of effective and practical MERL systems for their projects. This five-year cross-border peacebuilding program is implemented by Pact in partnership with Mercy Corps and a range of local partners with activities in Ethiopia, Kenya, Somalia, South Sudan, and Uganda. PEACE III aims to strengthen cross-border conflict management in the Horn of Africa and is pursuing two related objectives: 1) to strengthen local cross-border conflict management and 2) to improve the responsiveness of regional and national institutions to cross-border conflict. This manual was created to support and provide examples to peacebuilding practitioners and is an addition to Pact’s existing MERL Modules. Other useful examples of MERL training manuals for peacebuilding programs exist. This module does not seek to replicate those manuals, but rather draws on them and integrates their expertise here. Parts of this manual were also drawn from Pact’s MERL Modules but customized with practices and examples relevant for peacebuilding programs. It is the authors’ hope that this module can serve as an introduction to MERL for peacebuilding practitioners and can point them to other relevant resources in the field. Each begins with an outline of the learning objectives, includes learning activities throughout the chapters, and ends with a summary of key points and learning." (Introduction)
more
"This Module is not about placing a value on artistic expression, but rather about capturing the true impact of Participatory Theatre for Change (PTC) and helping advance the field through the development of vetted best practice. As discussed in the Module, this starts with design, focusing on the i
...
mplementation context and understanding the full dynamics in which PTC activities will take place. The Context Analysis process will help determine how PTC can best be utilised in the implementation environment, how complex the programme should be, and if there are additional activities needed to ensure impact. The information from preliminary design thinking and the Context Analysis then supports the identification and contextualization of the key interrelated theories of change that apply to the programme, serving as a foundation from which the activities can be evaluated. Monitoring then allows for an iterative process of designing individual performances, engaging appropriately and in a context sensitive manner with the community, as well as determining if the PTC activities as implemented are trending towards impact. Regular monitoring helps with course corrections when needed, and leads towards more effective programming. The monitoring of the process and quality helps ensure that the performances are doing no harm, artistic expressions, and implemented in such a manner as to achieve Reach, Resonance, and Response. Monitoring provides the temperature checks to make sure the ecosystem of PTC is balanced. And finally, evaluation helps push PTC programming to the next stage. Strong evaluations provide the community with more information about changes that have happened, even self-reflection through participatory methods. Evaluations also enable the actors to learn about the bigger picture of what worked and did not work beyond the immediacy of the performance space and towards the longer term impacts. It enables informed follow-on activities, as well as learnings that can be shared with the broader field to enhance practice more globally. Lastly, evaluations provide evidence of the great work participatory theatre does as a nuanced, emotionally connected, and transformative approach to communications for development." (Conclusion, pages 38-39)
more
"The Social Impact Navigator provides an accessible introduction to the issue of impact orientation. We want to show you how with simple steps, you can plan and implement your project in an impact-oriented way and analyze your results. We present instruments suitable for everyday use that will give
...
you practical help in integrating an impact orientation into your project work, and support you as you address the issue of impact orientation inside your organization. Above all, we want to motivate you to engage with the issue yourself. Who is the target audience? This publication is directed toward non-profit and other civil society organizations, and their projects and programs that have as yet had only limited experience with the issues of impact orientation and social impact analysis. We want to show that by taking simple, small steps, even organizations with limited resources for monitoring and evaluation can review the effectiveness of their work and learn from these results." (About the guide, page 9)
more
"The 2016 Norms and Standards, now consolidated into one document, are interrelated and mutually reinforcing. The ten general norms should be upheld in the conduct of any evaluation; the four institutional norms should be reflected in the management and governance of evaluation functions. The associ
...
ated standards support the implementation of these normative principles. The 2016 Norms and Standards will serve as the framework for the UNEG evaluation competencies, peer reviews and benchmarking initiatives. UNEG guidance documents provide further details and guidance on implementation of these Norms and Standards and on evaluation practice within their framework. In some areas, UNEG working groups are updating or developing new guidance where gaps exist, informed by the practical experience of UNEG members and global good practices." (Preamble)
more
"In times of digital transformation media all over the world have to come up with new ways to ensure their survival. Meanwhile, media development actors are searching for new concepts and orientation in their support of media organizations and media markets. This paper presents DW Akademie’s sugge
...
stion for new indicators to measure economic viability. The criteria not only take into account the financial strategies and managerial structures of individual media outlets, but also the overall economic conditions in a country as well as the structures of the media market needed to ensure independence, pluralism and professional standards. After all, money talks – and media development should listen." (Executive summary)
more