mediadev library

Filter

105

Sort by:

Direction:

Google Scholar (14)

WorldCat (13)

Are We Making a Difference? Global and Local Efforts to Assess Peacebuilding Effectiveness
Inspiring Practice

Top Insights

Stacey L. Connaughton, Jasmine R. Linabary (eds.)

Lanham et al.: Rowman & Littlefield (2024), xxvii, 320 pp.

"Sections of the book engage in critical reflection on what peacebuilding effectiveness is and who gets to decide, provide practical examples and case studies of the successes and failures of assessing peacebuilding work, and support innovative strategies and tools to move the field forward. Chapter ... more

External Link (19)

Impact Framework for Media Projects. Toolkit

International Media Support (IMS);Local Media for Democracy Project;European Federation of Journalists (EFJ);Journalismfund Europe;Centre of Media Pluralism (2024), 13 pp.

"The impact framework is a set of tools and guidelines that helps to define targets for, track, and assess the impact of activities under the supported media projects in a clear and organised way; it can also be used for other media projects. Its methodology embraces a user-centric approach, links p ... more

External Link (5)

Monitoring and Evaluation for Digital Security Training

Kate Long, Ellie Cole

Internews (2023), 87 pp.

Google Scholar (12)

WorldCat (13)

Utilization-Focused Evaluation
Key Guidance

Michael Quinn Patton, Charmagne E. Campbell-Patton

Thousand Oaks et al.: Sage, 5th ed. (2022), xxiv, 406 pp.

"The Fifth Edition of the bestselling 'Utilization-Focused Evaluation' provides expert, detailed advice on conducting evaluations that promote effective use of the findings. Chock full of useful pedagogy, this book presents Michael Quinn Patton's distinctive opinions based on more than forty years o ... more

External Link (12)

Guide sur la mesure de l'évaluation (M&E) d'impact à destination des associations

ISD (2022), 17 pp.

Download (3)

Impact Evaluation in International Development: Theory, Methods and Practice
Key Guidance

Paul Glewwe, Petra Todd

Washington, DC: World Bank (2022), xix, 401 pp.

"This book is written to provide detailed, rigorous guidance on how to conduct impact evaluations of government and nongovernment programs and projects. It covers all the leading quantitative impact evaluation methods, explaining the assumptions required for them to provide unbiased estimates and th ... more

Download (2)

How to conduct an online participatory outcomes evaluation workshop: Analysis and strategic learning

Barbara Klugman

Manchester: Women in Informal Employment: Globalizing and Organizing (WIEGO) (2022), 40 pp.

"This tool is on how to categorize and analyse outcomes already harvested with informal workers in an online workshop using Tool 7, and how to use this analysis to discuss achievements, challenges, and strategy with the same participants. Tool 7 took you through how to support participants in a work ... more

Download (1)

How to conduct a participatory outcomes evaluation workshop: Analysis and strategic learning

Barbara Klugman

Manchester: Women in Informal Employment: Globalizing and Organizing (WIEGO) (2022), 19 pp.

"This tool is on how to categorize, analyse and interpret outcomes already harvested using Tool 5, in a workshop setting. Tool 5 takes you through how to support participants in a workshop to harvest: WIEGO outcomes – that is changes made by informal workers, Nets or MBOs1 that WIEGO has influence ... more

Download (2)

How to conduct a participatory evaluation workshop: Harvesting outcomes

Barbara Klugman

Manchester: Women in Informal Employment: Globalizing and Organizing (WIEGO) (2022), 20 pp.

"A great way to find out if WIEGO’s interventions – trainings or other kinds of supports to Nets and MBOs – have worked well, or if people have used our tools and materials, is to engage them in a follow-up evaluation workshop. This Tool 5 takes you through the process of supporting participan ... more

Download (1)

How to write an outcome statement

Barbara Klugman

Manchester: Women in Informal Employment: Globalizing and Organizing (WIEGO) (2022), 14 pp.

"In your day to day work you notice changes that others are making, influenced by WIEGO. How do you capture these to support WIEGO’s learning? This tool provides an explanation of what to look for, and a template for documenting outcomes, why they matter (their significance) and how WIEGO or WIEGO ... more

Download (2)

How to conduct an online participatory evaluation workshop: Harvesting outcomes

Barbara Klugman

Manchester: Women in Informal Employment: Globalizing and Organizing (WIEGO) (2022), 30 pp.

"This Tool 7 is an online version of Tool 5 of the WIEGO MLE Toolkit: How to conduct a participatory workshop: harvesting outcomes. That tool discusses the rationale and gives illustrative examples of running a participatory OH workshop, and these are not repeated here. Please read them first. Tool ... more

Download (2)

Using Big Data for Impact Evaluations

F. Rathinam, P. Thissen, M. Gaarder

Oxford: Centre of Excellence for Development Impact and Learning (CEDIL) (2021), 7 pp.

"Big data can contribute to the evidence base in development sectors where evaluations are often infeasible due to data issues. Given the rapidly increasing availability of big data and improving computation capacity, there is a great potential for using big data in future impact evaluations. Big da ... more

Download (2)

20 years of Outcome Mapping: Evolving practices for transformative change

Outcome Mapping Learning Community (2021), 11 pp.

"To mark 20 years of Outcome Mapping, this paper explores the core principles and concepts that are foundational to using the approach. It also presents a set of guiding practices to support transformative change. Three principles inherent in Outcome Mapping: 1. Social, policy & systems changes depe ... more

External Link (13)

Is There Lasting Change, Five Years After EveryChild’s Exit? Lessons in Designing Programmes for Lasting Impact

Lucy Morris

Oxford: INTRAC (2021), 19 pp.

Download (2)

Process Tracing as a Practical Evaluation Method: Comparative Learning from Six Evaluations

Alix Wadeson, Bernardo Monzani, Tom Aston

[authors] (2020), 31 pp.

"This paper presents comparative learning from the evaluation of six international development initiatives that applied various forms of Process Tracing. While these initiatives span across diverse contexts and pursued different aims, they are connected by a common thread: all six case studies centr ... more

Download (1)

Decoding Media Impact: Insights, Advice and Recommendations

Katie Donnelly

Philadelphia, Penns.: Media Impact Funders (2020), 31 pp.

"This guide is meant to serve as a practical resource for funders who want to understand where to start. Informed by feedback from our network, it represents a synthesis of the past seven years of work we’ve done in the impact space, and includes examples of successful media impact evaluation, too ... more

Download (2)

How to Perform Impact Assessments: Key Steps for Assessing Communication Interventions

James Dennison

International Centre for Migration Policy Development (ICMPD);EUROMED Migration (2020), 29 pp.

"This report brings together disparate terminology, findings and recommendations from the private and public sectors and academia to synthesise a set of five general steps for practitioners when performing impact assessments. Impact assessment (IA) compares a variable of interest after an interventi ... on (e.g. a communication campaign) to what it would it be if that intervention had never happened. Accompanying each of the five steps are examples of how migration communicators can assess the impact of campaigns to, first, change attitudes and, second, change behaviour. Step 1: Set objectives for the intervention that define what the desired effect is. Ideally, this should (1) meet the SMART criteria of specific, measurable, attainable, relevant and timebound; (2) focus on ultimate outcomes, rather than only outputs; (3) avoid a number of common mistakes in setting objectives and (4) carefully consider what the—as specific as possible— target audience is. Step 2: Identify a measure of the impact(s) that the intervention has as its objective. These should be (1) clearly defined and unambiguous; (2) externally valid (they act reliably if used for other interventions) and (3) internally valid (they measure what they claim to measure). There already exist long-lists of measures (also known as indicators) to choose from. Step 3: Estimate what would have happened had there been no intervention, known as a ‘counterfactual’. Ideally, but not necessarily, this requires performing a pre-intervention measurement, also known as baseline assessment. However, this is not always possible. This should not dissuade practitioners but instead assumptions of any IA, as discussed below, should be made openly. A long list of methods for measurement, including sampling considerations, are provided. Step 4: Perform the intervention. This may involve separating a randomised sample into a treatment group(s)—that receives the intervention(s)—and a control group—that does not. If this is not feasible, other forms of counterfactual are possible that ‘construct’ a control group. This section also overviews: (1) types of communication campaigns; (2) the MINDSPACE checklist of behavioural influences for interventions; (3) key recommendations on persuasive interventions from ICMPD’s previous work; (4) recommendations on campaigns deterring irregular migration. Step 5: Post-intervention measurement and analysis: (1) those receiving the intervention should be measured post-intervention (ideally, as well as, either a genuine or constructed control group); (2) the impact must be calculated: usually the difference in the variable of interest pre- and post-intervention and/or between the treatment and control group; (3) theoretical consideration of why and what aspect of the campaign caused an impact; are the findings likely to be universalizable?; (4) creation (and, in some cases, incorporation) of recommendations based on combination of impact and theoretical considerations." (Executive summary) more

Download (1)

Comment réaliser des évaluations d’impact : étapes clés pour évaluer les actions de communication

James Dennison

International Centre for Migration Policy Development (ICMPD);EUROMED Migration (2020), 30 pp.

"Ce rapport réunit une terminologie hétérogène, des conclusions et des recommandations émanant des secteurs privé et public et du monde universitaire pour définir un ensemble de cinq étapes générales à suivre par les professionnels lors de la réalisation d’une EI. L’EI compare une va ... riable étudiée après une action (par ex. une campagne de communication) à ce qu’elle serait si cette action n’avait jamais eu lieu. Accompagnant chacune des cinq étapes, nous présenterons des exemples de la façon dont les communicants en migration peuvent évaluer l’impact des campagnes pour, d’abord, modifier les attitudes et, ensuite, changer les comportements. Étape 1 : Fixer des objectifs pour l’action qui définissent l’effet souhaité. Dans l’idéal, ils devraient (1) correspondre aux critères SMART : spécifique, mesurable, atteignable, pertinent et temporellement défini; (2) se concentrer sur les résultats finaux, plutôt qu’uniquement sur les produits; (3) éviter certaines erreurs courantes dans la définition des objectifs et (4) déterminer de façon aussi spécifique que possible l’identité du public cible. Étape 2 : Identifier une mesure de l’impact ou des impacts de l’objectif de l’action. Ces impacts devraient être (1) clairement définis et non ambigus; (2) valides d’un point de vue externe (ils restent fiables s’ils sont utilisés pour d’autres actions) et (3) valides d’un point de vue interne (ils mesurent ce qu’ils prétendent mesurer). Il existe déjà de longues listes de mesures (également connues sous le nom d’indicateurs) parmi lesquelles il est possible de choisir. Étape 3 : Estimer ce qui se serait passé si l’action n’avait pas eu lieu, ou situation « contrefactuelle ». Idéalement, mais pas nécessairement, cela implique la réalisation de mesures en amont de l’action, également connues sous le nom d’évaluation de base. Néanmoins, ce n’est pas toujours possible. Cela ne devrait pas dissuader les professionnels, en revanche, les hypothèses relatives aux EI devraient faire l’objet d’une discussion ouverte, comme évoqué ci-dessous. Une longue liste de méthodes de mesure, y compris des considérations liées à l’échantillonnage, sont fournies. • Étape 4 : Réaliser l’action. Cela peut impliquer de séparer un échantillon aléatoire en un ou plusieurs groupes traités, qui font l’objet de l’action/des actions, et un groupe témoin, qui n’en fait pas l’objet. Si cela n’est pas faisable, d’autres formes de situations contrefactuelles sont possibles pour « construire » un groupe témoin. Cette section aborde également : (1) les types de campagnes de communication; (2) la check-list MINDSPACE d’influences comportementales pour les actions; (3) les recommandations clés portant sur les actions persuasives issues des travaux précédents de l’ICMPD; (4) les recommandations relatives aux campagnes de dissuasion de la migration irrégulière. • Étape 5 : Mesures et analyses en aval de l’action : (1) ceux qui ont bénéficié de l’action doivent faire l’objet de mesures en aval de l’action (idéalement dans le cadre un groupe témoin authentique ou construit); (2) l’impact doit être calculé : généralement la différence entre la variable étudiée en amont et en aval de l’action et/ou entre le groupe traité et témoin; (3) réflexion théorique sur les raisons et les aspects précis de la campagne qui ont causé un impact; les conclusions sont-elles transposables ?; (4) création (et, dans certains cas, incorporation) de recommandations basées sur la combinaison de l’impact et des réflexions théoriques." (Résumé) more

Download (2)

Managing Outcomes: A Practitioner's Manual for Analysis, Planning, Monitoring and Self-Evaluation Based on Outcome Mapping

Christian Kuijstermans et al.

Cologne: AGIAMONDO (2020), vi, 114 pp.

"Outcome Mapping was developed 20 years ago by the International Development Research Centre and for many in the development sector it has become a staple in planning, monitoring and evaluation toolkits. Countless organisations across the world have applied and adapted Outcome Mapping for their own ... more

Download (1)

Wozu Non-Profit-Journalismus? Ein Report zu gemeinnützigem Journalismus – mit Wirkungslogiken, Qualitätskriterien und Tipps für Förder*innen
Key Guidance

Charlotte Buttkus, Igor Ryabinin, Florian Hinze

Berlin: PHINEO gemeinnützige AG (2020), 63 pp.

"Der Report „Wozu Non-Profit-Journalismus?“ macht sich für eine dritte Säule im Mediensystem stark: Der gemeinnützige Journalismus hält der Krise Antworten entgegen und leistet als Ergänzung zum öffentlich-rechtlichen und privaten Verlagsjournalismus einen Beitrag zur Medienvielfalt. Er is ... more

Are We Making a Difference? Global and Local Efforts to Assess Peacebuilding Effectiveness Inspiring Practice Top Insights

Utilization-Focused Evaluation Key Guidance

Impact Evaluation in International Development: Theory, Methods and Practice Key Guidance

Wozu Non-Profit-Journalismus? Ein Report zu gemeinnützigem Journalismus – mit Wirkungslogiken, Qualitätskriterien und Tipps für Förder*innen Key Guidance

Are We Making a Difference? Global and Local Efforts to Assess Peacebuilding Effectiveness
Inspiring Practice

Top Insights

Utilization-Focused Evaluation
Key Guidance

Impact Evaluation in International Development: Theory, Methods and Practice
Key Guidance

Wozu Non-Profit-Journalismus? Ein Report zu gemeinnützigem Journalismus – mit Wirkungslogiken, Qualitätskriterien und Tipps für Förder*innen
Key Guidance