Toolbox Evaluation & Impact Assessment

Sort by:

Direction:

Meta-Synthesis of UN Women Evaluations on Advocacy and Communications

Ekaterina Dorodnykh, Soo Yeon Kim, Aileen Allen

New York; Independent Evaluation Service (IES): UN Women (2023), ix, 32 pp.

"This meta-synthesis collates evaluation insights and evidence on the advocacy and communications efforts related to the key results areas of UN Women’s Strategic Plan: Governance and Participation in Public Life; Women’s Economic Empowerment; Ending Violence Against Women; and Women, Peace and ... more

Download (4)

A Systematic Literature Review and Meta-Analysis of Studies on Online Fake News Detection

Robyn C. Thompson, Seena Joseph, Timothy T. Adeliyi

Information (MDPI), volume 13, issue 527 (2022), 20 pp.

"Despite the large number of studies on fake news detection, they have not yet been combined to offer coherent insight on trends and advancements in this domain. Hence, the primary objective of this study was to fill this knowledge gap. The method for selecting the pertinent articles for extraction ... more

Download (6)

Evaluating the impact of information campaigns in the field of migration: A systematic review of the evidence, and practical guidance

Jasper Tjaden, Sandra Morgenstern, Frank Laczko

Geneva: International Organization for Migration (IOM); Global Migration Data Analysis Centre (GMDAC) (2018), 50 pp.

"Information campaigns designed to raise awareness of the potential risks of (irregular) migration have attracted much attention and investment across the world in recent years. Studies have repeatedly shown that many migrants start their journeys with limited or biased information and end up in vul ... nerable situations. In response, information campaigns have increased in number and the type, format, messages and strategy of such campaigns have diversified. This report presents the results from a systematic literature review of evaluations of such information campaigns in the field of migration. The study reveals that the evidence base available for programming and policymaking in this area is strikingly limited. We find that the uptake in the use of information campaigns has far outpaced any rigorous assessment of the effects that different campaigns may have on their respective target groups. In the absence of reliable evidence, the debate on the potential of this policy tool often relies on largely anecdotal evidence. Better evidence can show how information campaigns can be designed to best achieve their intended effects given the particular circumstances. The current lack of evidence limits the impact of future campaigns. While rigorous assessment of campaign impact can be difficult and costly, better evidence is clearly needed – wherever feasible and appropriate. Based on an extensive, systematic literature review, 60 relevant evaluations of information campaigns that targeted potential migrants and traffickers, as well as communities at large, were identified from a pool of 3,600 records. Only 30 of the selected campaign evaluations had publicly available results; the rest were collected through expert referrals. Two studies were published in peer-reviewed journals. Among the campaigns featured in the 60 studies, the most popular communication tools were workshop-type activities and cable TV programmes/advertisements. Most campaigns focused on trafficking, followed by irregular migration and, more generally, smuggling. A common issue is the lack of a clearly defined campaign objective and/or target group. This hampers any rigorous evaluation of programme effects. Whenever an objective is defined, it is most often aimed at “awareness-raising” and “knowledge generation.” The majority of the campaign evaluations claimed that the campaign under study was “successful” in inducing a change in knowledge, perceptions, attitudes and – to a lesser degree – (intended) behaviour. However, most of the evaluations reviewed provided relatively little evidence of the full impact of information campaigns. While many of the evaluations reported the number and profiles of campaign recipients or beneficiaries, impact was not directly measured. (In the evaluation literature, impact is defined as a change in outcome that is directly attributable to the programme and not any other factor.) Most of the evaluations identified did not meet minimum standards for robust evidence on programme effects. The large majority of evaluations were based on based on cross-sectional surveys of small numbers of participants (N) sampled at convenience, limiting the generalizability of the results. Only a few large-N studies employed a control-group design or involved pre- and post-measurements. None employed a (quasi-)experimental method for causal inference (e.g. randomized controlled trial, which is considered the “gold standard” for measuring impact)." (Executive summary) more

Download (3)

Inclusive Rural Communication Services: Building Evidence, Informing Policy
Deep Insights

Rome: FAO; University of Queensland (2017), viii, 90 pp.

"This publication is the first scoping study aimed at compiling existing evaluation cases in the field of Communication for Development as applied to agricultural and rural development initiatives. It draws on a literature review and 19 cases across Africa, Asia-Pacific, Latin America and the Caribb ... more

External Link (48)

Google Scholar (47)

WorldCat (52)

Rethinking Media Development Through Evaluation: Beyond Freedom
Deep Insights

Jessica Noske-Turner

Cham: Palgrave Macmillan (2017), xiii, 176 pp.

"This book argues for an overhaul of the way media assistance is evaluated, and explores how new thinking about evaluation can reinforce the shifts towards better media development. The pursuit of media freedom has been the bedrock of media development since its height in the 1990s. Today, citizen v ... more

External Link (39)

Inclusión digital: Una mirada crítica sobre la evaluación del modelo Uno a Uno en Latinoamérica

Sebastián Benítez Larghi, Rosalía Winocur Iparraguirre (eds.)

Buenos Aires: Teseo (2016), 194 pp.

"En los últimos años, la mayoría de los gobiernos latinoamericanos han realizado esfuerzos destinados a mejorar la inclusión digital en sus países, desarrollando diversas políticas aplicadas en el ámbito educativo. Estas políticas han sido y continúan siendo profusamente evaluadas a través ... more

Download (6)

10 Years of Evaluation Practice in Media Assistance: Who, When, Why and How?

Jessica Noske-Turner

Nordicom Review, volume 36, issue Special Issue (2015), pp. 41-56

"Evaluating the impact of media assistance is challenging for several reasons. Primary among them is that these kinds of initiatives operate in a complex political, social, and cultural environment. Although there has been increased attention to evaluation of media assistance, with a series of inter ... more

External Link (44)

Systematic Review of the Effectiveness of Mass Media Interventions for Child Survival in Low- and Middle-Income Countries

Danielle A. Naugle, Robert C. Hornik

Journal of Health Communication, volume 19, issue suppl. 1 (2014), pp. 190-215

"Through a systematic review of the literature, this article summarizes and evaluates evidence for the effectiveness of mass media interventions for child survival. To be included, studies had to describe a mass media intervention; address a child survival health topic; present quantitative data fro ... more

Download (2)

Cluster Evaluation Report: UNDEF-Funded Media-Related Projects

Pierre Robert

United Nations Democracy Fund (UNDEF); Transtec (2012), 40 pp.

"This report is the cluster evaluation of 12 UNDEF-supported projects related to the media. It concerns projects that either focused on media capacity building or included a significant element of work with the media. The projects were implemented between 2007 and 2011; they lasted between 12 and 24 ... more

Download (5)

Cooperación internacional a medios de comunicación: Resultados de tres meta-evaluaciones

Christoph Dietz

In: Políticas y legislación para la radio local en América Latina

Alfonso Gumucio Dagron, Karina Herrera Miller (eds.)

La Paz: Plural Editores (2010), pp. 179-189

"A pesar de que las inversiones externas en proyectos de medios han aumentado – con excepción de América Latina – hacen falta estudios que analicen el impacto de estas inversiones. A veces se han publicado evaluaciones de proyectos individuales, pero se careció de estudios que analizaran el c ... more

Download (3)

Tuned in to Student Success: Assessing the Impact of Interactive Radio Instruction for the Hardest-To-Reach

Jennifer Ho, Hetal Thurkal

Washington, DC: Education Development Center, Inc. (2009), iv, 64 pp.

"Evaluation data gathered between 1975 and 2000 demonstrated that Interactive Radio Instruction (IRI) had improved learning outcomes in conventional classrooms by between 10% and 20% when compared with control classrooms not using IRI. These programs often had relatively well-funded evaluation compo ... more

Download (6)

Communicating with Radio: What Do We Know? Findings from a Review of Selected Rural Radio Effectiveness Evaluations
Deep Insights

Linje Manyozo

Ottawa: Farm Radio International, African Farm Radio Research Initiative (AFRRI) (2008), 105 pp.

"This study reviews and analyses what has already been documented on the links between radio-based communication strategies and rural development outcomes, particularly with regards to smallholder farming and food security outcomes. The report explores best radio practices, including issues related ... more

Download (2)

Towards a New Model: Media and Communication in Post-Conflict and Fragile States
Deep Insights

Shanthi Kalathil, John Langlois, Adam Kaplan

Washington, DC: World Bank, Communication for Governance and Accountability Program (CommGAP) (2008), 105 pp.

"There is very little undestanding of the role that communicartion processes play in the numerous starnds of post-conflict reconstruction, including peacebuilding, governance, and long-term development. This paper addressess this gap by distilling lessons learned from the media and communication str ... more

Download (2)

Ten Years of Media Support to the Balkans: An Assessment
Deep Insights

Aaron Rhodes

Stability Pact for South Eastern Europe, Media Task Force (2007), 47 pp.

"From 1995 to 2005, the international community provided significant support to media in the Western Balkans. Based on a meta-analysis of 37 project reports and interviews with a broad range of media experts, this study finds that direct support to independent media was a key factor in helping the c ... more

Download (3)

Evaluating Mass Media Health Communication: The Use of Evaluation Data to Improve Theory

Joel Lehmann

Freiburg (CH): Universität Freiburg (2007), 127 pp.

"This paper discussed the possibility to improve public communication campaign theory, by making use of data obtained through mass media health communication campaign evaluations. The idea of an ‘engineering’ approach to campaign design, where theory and scientific findings are systematically us ... more

Download (5)

Estado del arte de los programas de prevención de la violencia en jóvenes: Basados en el uso de medios de communicación

Jair Vega Casanova

Washington, DC; Lima: Organización Panamericana de la Salud (OPS); Cooperación Técnica Alemana (GTZ) (2006), 82 pp.

Inclusive Rural Communication Services: Building Evidence, Informing Policy Deep Insights

Rethinking Media Development Through Evaluation: Beyond Freedom Deep Insights

Communicating with Radio: What Do We Know? Findings from a Review of Selected Rural Radio Effectiveness Evaluations Deep Insights

Towards a New Model: Media and Communication in Post-Conflict and Fragile States Deep Insights

Ten Years of Media Support to the Balkans: An Assessment Deep Insights

Inclusive Rural Communication Services: Building Evidence, Informing Policy
Deep Insights

Rethinking Media Development Through Evaluation: Beyond Freedom
Deep Insights

Communicating with Radio: What Do We Know? Findings from a Review of Selected Rural Radio Effectiveness Evaluations
Deep Insights

Towards a New Model: Media and Communication in Post-Conflict and Fragile States
Deep Insights

Ten Years of Media Support to the Balkans: An Assessment
Deep Insights