"This chapter first discusses evaluation of communication for development in relation to ideas around participation and social change, before presenting the framework for evaluating communication for development and social change, and the key principles that underpin it. It then describes some of th
...
e most interesting current trends and debates in development evaluation that informed the development of the framework, and outlines some strategies for overcoming the many challenges and issues associated with implementing this alternative evaluation approach. The chapter discusses some of the aspects of systems thinking and complexity theory that informs the framework, and gives brief examples to illustrate their relevance. Finally, the chapter discusses the implications for increasing the sustainability and effectiveness of communication for development and social change." (Summary)
more
"In this paper we describe how quality in reporting could be measured through content analysis. We show that this approach, although somewhat technical, is feasible. It can help projects to become better and more successful. As a suggestion for practitioners in media development we present three opt
...
ions for measuring quality of reporting for monitoring and evaluation purposes." (Abstract)
more
"The paper focuses on exploring the application of the following ICTs: mobile technology, social media, big data, the digitization of surveys, and tools to better visualize data. Each section outlines a series of resources and some advantages and drawbacks to utilizing the new technology for M&E pur
...
poses. When appropriate, examples and case studies have been included." (Document summary)
more
"By illustrating the rise of neoliberalism as a case in point, the study hypothesises a neoliberal influence on the measurement of freedom of information. To test such assumption, the work describes three ideal typical models of freedom of information – the liberal, egalitarian and neoliberal mode
...
ls – and their connection with specific conceptions of democracy. Then, the article focuses on the Freedom of the Press Index by Freedom House, that is the most used and recognised instrument for measuring freedom of information. Though the Freedom House contends to measure a liberal conception of freedom of information, the analysis of the indicators of the Freedom of the Press Index shows that they mirror the neoliberal model at least with respect to the role of state and market on media systems, and the conception of media pluralism. The results bring into question the uncritical acceptance of the Freedom of the Press Index as the universal yardstick of freedom of information." (Abstract)
more
"This thesis explores how the impacts of Australian media assistance on social change and governance can be most effectively evaluated and understood. It is based on a three-stage research design, using predominantly qualitative research methods. In doing so it contributes in-depth insights into the
...
politics, theories, and practices of media assistance evaluation, with illustrations of how this knowledge can be directly applied to improve practice in this area. The findings of this research suggest the importance of early investment in participatory planning of evaluation designs, which are then periodically revisited. These evaluation designs should be based on a theoretically sound link between models of change, evaluative questions and methods." (Abstract)
more
"This paper suggests that the problem of impact evaluation of media assistance is understood to be more than a simple issue of methods, and outlines three underlying tensions and challenges that stifle implementation of effective practices in media assistance evaluation. First, there are serious con
...
ceptual ambiguities that affect evaluation design. Second, bureaucratic systems and imperatives often drive evaluation practices, which reduces their utility and richness. Third, the search for the ultimate method or toolkit of methods for media assistance evaluation tends to overlook the complex epistemological and political undercurrents in the evaluation discipline, which can lead to methods being used without consideration of the ontological implications. Only if these contextual factors are known and understood can effective evaluations be designed that meets all stakeholders’ needs." (Abstract)
more
"The Tanzania Media Fund (TMF) supports individual journalists and media institutions to produce quality public interest and investigative journalism content that better informs the public, contributes to debate and thereby increases public demand for greater accountability in Tanzania. TMF has used
...
lessons learned from its first phase (2008- 2012) to develop a monitoring and evaluation (M&E) framework that captures TMF’s achievements in phase 2 (2012-2015) and beyond. This article provides an overview of the practical implementation of the M&E framework, and challenges encountered during implementation." (Abstract)
more
"A results-oriented culture of performance and service has been enforced since the 1990s in the EU. Evaluation systems have been a powerful catalyst in driving the transition from media support to media development and in making the latter more independent from broadcasters and donors. In recent yea
...
rs, changes in media assistance procedures and aims have profoundly modified the traditional landscape. This article will not question these changes, their origin and motivations. It will focus on implementers’ coping strategies to adapt (or not) to these new procedures and aims and how results-oriented evaluations can drive the shift from outputs to outcomes in a changing media development sector." (Abstract)
more
Provides indicators of performance along 9 parameters: 1. Content Generation and Programming; 2. Policies and Guidelines; 3. Volunteers; 4. Technology: Access and Management; 5. On-Air Standards of Broadcasting; 6. Governance; 7. Feedback and Grievances; 8. Content Sharing and Networking; 9. Revenue
...
Generation and Financial Accountability. Themes such as participation, inclusion, gender, and capacity-building cut across the 9 parameters.
more
"Data quality is a cornerstone of accountability in program reporting. In the international development sector, although we are often focused on reporting, ensuring the quality of the data that we report is critical for our partners, our donors, and our beneficiaries. In addition, Data Quality Manag
...
ement Plans and Routine Data Quality Assessments are both important elements of Pact’s Results and Measurement Standards. The intent of this manual is to provide guidance on how to ensure excellent data quality in all our programming. A slide set accompanying the module provides an opportunity to engage in practical exercises to test the skills outlined in this text." (Foreword)
more
"A randomized controlled trial (RCT) is a way of doing impact evaluation in which the population receiving the programme or policy intervention is chosen at random from the eligible population, and a control group is also chosen at random from the same eligible population. It tests the extent to whi
...
ch specific, planned impacts are being achieved. In an RCT, the programme or policy is viewed as an ‘intervention’ in which a treatment – the elements of the programme/policy being evaluated – is tested for how well it achieves its objectives, as measured by a predetermined set of indicators. The strength of an RCT is that it provides a very powerful response to questions of causality, helping evaluators and programme implementers to know that what is being achieved is as a result of the intervention and not anything else [...] The distinguishing feature of an RCT is the random assignment of members of the population eligible for treatment to either one or more treatment groups (who receive the intervention treatment or variations of it) or to the control group (who receive either no intervention or the usual intervention, if the treatment is an innovation to an existing intervention). The effects on specific impact areas for the different groups are compared after set periods of time." (Page 1)
more
"A practical guide to managing and leading evaluation efforts, this module is designed for use in evaluations within your organization and among your partners. Increasing local capacity to conduct and manage good program evaluation is a key goal of the Results and Measurement team at Pact ... Each c
...
hapter’s learning objectives and exercises relate to sections of Pact’s evaluation protocol, and each chapter builds on the previous one. By the end of the module, if you have worked your way through the exercises, you should have a comprehensive, written plan for your evaluation—that is, a full terms of reference (TOR). In addition, a TOR template can be found in Appendix 1 (page 90). The shaded boxes that introduce and give an overview of each chapter refer to relevant sections of this template." (Foreword)
more
"The book begins with an overview of the evaluation field and program evaluation standards, and proceeds to cover the most widely used evaluation approaches. With new evaluation designs and the inclusion of the latest literature from the field, this second edition is an essential update for professi
...
onals and students who want to stay current. Understanding and choosing evaluation approaches is critical to many professions, and Evaluation Theory, Models, and Applications, Second Edition is the benchmark evaluation guide. Authors Daniel L. Stufflebeam and Chris L. S. Coryn, widely considered experts in the evaluation field, introduce and describe 23 program evaluation approaches, including, new to this edition, transformative evaluation, participatory evaluation, consumer feedback, and meta-analysis. Evaluation Theory, Models, and Applications, Second Edition facilitates the process of planning, conducting, and assessing program evaluations. The highlighted evaluation approaches include: Experimental and quasi-experimental design evaluations Daniel L. Stufflebeam's CIPP Model Michael Scriven's Consumer-Oriented Evaluation Michael Patton's Utilization-Focused Evaluation Robert Stake's Responsive/Stakeholder-Centered Evaluation Case Study Evaluation Key readings listed at the end of each direct readers to the most important references for each topic. Learning objectives, review questions, student exercises, and instructor support materials complete the collection of tools. Choosing from evaluation approaches can be an overwhelming process, but Evaluation Theory, Models, and Applications, Second Edition updates the core evaluation concepts with the latest research, making this complex field accessible in just one book." (Publisher description)
more
"The BetterEvaluation Rainbow Framework prompts you to think about a series of key questions. It is important to consider all these issues, including reporting, at the beginning of an evaluation. The Framework can be used to plan an evaluation or to locate information about particular types of metho
...
ds. An expanded version of the framework showing options or methods for each question can be downloaded from our website: http://betterevaluation.org/plan." (Introduction)
more
"This guidebook aims to give the reader an overview of the existing international media freedom measures and how they can be used. By introducing the methodology and pointing out the strengths and weaknesses, it allows the readers to better understand, judge and thus critically reflect the indices
...
findings. This, in turn, enables them to ideally use and adopt the results for their own purposes. It addresses both stakeholders active in media development cooperation and journalists as well as all other people interested in this topic, such as politicians, academics or activists. The following five international and global media freedom indices will be introduced and analyzed: The Freedom of the Press Index by Freedom House; The Press Freedom Index by Reporters Without Borders; The Media Sustainability Index by the International Research & Exchanges Board (IREX); The African Media Barometer by the Friedrich Ebert Stiftung; The Media Development Indicators by UNESCO. These five measures were selected for the analysis because they are the only initiatives that evaluate media freedom internationally and on a regular basis. Strictly speaking, these indices can be further divided into two subgroups: those that claim to measure media freedom and those that aim to measure the theoretically broader concepts of media development or media sustainability. But since media freedom is a crucial component of media development and media sustainability and because in practice it is difficult to properly distinguish between the two concepts, both are included in this analysis." (Introduction, page 7)
more
This book provides a comprehensive yet accessible guide to running randomized impact evaluations of social programs. Drawing on the experience of researchers at the Abdul Latif Jameel Poverty Action Lab, which has run hundreds of such evaluations in dozens of countries throughout the world, it offer
...
s practical insights on how to use this powerful technique, especially in resource-poor environments. This step-by-step guide explains why and when randomized evaluations are useful, in what situations they should be used, and how to prioritize different evaluation opportunities. It shows how to design and analyze studies that answer important questions while respecting the constraints of those working on and benefiting from the program being evaluated. The book gives concrete tips on issues such as improving the quality of a study despite tight budget constraints, and demonstrates how the results of randomized impact evaluations can inform policy. With its self-contained modules, this one-of-a-kind guide is easy to navigate. It also includes invaluable references and a checklist of the common pitfalls to avoid. Provides the most up-to-date guide to running randomized evaluations of social programs, especially in developing countries Offers practical tips on how to complete high-quality studies in even the most challenging environments Self-contained modules allow for easy reference and flexible teaching and learning Comprehensive yet nontechnical
more
"This guidebook has been developed for use by professionals, policymakers and the research community involved in media development around the world. Its development was based on the UIS questionnaires on media statistics (see Appendices II, III and IV). This guide is not intended to provide a full s
...
et of monitoring and evaluation indicators, but rather a limited number of indicators that can easily be calculated based on administrative data available within most countries. For this reason, this tool is flexible, open to changes and can be adapted to the context of a given country. Over time, the guidebook will be updated according to changes to the questionnaire and data requirements. Qualitative indicators that may emerge from the regulatory framework questionnaire are not a concern of this guide; the guide is more quantitative in nature rather than constituting a qualitative assessment tool that is required for the in-depth analysis of laws and regulations. At the time of publication (May 2013), 54 country profiles have been published on the UIS website and further countries may be added in the future. The profiles present national regulations and data on broadcast and print media." (Executive summary)
more