"Ziel der hier vorgelegten Studie ist es, analog der Vorgaben des PriME-Handbuchs 2008 von InWEnt, gemäß der Kriterien für Evaluation von Entwicklungszusammenarbeit nach OECD-DAC, unter Rückgriff auf angelsächsische Modelle für PM+E im Bereich der Medienentwicklungszusammenarbeit sowie unter R
...
ückgriff auf die kommunikationswissenschaftliche Literatur ein Konzept für künftige systematische Evaluierungen der mittelfristigen Wirkungen des IIJ-Programms zu entwickeln, das über die Evaluierung unmittelbar nach Ende der Weiterbildungsmaßnahme hinausgeht. Mit Blick auf die bereits vom IIJ formulierten Programmziele zu prüfen ist der Erfolg von Capacity-Building-Maßnahmen auf Ebene der individuellen Akteure (Journalisten), auf Ebene von Organisationen (Redaktionen) sowie auf Systemebene. Hierzu wird eine Methodenkombination (Triangulation) empfohlen, die aufeinander aufbauend sowohl mit quantitativen als auch mit qualitativen Methoden arbeitet und außer der Ebene der Akteure (Journalisten) insbesondere die Ebene der Organisationen (Redaktionen) einbezieht. Um einen ökonomischen Umgang mit Ressourcen sicherzustellen, wird grundsätzlich empfohlen, mit Online-Befragungen zu arbeiten und ergänzend Telefon-Befragungen sowie fallweise vor Ort Face-to-Face-Interviews durchzuführen. Im Rahmen der Studie werden folgende PM+E-Tools für das IIJ entwickelt: Fragebogen für die Online-Befragung der Alumni (quantitativ), Fragebogen für die ergänzende Online-Befragung von Referenzpersonen der Alumni (quantitativ), Leitfaden für telefonische Interviews mit Alumni/Experten in den Zielländern (qualitativ), Leitfaden für Face-to-Face-Interviews mit lokalen Partnern (qualitativ). Der Fragebogen für die Online-Befragung als zentrales PM+E-Tool wurde erfolgreich einem Pre-Test unterzogen. Die Studie schließt mit einem Analyseraster für die Auswertung von im Rahmen von PM+E-Maßnahmen gewonnenen Daten, um gemäß der PriME-Qualitätsschleife institutionelles Lernen zu ermöglichen." (Zusammenfassung, Seite 6)
more
"This publication allows community radio stations to assess their performance regarding: community participation and ownership; radio governance structures and procedures; radio programme structure; radio station management; financial management and resource structure; as well as networking. Using a
...
detailed scoring system, the manual provides a comprehensive list of indicators that categorises assessed stations into four groups: evolving, progressing, performing and model community radios. It considers the issues that are at the heart of community media: public accountability, community representation, locally relevant programming, diverse funding, and due acknowledgement of staff, including volunteers. The manual is clear and concise providing a sound basis for the task it describes. Tailored to the needs of community radios in Nepal, not every single indicator may apply to stations in other countries. Nevertheless, the scoring methodology can easily be adapted to other contexts." (CAMECO Update 4-2009)
more
"The paper is divided into two parts: Part One describes a methodology for designing an M&E system. This covers a number of stages from defining the scope and purpose of the system to its eventual roll out. However, it does not cover the implementation of the M&E system. Part Two addresses many of t
...
he technical issues that need to be considered when designing M&E systems for complex organisations. The information in Part Two may be useful to M&E system designers whether or not the basic methodology in Part One is followed." (Page 1)
more
"The outcome of this study is a prototype for a European Media Pluralism Monitor – a riskbased, holistic, user-friendly and evolving monitoring tool that includes indicators of a legal, economic and socio-demographic nature. In order to account for the multi-faceted character of media pluralism, t
...
hese indicators relate to various risk domains, including media ownership and/or control, media types and genres, political pluralism, cultural pluralism and geographic pluralism. Furthermore, they cover the various stages of the media value chain: supply, distribution and use. The Monitor offers a diagnostic, not a prescriptive tool on the basis of established risk management strategies. Its purpose is to facilitate the collection of empirical data on various risks for media pluralism given the particular economic, sociodemographic and legal situation in each Member State." (Page viii)
more
"With this glossary, the DAC Working Group on Evaluation for Development Cooperation hopes to facilitate and improve dialogue and understanding among all those involved in development activities and their evaluation, whether in partner countries, development organizations and banks, or nongovernment
...
al organizations. It should serve as a valuable guide in evaluation education and training as well as in practical development work." (Back cover)
more
"This 2009 version of the ‘Handbook on Planning, Monitoring and Evaluating for Development Results’ aims to support UNDP in becoming more results-oriented and to improve its focus on development changes and real improvements in people’s lives. It replaces and updates the previous Handbook from
...
2002. It was a breakthrough in driving the effective application of the results-based management approach in programming and performance management. The Handbook recognizes that planning, monitoring and evaluation require a focus on nationally owned development priorities and results, and should reflect the guiding principles of national ownership, capacity development and human development. Globally, there has been a significant shift away from the project approach in favour of programme and national approaches." (Preface, page III)
more
"Die anvisierte Leserschaft dieser Landkarte ist die entwicklungspolitische Fachwelt, die mit der Analyse von tatsächlichen, das heißt empirisch nachprüfbaren (de facto) Wirkungen befasst ist und die einen schnellen, informativen Zugriff auf das Vorhandene benötigt. Dies sind in erster Linie Pro
...
jekt- und Programmverantwortliche in den Entwicklungsorganisationen in Geber- und Empfängerländern, die gehalten sind, die Wirkungen von Entwicklungsmaßnahmen nachzuweisen und in ihren Berichten zu dokumentieren; Mitarbeiter/-innen von Evaluierungs- und Qualitätsmanagementeinheiten, die Wirkungsanalysen zumeist als Teil von (Querschnitts-)Evaluationen in Auftrag geben; Wissenschaftler/-innen, die bei dem Design von empirischen Wirkungsstudien beraten oder diese selbst durchführen; sowie Gutachter/-innen und Berater/-innen, die vor der Aufgabe stehen, Wirkungsanalyseverfahren anzuwenden oder in einer Organisation einzuführen. In der vorliegenden Landkarte wurde versucht, alle, insbesondere im deutschsprachigen Kontext bekannten und in der Praxis erprobten, gut beschriebenen Wirkungsanalyseverfahren aufzunehmen, wobei ein Anspruch auf Vollständigkeit nicht erhoben werden kann. Dabei liegt der Schwerpunkt nicht nur auf qualitativen und partizipativen Verfahren, die selbst oft zusätzliche quantitative Elemente enthalten, sondern es werden auch quantitative experimentelle und nicht-experimentelle Designs beschrieben, die mitunter als „rigorose“ Verfahren bezeichnet werden. Dabei werden hier keine Bewertungen im Sinne von gut oder schlecht ausgesprochen. Ziel ist es stattdessen, den Nutzern dieser Landkarte die Möglichkeit zu geben, Verfahren nach rein sachlichen und pragmatischen Erwägungen für einen bestimmen Untersuchungszweck oder -auftrag auszuwählen." (Vorwort)
more
"This Working Paper from DFID’s Evaluation Department offers a menu of Voice & Accountability (V&A) indicators, and suggests steps for building monitoring and evaluation frameworks for V&A interventions. It provides a check list of management issues, and some ideas for data collection. It does not
...
attempt to make any judgement about the indicators identified, as this work will be further developed under DFID’s ‘Suggested Indicators for Governance’ work, due in 2010. The paper is intended for DFID advisers and managers working on V&A initiatives at the country level. It will also be of use to people outside DFID who are interested in understanding how V&A work contributes to development outcomes; or who want more information about data collection methods for V&A measurement. V&A interventions range from work with governments on policy and reform processes, to activities at community level on civic education and rights awareness. DFID supports a significant amount of V&A work through government and non-state actors, in sector programmes and in work with civil society organisations including the media. We now need to establish the evidence base to show what change has resulted." (Executive summary)
more
"This is a practical and well structured manual aiming to use self-evaluation for organisational learning. The book consists of four parts. "The evaluation context" introduces the role of monitoring, evaluation and impact assessment as part of the project cycle logic. "The evaluation process" descri
...
bes steps to be taken in designing and implementing an evaluation. The third part, "evaluation tools", gives a practical insight to major evaluation methods like SWOT analysis, questionnaires (and their design), focus groups or case studies. The fourth and main part provides evaluation guidelines for training courses, newsletters, websites, small libraries and resource centres, online communities, rural radios, databases and selective dissemination of information services." (CAMECO Update 1-2011)
more
"Although the argument for evaluating advocacy is convincing, advocacy has long been considered “too hard to measure,” and so far relatively few advocates, funders, or evaluators have taken on the challenge. But this is now changing. Interest in advocacy evaluation is surging and cutting-edge ad
...
vocates are embracing evaluation as a critical part of their work. The main barrier preventing more organizations from using evaluation is a lack of familiarity with how to think about and design evaluations of advocacy efforts that are useful, manageable, and resource-efficient. Even knowing where to start can be a challenge. This tool was developed to help address that gap in knowledge. It guides users through four basic steps of advocacy evaluation planning." (Page 3)
more
"Explores the application of systems ideas to investigate, evaluate, and intervene in complex and messy situations. The text serves as a field guide, with each chapter representing a method for describing and analyzing; learning about; or changing and managing a challenge or set of problems. The boo
...
k is the first to cover in detail such a wide range of methods from so many different parts of the systems field. The book's Introduction gives an overview of systems thinking, its origins, and its major subfields. In addition, the introductory text to each of the book's three parts provides background information on the selected methods. Systems Concepts in Action may serve as a workbook, offering a selection of tools that readers can use immediately. The approaches presented can also be investigated more profoundly, using the recommended readings provided. While these methods are not intended to serve as "recipes," they do serve as a menu of options from which to choose." (Publisher description)
more
"[...] Fortunately, in the last decade in particular, much progress has been made on incorporating social science theory into both campaign design and evaluation, primarily in the health field. Indeed, evaluators are being encouraged to engage in theory testing and/or logic model development. Findin
...
gs from recent meta-analyses suggest that newer communication campaigns are increasingly utilizing theory. In addition, there has been great diversity in the theories being applied in this area, and many of the theories being used most often, including the Theory of Reasoned Action, Social Cognitive Theory, and the transtheoretical “Stages of Change” model, also are widely studied in the health behavior change literature.
An evaluation research team typically consists of program staff in charge of program planning and a program evaluator. Often, the program evaluator is one of the few behavioral or social scientists on the project. Without a theorist on the team, the theory behind the project is likely to remain implicit from the start. The failure to acknowledge or discuss theory from the beginning risks wasting resources on message strategies that are not adequately linked to psychosocial predictors of behavior, and on performance measures that are off the mark. Thus, all program personnel should be involved in theory/logic model development so that the theoretical underpinnings of the project are grounded in more than evaluator assumptions." (Introduction)
more
"This guide outlines a step-by-step process for developing a performance story report in the context of natural resource management. The guide can be used in a range of contexts by evaluators and others who want to use participatory evaluation approaches to report on outcomes. Users may include cons
...
ultants, government and non-government organisations, community groups, students, natural resource management organisations, industry bodies and academics. The guide will enable them to evaluate and report on program outcomes and continually improve their programs based on lessons learned through participatory evaluation approaches. Performance story evaluation is useful for both internal and external evaluations and learning. Performance story reports are effective for reporting annually on achievements from one year to the next." (Introduction, page 5)
more
"Die Entwicklungszusammenarbeit (EZ) ist in Deutschland das Politikfeld mit der längsten Evaluationstradition. Alle größeren deutschen EZ-Organisationen nutzen das Instrument der Evaluation – quantitativ und qualitativ jedoch in sehr unterschiedlichem Maße. Diese zwei Bände umfassende Studie
...
im Auftrag des Bundesministeriums für wirtschaftliche Zusammenarbeit und Entwicklung (BMZ) untersucht mit erheblichem methodischen Aufwand, wie die einzelnen EZ-Organisationen evaluieren, was sie über die Wirkungen der von ihnen geförderten Projekte und Programme wissen und ob und wie sich die Evaluationssysteme der einzelnen Organisationen zu einem sinnvollen Ganzen zusammenfügen. Eine vergleichbare Studie liegt bisher weder über ein anderes Politikfeld in Deutschland noch über die Evaluation in der Entwicklungszusammenarbeit in einem anderen Land Europas vor." (Verlagsbeschreibung)
more