"Enhancing citizen voice and accountability has increased in importance for donors since the 1990s. This paper reviews existing literature and the strategy and policy documents of seven DAC donors in order to contribute to the design of an evaluation framework to assess the effectiveness of these do
...
nors’ voice and accountability interventions." (Executive summary)
more
"This paper discussed the possibility to improve public communication campaign theory, by making use of data obtained through mass media health communication campaign evaluations. The idea of an ‘engineering’ approach to campaign design, where theory and scientific findings are systematically us
...
ed and adopted for practical problems, plays an important role in the discussion [...] In the third part, a sample of 33 evaluation reports for mass media health communication campaigns was analyzed. 32 of these reports have not been published in an scientific journal. The evaluations were conducted in 22 different countries. The analysis of the reports focused on the campaign goals, evaluation outcome measures, research design and methods, and on questions of validity. The findings suggest that theory is not widely and consequently used to inform health mass communication campaigns or their evaluations – with notable exceptions. While there is a large number of outcomes measured, they seem to be taken out of theoretical context. Neither the campaign goals nor the evaluation measures reflect the large number of possible communication strategies that the various communication or behavior-change models and theories imply. Unintended campaign effects were mostly ignored. In very few cases the campaign designers or evaluators make use of an effects model or program logic model. This is one of the areas where I see the possibility of an important improvement. The methodology of campaign evaluation is relatively homogenous across the 33 cases in regards to data collection method. Standardized questionnaires are the dominating data collection instrument. Non-reactive observation or tracking methods are very rare. A surprising two thirds of the evaluations did not use multivariate analysis, and the reliance on self-reports raises questions of reliability." (Summary, page 120-121)
more
"This working paper was conceived to stimulate debate on new trends in the evaluation function within the Post-Paris new Aid architecture and the UN Reform, and to explore the status of the evaluation function in CIS countries. Though this paper is not a technical manual or handbook, the authors mad
...
e every effort to offer practical proposals on how to implement a democratic approach to evaluation.
The paper is divided into three parts. In the first part, Segone presents the evolution of the evaluation function in the context of UN Reform and a changing Aid architecture. This part is mainly based on the discussion and outcomes of the IDEAS 1st Biennial Conference held in New Delhi in 2005 and conceptual discussions within the UN. Samuel Bickel presents an assessment of the status of the evaluation status worldwide, based on the address he delivered at the 2005 IPEN Conference held in Kazakhstan. Quesnel introduces how the growing professional evaluation organizations are instrumental to strengthen the evaluation function worldwide. Segone then presents thoughts on the scope of the evaluation function.
In the second part Segone proposes a strategy for improving the evaluation function through strengthening a pro-evaluation culture and a democratic approach to evaluation. Kushner, one of the world’s leading thinkers on Democratic evaluation, presents his thinking on the relationship between Evaluation and Democracy.
In the third part, six members of IPEN, coordinated by Kuzmin, analyse the evaluation function in CIS countries, giving important information on its status and trends. This piece is particularly important as it is one of the few existing documents on the evaluation function in CIS countries. Finally, the annexes give practical information on how to access international evaluation resources via the Internet and present the UN Evaluation Norms and Standards and guidelines on how to develop evaluation ToR." (Introduction, page 8)
more
"During the last six years, the Asociación Latinoamericana de Educación Radiofónica (ALER) carried out two main investigations on popular radio in Latin America: on the one hand an external evaluation (in 1996/97) of the strengths and weaknesses of ALER's strategies and lines of action, and on th
...
e other hand (in 2000/2001) a diagnosis of the impact of the associate members. The author, one of the two coordinators of the second study, compares the different objectives, methodologies and results of the two experiences. The two studies met their main objectives. The 1996 evaluation led to the implementation or correction of some aspects of the institutional logic, while the 2000 diagnosis led to a broad process of reflection." (Summary)
more
"Este manual intenta proporcionar a los administradores de proyectos y a los analistas de políticas las herramientas necesarias para evaluar el impacto de los proyectos. Está destinado a lectores con conocimientos generales de estadísticas. Para algunos de los métodos estadísticos más profundo
...
s analizados, el lector es remitido a la literatura técnica sobre el tema. En el Capítulo 1 se presenta una visión general de los conceptos y métodos, en el Capítulo 2 se analizan los pasos clave y temas relacionados que hay que considerar durante la implementación, en el Capítulo 3 se ilustran diversas técnicas analíticas a través de un estudio de casos y en el Capítulo 4 se incluye un análisis de las lecciones aprendidas de un valioso conjunto de evaluaciones de “prácticas óptimas” de los proyectos de pobreza que se revisaron para este manual. Los estudios de casos, incluidos en el Anexo I, se seleccionaron de una variedad de evaluaciones realizadas por el Banco Mundial, otras agencias de donantes, instituciones de investigación y empresas consultoras privadas. Se eligieron por su rigor metodológico, en un intento por cubrir una amplia combinación de escenarios de países, tipos de proyectos y metodologías de evaluación. En los Anexos también se incluyen muestras de los principales componentes que serían necesarios al planificar cualquier evaluación de impacto: muestras de términos de referencia, un presupuesto, indicadores de impacto, un marco lógico y una matriz de análisis." (Prólogo, páginas 5-6)
more
"In diesem Lehrbuch werden die wichtigsten Theorien, Methoden und Entwicklungen der Evaluationsforschung in Deutschland, Europa und den USA beschrieben. Außerdem wird der Stand der Forschung für ausgewählte Politikfelder beschrieben: Forschungs-/Technologiepolitik, Arbeitsmarktpolitik, Verwaltung
...
sforschung, Umwelt, Hochschulen, Erziehung und Entwicklungszusammenarbeit." (Katalog Leske + Budrich 2000)
more
"Der Sammelband gibt einen systematischen Überblick über Praxis und Theorie entwicklungspolitischer Evaluierung. Eingeleitet wird er durch eine "Kleine Entwicklungsgeschichte der Evaluierungsforschung". Mit Beiträgen von: Stefan Brüne (DÜI), Reinhard Stockmann (Universität Saarbrücken), Paul
...
Hoebink (Kath. Universität Nimwegen), Jochen Kenneweg (BMZ), Theo Mutter (Freier Gutachter), Ulrich Thumm (Weltbank), Martin Raschen (KfW), Hans-Joachim Preuss/Volker Steigerwald (GTZ), Jutta Barth (EZE), Martin Dütting (Misereor), Ruth Erlbeck (DED) und Manuel Wiener (Deutsche Welthungerhilfe)." (Verlagsbeschreibung)
more