Handbook of Practical Program Evaluation
San Francisco: Jossey-Bass, 4th ed. (2015), xl, 864 pp.
Contains illustrations, index
Series: Essential Texts for Nonprofit and Public Leadership and Management
ISBN 978-1-118-89361-6 (pdf); 978-1-118-89360-9 (print)
Other editions: 1st ed. 1994, 2nd ed. 2004, 3rd ed. 2010
"The Handbook of Practical Program Evaluation provides tools for managers and evaluators to address questions about the performance of public and nonprofit programs. Neatly integrating authoritative, high-level information with practicality and readability, this guide gives you the tools and processes you need to analyze your program's operations and outcomes more accurately. This new fourth edition has been thoroughly updated and revised, with new coverage of the latest evaluation methods, including: culturally responsive evaluation; adopting designs and tools to evaluate multi-service community change programs; using role playing to collect data; using cognitive interviewing to pre-test surveys; coding qualitative data. You'll discover robust analysis methods that produce a more accurate picture of program results, and learn how to trace causality back to the source to see how much of the outcome can be directly attributed to the program. Written by award-winning experts at the top of the field, this book also contains contributions from the leading evaluation authorities among academics and practitioners to provide the most comprehensive, up-to-date reference on the topic. Valid and reliable data constitute the bedrock of accurate analysis, and since funding relies more heavily on program analysis than ever before, you cannot afford to rely on weak or outdated methods. This book gives you expert insight and leading edge tools that help you paint a more accurate picture of your program's processes and results, including: obtaining valid, reliable, and credible performance data; engaging and working with stakeholders to design valuable evaluations and performance monitoring systems; assessing program outcomes and tracing desired outcomes to program activities; providing robust analyses of both quantitative and qualitative data" (Publisher description)
PART ONE: EVALUATION PLANNING AND DESIGN, 1
1. Planning and Designing Useful Evaluations / Kathryn E. Newcomer, Harry P. Hatry, Joseph S. Wholey, 7
2. Analyzing and Engaging Stakeholders / John M. Bryson, Michael Quinn Patton, 36
3. Using Logic Models / John A. McLaughlin, Gretchen B. Jordan, 62
4. Exploratory Evaluation / Joseph S. Wholey, 88
5. Performance Measurement / Theodore H. Poister, 108
6. Comparison Group Designs / Gary T. Henry, 137
7. Randomized Controlled Trials / Carole J. Torgerson, David J. Torgerson, Celia A. Taylor, 158
8. Conducting Case Studies / Karin Martinson, Carolyn O’Brien, 177
9. Recruitment and Retention of Study Participants / Scott C. Cook, Shara Godiwalla, Keeshawna S. Brooks, Christopher V. Powers, Priya John, 197
10. Designing, Managing, and Analyzing Multisite Evaluations / Debra J. Rog, 225
11. Evaluating Community Change Programs / Brett Theodos, Joseph Firschein, 259
12. Culturally Responsive Evaluation / Stafford Hood, Rodney K. Hopson, Karen E. Kirkhart, 281
PART TWO: PRACTICAL DATA COLLECTION PROCEDURES, 319
13. Using Agency Records / Harry P. Hatry, 325
14. Using Surveys / Kathryn E. Newcomer, Timothy Triplett, 344
15. Role Playing / Claudia L. Aranda, Diane K. Levy, Sierra Stoney, 383
16. Using Ratings by Trained Observers / Barbara J. Cohn Berman, Verna Vasquez, 412
17. Collecting Data in the Field / Demetra Smith Nightingale, Shelli Balter Rossman, 445
18. Using the Internet / William C. Adams, 474
19. Conducting Semi-Structured Interviews / William C. Adams, 492
20. Focus Group Interviewing / Richard A. Krueger, Mary Anne Casey, 506
21. Using Stories in Evaluation / Richard A. Krueger, 535
PART THREE: DATA ANALYSIS, 557
22. Qualitative Data Analysis / Delwyn Goodrick, Patricia J. Rogers, 561
23. Using Statistics in Evaluation / Kathryn E. Newcomer, Dylan Conger, 596
24. Cost-Effectiveness and Cost-Benefit Analysis / Stephanie Riegg Cellini, James Edwin Kee, 636
25. Meta-Analyses, Systematic Reviews, and Evaluation Syntheses / Robert Boruch, Anthony Petrosino, Claire Morgan, 673
PART FOUR: USE OF EVALUATION, 699
26. Pitfalls in Evaluations / Harry P. Hatry, Kathryn E. Newcomer, 701
27. Providing Recommendations, Suggestions, and Options for Improvement / George F. Grob, 725
28. Writing for Impact / George F. Grob, 739
29. Contracting for Evaluation Products and Services / James B. Bell, 765
30. Use of Evaluation in Government / Joseph S. Wholey, 798
31. Evaluation Challenges, Issues, and Trends / Harry P. Hatry, Kathryn E. Newcomer, Joseph S. Wholey, 816
1. Planning and Designing Useful Evaluations / Kathryn E. Newcomer, Harry P. Hatry, Joseph S. Wholey, 7
2. Analyzing and Engaging Stakeholders / John M. Bryson, Michael Quinn Patton, 36
3. Using Logic Models / John A. McLaughlin, Gretchen B. Jordan, 62
4. Exploratory Evaluation / Joseph S. Wholey, 88
5. Performance Measurement / Theodore H. Poister, 108
6. Comparison Group Designs / Gary T. Henry, 137
7. Randomized Controlled Trials / Carole J. Torgerson, David J. Torgerson, Celia A. Taylor, 158
8. Conducting Case Studies / Karin Martinson, Carolyn O’Brien, 177
9. Recruitment and Retention of Study Participants / Scott C. Cook, Shara Godiwalla, Keeshawna S. Brooks, Christopher V. Powers, Priya John, 197
10. Designing, Managing, and Analyzing Multisite Evaluations / Debra J. Rog, 225
11. Evaluating Community Change Programs / Brett Theodos, Joseph Firschein, 259
12. Culturally Responsive Evaluation / Stafford Hood, Rodney K. Hopson, Karen E. Kirkhart, 281
PART TWO: PRACTICAL DATA COLLECTION PROCEDURES, 319
13. Using Agency Records / Harry P. Hatry, 325
14. Using Surveys / Kathryn E. Newcomer, Timothy Triplett, 344
15. Role Playing / Claudia L. Aranda, Diane K. Levy, Sierra Stoney, 383
16. Using Ratings by Trained Observers / Barbara J. Cohn Berman, Verna Vasquez, 412
17. Collecting Data in the Field / Demetra Smith Nightingale, Shelli Balter Rossman, 445
18. Using the Internet / William C. Adams, 474
19. Conducting Semi-Structured Interviews / William C. Adams, 492
20. Focus Group Interviewing / Richard A. Krueger, Mary Anne Casey, 506
21. Using Stories in Evaluation / Richard A. Krueger, 535
PART THREE: DATA ANALYSIS, 557
22. Qualitative Data Analysis / Delwyn Goodrick, Patricia J. Rogers, 561
23. Using Statistics in Evaluation / Kathryn E. Newcomer, Dylan Conger, 596
24. Cost-Effectiveness and Cost-Benefit Analysis / Stephanie Riegg Cellini, James Edwin Kee, 636
25. Meta-Analyses, Systematic Reviews, and Evaluation Syntheses / Robert Boruch, Anthony Petrosino, Claire Morgan, 673
PART FOUR: USE OF EVALUATION, 699
26. Pitfalls in Evaluations / Harry P. Hatry, Kathryn E. Newcomer, 701
27. Providing Recommendations, Suggestions, and Options for Improvement / George F. Grob, 725
28. Writing for Impact / George F. Grob, 739
29. Contracting for Evaluation Products and Services / James B. Bell, 765
30. Use of Evaluation in Government / Joseph S. Wholey, 798
31. Evaluation Challenges, Issues, and Trends / Harry P. Hatry, Kathryn E. Newcomer, Joseph S. Wholey, 816
