Browse Data Collection Resources
-
"Participatory Performance Story Reporting" Clear Horizon, an M&E company in Australia, describes its participatory approach, specifically as it relates to the method of performance story reporting (PPSR). The company defines performance story reports as "essentially a short report about how a program contributed to outcomes." This page on their website includes links to other pages that describe the structure, process, and limitations of this the PPSR method. Author: Clear Horizon Type: Websites & Online Tools Date: Dec 31, 2008 Be the first to review this resource! Download (161.39 KB) -
5 Evaluation Lessons From a Recovering Program Officer (Presentation slides) As a profession, evaluators must constantly demonstrate the value of their work to remain relevant. Each evaluation represents a significant investment in resources that many argue could be used to provide more programming. Author: Will Fenn Type: Presentation Slides Date: Oct 17, 2013 Point K Pick Be the first to review this resource! Download (4.05 MB) -
5 Evaluation Lessons from a Recovering Program Officer (recording) As a profession, evaluators must constantly demonstrate the value of their work to remain relevant. Each evaluation represents a significant investment in resources that many argue could be used to provide more programming. A primary concern of maintaining the value proposition of the evaluation field is ensuring that evaluations remain manageable and useful to all participants. The Ignite session offered five succinct lessons from a former foundation Program Officer that can be applied across program types to help nonprofits and foundations improve evaluation coordination and use. Author: Will Fenn Type: Websites & Online Tools Date: Oct 17, 2013 Be the first to review this resource! Web Link -
A Guide to Actionable Measurement Staff members from the Bill & Melinda Gates Foundation discuss the principles and practices they use to make decisions about data collection, analysis, and reporting. Their approach, "actionable measurement," emphasizes the collection of information for specific decisions or actions.
UPDATE: We had a broken link here. It was updated on Jan. 13, 2011.
Author: Bill & Melinda Gates Foundation Type: Research & Reports Date: May 10, 2010
Download (284.17 KB) -
A Guide to Measuring Advocacy and Policy Developed for the Annie E. Casey Foundation, this guide serves as a broad call to grantmakers to build and advance the field of advocacy and policy evaluation. The guide includes sections on the context of advocacy evaluation and evaluation design. Author: Reisman, Jane, et al. Type: Research & Reports Date: Mar 15, 2007
Download (255.04 KB) -
A Practical Guide for Engaging Stakeholders in Developing Evaluation Questions This guide describes a five-step process for engaging stakeholders in developing evaluation
questions, and includes four worksheets and a case example to further facilitate the planning
and implementation of your stakeholder engagement process.Step 1: Prepare for stakeholder engagement: This step includes collecting information about
the program or initiative being evaluated—its history, why it came into being, what it is trying
to accomplish and what success would look like.Author: Hallie Preskill and Nathalie Jones Type: Workbooks & Guides Date: Jun 1, 2009 Be the first to review this resource! Download (1001.41 KB) -
Abdul Latif Jameel Poverty Action Lab Executive Training: Evaluating Social Programs 2009 This five-day program on evaluating social programs provides a thorough understanding of randomized evaluations and pragmatic step-by-step training for conducting one's own evaluation. While the course focuses on randomized evaluations, many of the topics, such as measuring outcomes and dealing with threats to the validity of an evaluation, are relevant for other methodologies.
Courses have been recorded and loaded as videos online, split up by topic. You may also access the course lecture notes and assignments.Author: Esther Duflo, Rachel Glennerster, & Abhijit Banerjee Type: Websites & Online Tools Date: May 1, 2009 Be the first to review this resource! Web Link -
Addressing Attribution of Cause and Effect in Small n Impact Evaluations: Towards an Integrated Framework With the results agenda in the ascendancy in the development community, there is an increasing need to demonstrate that development spending makes a difference, that it has an impact. This requirement to demonstrate results has fuelled an increase in the demand for, and production of, impact evaluations. There exists considerable consensus among impact evaluators conducting large n impact evaluations involving tests of statistical difference in outcomes between the treatment group and a properly constructed comparison group.
Author: Howard White and Daniel Phillips Type: Research & Reports Date: Jun 1, 2012
Download (637.96 KB) -
Advocacy & Policy Change Composite Logic Model and associated materials This collaborative work by more than 50 advocates, grantmakers, and evaluators offers a way to improve communication in the advocacy evaluation field by articulating common goals, outcomes, and indicators. Supplements to the Model include guiding questions, definitions, and samples based on hypothetical advocacy situations—one each for the intended "strategy" and "evaluation" uses of the Model. There is also an online tool based on the Model.
Author: Coffman, Julia, et al. Type: Tipsheets & Paper Tools Date: Apr 1, 2007
Web Link -
Advocacy Evaluation Update #10 In this issue:
ADVOCACY EVALUATION AND RIGOR - How to be Methodically Rigorous in the Field of Advocacy Evaluation By Lily Zandniapour and Kathy Brennan
PROFILES FROM THE FIELD - Dr. Paul Zeitz, The Global AIDS Alliance By Laura Ostenso
SPOTLIGHT A User’s Prospective on an Advocacy Evaluation Planning Tool from the Children’s Aid Society - By Moria Cappio and Melanie Reyes
EDITOR’S PICKS News, Events, and Resources
Author: Julia Coffman (ed.) Type: Newsletters & Periodicals Date: Oct 1, 2010 Be the first to review this resource! Download (425.54 KB) -
Advocacy Evaluation Update #9 In This Issue:
1. Feature: Framework of Factors that Affect Political Support
Why do some issues receive priority attention from political leaders while others receive very little? Political scientist Jeremy Shiffman has developed a framework that offers a response to this question.
2. Spotlight: Evaluating Community Organizing
Catherine Crystal Foster and Justin Louie identify what to consider when evaluating community organizing efforts. They also offer example benchmarks and methods for capturing organizing outcomes.
Author: Julia Coffman (ed.) Type: Newsletters & Periodicals Date: May 1, 2010 Be the first to review this resource! Download (329.6 KB) -
Advocacy Impact Evaluation Reflections on a retrospective advocacy evaluation case study of a legislative campaign. The case study, based on a thorough review of the campaign’s activities, interviews with key informants, and careful analysis of the Supreme Court decision, examines a coordinated final-push campaign and its outcomes. Author: Patton, Michael Quinn Type: Research & Reports Date: Mar 1, 2008 Point K Pick
Download (275.26 KB) -
Advocacy in Action: A toolkit to support NGOs and CBOs responding to HIV/AIDS This toolkit is a guide to facilitating a workshop for planning an advocacy effort. Section 2.8 of the toolkit (pp. 56-60) presents step-by-step instructions to selecting and monitoring indicators, and performing an evaluation. Author: International HIV/AIDS Alliance Type: Workbooks & Guides Date: Jan 1, 2002 Be the first to review this resource! Download (2.01 MB) -
Advocacy Strategies for Civil Society: A Conceptual Framework and Practitioner’s Guide Fox and Helweg developed this publication to help USAID evaluate advocacy components of international development projects. The publication discusses advocacy strategies as part of a developmental project, how to choose the correct advocacy strategy for a project, and the process of identifying and developing advocacy capacity building needs. Author: Fox, Leslie M., and Helweg, Priya Type: Workbooks & Guides Date: Jan 1, 1997
Download (196.06 KB) -
AEA Workshop Presentation: "Expanding Advocacy Capacity" The authors, from the Philip R. Lee Institute for Health Policy Studies at the University of California, San Francisco, presented the following slides during a workshop at the American Evaluation Association 2008 conference. Their session covered the findings (and methods) from their evaluation of The California Endowment's Clinic Consortia Policy and Advocacy Program. Author: Gardner, Annette; Geierstanger, Sara; Brindis, Claire Type: Presentation Slides Date: Oct 28, 2008 Be the first to review this resource! Download (850 KB) -
Agency and Empowerment: A Proposal for Internationally Comparable Indicators This article proposes a short list of internationally-comparable indicators of inclividual agency and empowerment (and the corresponcling survey questions). Data from these indicators would enable researchers to explore research and policy issues such as the interconnections between empowerment and economic or human development. The article sUNeys definitions of agency and empowerment, adopts the definition from Amartya Sen, supplemented by Rowlands' typology. Author: Solava Ibrahim and Sabina Alkire Type: Research & Reports Date: Jun 30, 2007 Be the first to review this resource! Download (2.21 MB) -
An Ecological Understanding of Evaluation Use: A Case Study of the Active for Life Evaluation This document presents a case study of use of an evaluation of Active for Life: Increasing Physical Activity Levels in Adults Age 50 and Older a program sponsored by the Robert Wood Johnson Foundation (RWJF). The breadth of both the program and the evaluation created additional ways of thinking about evaluation use–what it looks like, where you find it and how to connect it.
Author: Judith Ottoson and Diane Martinez, Type: Research & Reports Date: Jun 1, 2010 Be the first to review this resource! Download (847.79 KB) -
An Essential Guide to SWOT Analysis The Essential Guide to SWOT Analysis is the end product of a unique collaboration. As previously noted, through my work at a startup, I realized that there were no great, comprehensive SWOT guides out there, especially for people in the business world. So, I enlisted my college mentor, Justin Gomer, a Lecturer at UC Berkeley, and we decided to make a comprehensive guide ourselves. Author: Justin Gomer & Jackson Hille Type: Websites & Online Tools Date: Jan 1, 2014 Be the first to review this resource! Web Link -
An Evaluation Approach for an Environmental Think Tank and Advocacy Organization Johanna Morariu described how Innovation Network worked with the Post Carbon Institute to develop an organizational evaluation framework. We developed and fine tuned several assessment areas for think tank evaluation and advocacy evaluation with interview data collected from key informants. Then, in consultation with key staff from the Post Carbon Institute, we created an organizational theory of change. The theory contains information about the organization’s mission; audiences; strategies; focusing events, crises, and windows of opportunity; desired shifts, and impact. Author: Johanna Morariu Type: Opinion (blog, editorial) Date: Apr 19, 2011 Be the first to review this resource! Web Link -
Assessing Capacity for Community Change Efforts: Learnings From an Adaptive Initiative (Presentation slides) Should community change efforts be focused on funding coalitions or funding a flexible group of community leaders? The Kansas Health Foundation has embraced a four-pronged community change model that targets community leaders as key agents of change within each of their funded communities. Author: Kat Athanasiades, Veena Pankaj, Deanna Van Hersh Type: Presentation Slides Date: Oct 17, 2013 Point K Pick Be the first to review this resource! Download (682.32 KB) -
Basic Guide to Outcomes-Based Evaluation for Nonprofit Organizations with Very Limited Resources Aimed specifically at small nonprofits with limited resources, this is a complete, practical guide for a small scale, do-it-yourself outcomes evaluation. Author: McNamara, Carter (ed.) Type: Websites & Online Tools Date: Jan 18, 2008 Point K Pick
Web Link -
Basic Guide to Program Evaluation Carter McNamara's guide to evaluation, part of his Free Management Library and drawn from his book Field Guide to Nonprofit Program Design, Marketing and Evaluation. This guide covers the hows and whys of evaluation, an overview of evaluation and data collection methodologies and how to choose between them, analysis and interpretation advice, and other tips. Author: McNamara, Carter (ed.) Type: Websites & Online Tools Date: Jan 18, 2008
Web Link -
Basics of Conducting Focus Groups This is a succinct guide to running a focus group. It includes tips for preparation, developing questions, session planning, facilitation, and followup activities. Author: McNamara, Carter (ed.) Type: Websites & Online Tools Date: Jan 18, 2008 Be the first to review this resource! Web Link -
Beyond Boring Bar Charts [Slides] Tired of using the same old pie charts, bar charts, and line charts to tell your nonprofit’s story? Don’t have expensive data visualization software? Can’t afford to hire a graphic designer to transform your default Excel charts into polished masterpieces? In this 5-minute Ignite presentation at the Nonprofit Technology Conference, Ann Emery showed nonprofit leaders how to transform their default Excel charts by simply leveraging a little Excel elbow grease. Author: Ann K. Emery Type: Presentation Slides Date: Apr 22, 2013 Be the first to review this resource! Web Link -
Blog: "Monitoring and Evaluation NEWS" Monitoring and Evaluation NEWS is a frequently-updated blog / news website managed by Rick Davies in the UK. The site focuses on M&E methods for aid / development programs, and includes news, opinion, jobs, and events.
Author: Davies, Rick Type: Websites & Online Tools Date: Jan 1, 1997 Point K Pick Be the first to review this resource! Web Link