Browse Analysis and Reflection Resources
-
"Participatory Performance Story Reporting" Clear Horizon, an M&E company in Australia, describes its participatory approach, specifically as it relates to the method of performance story reporting (PPSR). The company defines performance story reports as "essentially a short report about how a program contributed to outcomes." This page on their website includes links to other pages that describe the structure, process, and limitations of this the PPSR method. Author: Clear Horizon Type: Websites & Online Tools Date: Dec 31, 2008 Be the first to review this resource! Download (161.39 KB) -
"Real-life Lessons Learned and Resources in Building Capacity for Advocacy and Policy Evaluation among KIDS COUNT Grantees" The Annie E. Casey Foundation and Organizational Research Services, Inc. recount ten lessons learned from an evaluation of five KIDS COUNT grantees that began in 2007. The evaluation was designed to test some of the ideas presented in "A Guide to Measuring Advocacy and Policy", a report produced by AECF and ORS in 2006. This handout, distributed at the American Evaluation Association 2008 conference, also contains a list of advocacy evaluation resources available on ORS's website. Author: Annie E. Casey Foundation; Organizational Research Services Type: Tipsheets & Paper Tools Date: Nov 6, 2008 Be the first to review this resource! Download (261.49 KB) -
#14ntcdataviz: DataViz! Tips, Tools, and How-tos for Visualizing Your Data [Resource Handout] This resource handout accompanied our presentation at the Nonprofit Technology Conference on March 13, 2014 in Washington, DC. Author: Johanna Morariu and Ann Emery, Innovation Network Type: Tipsheets & Paper Tools Date: Mar 13, 2014 Point K Pick Be the first to review this resource! Download (349.1 KB) -
#14ntcdataviz: DataViz! Tips, Tools, and How-tos for Visualizing Your Data [Slides] Presentation by Ann K. Emery, Johanna Morariu, and Andrew Means at the 2014 Nonprofit Technology Conference in Washington, DC. Author: Ann K. Emery and Johanna Morariu Type: Presentation Slides Date: Mar 13, 2014 Point K Pick Be the first to review this resource! Web Link -
#JAGUnity2014: DataViz for Philanthropists! Tips, Tools, and How-Tos for Communicating Better with Charts [Handout] This resource handout accompanied a presentation by Innovation Network's Johanna Morariu and Ann K. Emery for the Joint Affinity Group's Unity Conference on June 6, 2014 in Washington, DC. Author: Johanna Morariu and Ann K. Emery, Innovation Network Type: Tipsheets & Paper Tools Date: Jun 6, 2014 Be the first to review this resource! Download (255.28 KB) -
#JAGUnity2014: DataViz for Philanthropists! Tips, Tools, and How-Tos for Communicating Better with Charts [Slides] Presentation by Innovation Network's Johanna Morariu and Ann K. Emery at the Joint Affinity Groups Unity Conference, held June 6, 2014 in Washington, DC. Author: Johanna Morariu and Ann K. Emery, Innovation Network Type: Presentation Slides Date: Jun 6, 2014 Point K Pick Be the first to review this resource! Web Link -
#YNPNdc14: DataViz! Tips, Tools, and How-tos for Visualizing Your Data [Resource Handout] Johanna Morariu and Ann K. Emery presented at the Young Nonprofit Professionals Network 2014 Annual Leadership Conference, which was held on May 9, 2014 in Washington, DC. Author: Johanna Morariu and Ann K. Emery, Innovation Network Type: Tipsheets & Paper Tools Date: May 9, 2014 Point K Pick Be the first to review this resource! Download (253.7 KB) -
#YNPNdc14: DataViz! Tips, Tools, and How-tos for Visualizing Your Data [Slides] Johanna Morariu and Ann K. Emery presented at the Young Nonprofit Professionals Network 2014 Annual Leadership Conference, which was held on May 9, 2014 in Washington, DC. Author: Johanna Morariu and Ann K. Emery, Innovation Network Type: Presentation Slides Date: May 9, 2014 Point K Pick Be the first to review this resource! Web Link -
5 Evaluation Lessons From a Recovering Program Officer (Presentation slides) As a profession, evaluators must constantly demonstrate the value of their work to remain relevant. Each evaluation represents a significant investment in resources that many argue could be used to provide more programming. Author: Will Fenn Type: Presentation Slides Date: Oct 17, 2013 Point K Pick Be the first to review this resource! Download (4.05 MB) -
5 Evaluation Lessons from a Recovering Program Officer (recording) As a profession, evaluators must constantly demonstrate the value of their work to remain relevant. Each evaluation represents a significant investment in resources that many argue could be used to provide more programming. A primary concern of maintaining the value proposition of the evaluation field is ensuring that evaluations remain manageable and useful to all participants. The Ignite session offered five succinct lessons from a former foundation Program Officer that can be applied across program types to help nonprofits and foundations improve evaluation coordination and use. Author: Will Fenn Type: Websites & Online Tools Date: Oct 17, 2013 Be the first to review this resource! Web Link -
A Dataviz Technique New to aea365 Johanna Morariu describes treemaps, a relatively new data visualization technique, especially to evaluators. The technique was created in the 1990s by Dr. Ben Shneiderman for mapping computer hard drive usage. Treemaps are useful for visualizing hierarchical data, or tree structure data. Area is used to proportionally illustrate differences in values, i.e., how many program participants fall into each of the nested categories. She also shares resources for making your own treemaps. Author: Johanna Morariu Type: Opinion (blog, editorial) Date: Jun 23, 2013 Be the first to review this resource! Web Link -
A Guide to Actionable Measurement Staff members from the Bill & Melinda Gates Foundation discuss the principles and practices they use to make decisions about data collection, analysis, and reporting. Their approach, "actionable measurement," emphasizes the collection of information for specific decisions or actions.
UPDATE: We had a broken link here. It was updated on Jan. 13, 2011.
Author: Bill & Melinda Gates Foundation Type: Research & Reports Date: May 10, 2010
Download (284.17 KB) -
A Helpful Guide to Failure in Philanthropy. Use Carefully. Larry Blumenthal's article provides perspective about the fear of failure in philanthropy, and how to overcome that fear so foundations can learn from their mistakes (and other foundation's mistakes) to achieve their mission and program goals. Author: LARRY BLUMENTHAL Type: Newsletters & Periodicals Date: Jan 7, 2010 Be the first to review this resource! Web Link -
A Menu of Assessment Activities This brief menu of questions provides a simple, straightforward overview of evaluation activities. Author: Brett A. Magill Type: Tipsheets & Paper Tools Date: Feb 24, 2010
Download (86.05 KB) -
A Practical Guide for Engaging Stakeholders in Developing Evaluation Questions This guide describes a five-step process for engaging stakeholders in developing evaluation
questions, and includes four worksheets and a case example to further facilitate the planning
and implementation of your stakeholder engagement process.Step 1: Prepare for stakeholder engagement: This step includes collecting information about
the program or initiative being evaluated—its history, why it came into being, what it is trying
to accomplish and what success would look like.Author: Hallie Preskill and Nathalie Jones Type: Workbooks & Guides Date: Jun 1, 2009 Be the first to review this resource! Download (1001.41 KB) -
Abdul Latif Jameel Poverty Action Lab Executive Training: Evaluating Social Programs 2009 This five-day program on evaluating social programs provides a thorough understanding of randomized evaluations and pragmatic step-by-step training for conducting one's own evaluation. While the course focuses on randomized evaluations, many of the topics, such as measuring outcomes and dealing with threats to the validity of an evaluation, are relevant for other methodologies.
Courses have been recorded and loaded as videos online, split up by topic. You may also access the course lecture notes and assignments.Author: Esther Duflo, Rachel Glennerster, & Abhijit Banerjee Type: Websites & Online Tools Date: May 1, 2009 Be the first to review this resource! Web Link -
Addressing Attribution of Cause and Effect in Small n Impact Evaluations: Towards an Integrated Framework With the results agenda in the ascendancy in the development community, there is an increasing need to demonstrate that development spending makes a difference, that it has an impact. This requirement to demonstrate results has fuelled an increase in the demand for, and production of, impact evaluations. There exists considerable consensus among impact evaluators conducting large n impact evaluations involving tests of statistical difference in outcomes between the treatment group and a properly constructed comparison group.
Author: Howard White and Daniel Phillips Type: Research & Reports Date: Jun 1, 2012
Download (637.96 KB) -
Advocacy & Public Policy Grantmaking: Matching Process to Purpose Building on research conducted in 2007 by Coffman and Campbell, this brief summarizes advocacy and public policy grantmaking approaches and their implications for grant portfolio composition and management, auxiliary supports and evaluation. “Advocacy and public policy grantmaking” refers to grantmaking in support of a wide range of advocacy activities that are intend to trigger, block, maintain, support and/or monitor changes in public policy at any level of government. Author: Tanya Beer, Pilar Stella Ingargiola, and Meghann Flynn Beer Type: Research & Reports Date: Aug 5, 2012 Be the first to review this resource! Download (1.17 MB) -
Advocacy Evaluation Update #10 In this issue:
ADVOCACY EVALUATION AND RIGOR - How to be Methodically Rigorous in the Field of Advocacy Evaluation By Lily Zandniapour and Kathy Brennan
PROFILES FROM THE FIELD - Dr. Paul Zeitz, The Global AIDS Alliance By Laura Ostenso
SPOTLIGHT A User’s Prospective on an Advocacy Evaluation Planning Tool from the Children’s Aid Society - By Moria Cappio and Melanie Reyes
EDITOR’S PICKS News, Events, and Resources
Author: Julia Coffman (ed.) Type: Newsletters & Periodicals Date: Oct 1, 2010 Be the first to review this resource! Download (425.54 KB) -
Advocacy Evaluation Update #9 In This Issue:
1. Feature: Framework of Factors that Affect Political Support
Why do some issues receive priority attention from political leaders while others receive very little? Political scientist Jeremy Shiffman has developed a framework that offers a response to this question.
2. Spotlight: Evaluating Community Organizing
Catherine Crystal Foster and Justin Louie identify what to consider when evaluating community organizing efforts. They also offer example benchmarks and methods for capturing organizing outcomes.
Author: Julia Coffman (ed.) Type: Newsletters & Periodicals Date: May 1, 2010 Be the first to review this resource! Download (329.6 KB) -
Advocacy Impact Evaluation Reflections on a retrospective advocacy evaluation case study of a legislative campaign. The case study, based on a thorough review of the campaign’s activities, interviews with key informants, and careful analysis of the Supreme Court decision, examines a coordinated final-push campaign and its outcomes. Author: Patton, Michael Quinn Type: Research & Reports Date: Mar 1, 2008 Point K Pick
Download (275.26 KB) -
Advocacy, Poiltics & Philanthropy: A Reflection on a Decade of Immigration Reform Advocacy This Innovation Network report examines the impact and shares lessons from Atlantic’s $70.3 million
effort between 2004 and 2014 to reform the U.S. immigration system.
Among the topics covered:
Author: Innovation Network and Atlantic Philanthropies Type: Research & Reports Date: Mar 1, 2016 Be the first to review this resource! Download (1.98 MB) -
AEA Workshop Presentation: "Expanding Advocacy Capacity" The authors, from the Philip R. Lee Institute for Health Policy Studies at the University of California, San Francisco, presented the following slides during a workshop at the American Evaluation Association 2008 conference. Their session covered the findings (and methods) from their evaluation of The California Endowment's Clinic Consortia Policy and Advocacy Program. Author: Gardner, Annette; Geierstanger, Sara; Brindis, Claire Type: Presentation Slides Date: Oct 28, 2008 Be the first to review this resource! Download (850 KB) -
Agency and Empowerment: A Proposal for Internationally Comparable Indicators This article proposes a short list of internationally-comparable indicators of inclividual agency and empowerment (and the corresponcling survey questions). Data from these indicators would enable researchers to explore research and policy issues such as the interconnections between empowerment and economic or human development. The article sUNeys definitions of agency and empowerment, adopts the definition from Amartya Sen, supplemented by Rowlands' typology. Author: Solava Ibrahim and Sabina Alkire Type: Research & Reports Date: Jun 30, 2007 Be the first to review this resource! Download (2.21 MB) -
An Ecological Understanding of Evaluation Use: A Case Study of the Active for Life Evaluation This document presents a case study of use of an evaluation of Active for Life: Increasing Physical Activity Levels in Adults Age 50 and Older a program sponsored by the Robert Wood Johnson Foundation (RWJF). The breadth of both the program and the evaluation created additional ways of thinking about evaluation use–what it looks like, where you find it and how to connect it.
Author: Judith Ottoson and Diane Martinez, Type: Research & Reports Date: Jun 1, 2010 Be the first to review this resource! Download (847.79 KB)