News & Views

A blog for those interested in what affects, motivates and drives the New York City Nonprofit Sector — written by CRE’s crackerjack consulting team. We hope you use this space to share your thoughts, ask questions and engage in conversations about our city, social justice and the nonprofit sector.

Is Evaluation an Infection?

 

by Louisa Hackett - Recently, a few community-based organizations, evaluators and funders gathered at the City University of New York Graduate Center to discuss, as one participant described it, the accountability regime eating us.

  In discussing how evaluation is affecting (or as some might say infecting) the nonprofit sector, speakers mentioned all the research studies that report the same obvious and well known findings: lack of childcare, healthcare, access to education, employment and transportation restrict vulnerable populations’ ability to move out of poverty.  And, even more distressing, is that funding for evaluation and research undercuts the money available for programs.  

A recent case in point is the New York City-sponsored Opportunity NYC Family rewards that paid poor people to encourage good behaviors (going to the dentist; attending school regularly) and self-sufficiency (holding down a full-time job; passing the high school Regents exam).  The program which paid out more than $14 million to over 2,500 families also cost $10.2 million to run and $9.6 million to evaluate according to the New York Times

Government and foundations interest in funding ‘evidence-based’ programs is founded on a belief that scientifically designed research methods reveal what works.  However, as the group explained, complex social problems require complex interventions and complexity can not always be easily studied like a science experiment. 

Accountability does matter.  Collecting data has the potential to improve programs.  The question becomes creating useful evaluations or feedback mechanisms to make sure programs are effective and bad programs can be improved.  As Katya Fels Smyth and Lisbeth B. Schorr point out in their paper “A Lot to Lose: A Call to Rethink What Constitutes ‘Evidence’ in Finding Social Interventions that Work,” by basing our judgments on many ways of knowing and many sources of evidence, we can avoid the false choice between relying on random assignment experiments versus relying on professions of good intentions, ideology, and a handful of anecdotes.”

How can a nonprofit respond and be equipped to explain their programs impact?  One way is for groups to take back the evaluation language and explain to funders this is how we define and measure success.  An initial step is to develop a theory of change that makes explicit the link between a program’s activities and the impact it wants to make.  Another step is to gather information, including stories that indicate progress is being made within the program’s identified domains of impact.  And finally, groups can say to those funders requesting evaluation data, “will you support our ability to gather and report evidence our program works over and above the funding for the program?” 

« Back to Blog Listings

Find us on:  CRE on Twitter CRE on Facebook CRE on LinkedIn 

News and Views  CRE RSS

Tags

civic engagement internal controls Fran Barrett government Randall Quan Development Survey nonprofit start-ups New York City Government computers RFP NYS Budget Stanford Social Innovation Review Pamela Dicent Valyrie Laedlein Client News Louisa Hackett rockaways House Party Volunteers Nonprofit Quarterly arts Barbara Turk Nonprofit Nonprofit Sustainability harvard business school accountability National Committee of Responsive Philanthropy staff handling the unexpected cre What is Core? Data 30th Anniversary Coaching Jeff Ballow National and Community Service publications lower Manhattan fundraising HR Without HR Advocacy Maria Mottola tips Beth Kobliner nonprofit leaders New York Community Trust New York Times New York Foundation Interns CRE News NYCCCOC MAC AIDS Fund community Huffington Post nonprofit mergers announcment board and staff relations Jean Lobell generative bookkeeping guest blogger nonprofit management Barbara Blumenthal United Way of NYC I.T. without I.T. Nonprofit Tools Useful Links Nonprofit News board leadership executive transition capacity building New York Mohan Sikka mergers Data Starved Government Updates proposal writing Ximena Rua-Merkin Fran's Corner Featured Items Alliance for Nonprofit Management CRE Executive Search Board of Directors media Rona Taylor jobs Michael Hickey Albany nonprofit ownership Hurricane Sandy Philanthropic Collaborative Bill Ryan executive collaborations queens strategic alliances CRE POV evaluation foundations President Obama Funding Updates postponed event hard times Peter Block Mark Light case statement grantmakers Karen Erdos Sector Research Governance as Leadership grantmakers for effective organizations Holly Delany Cole HIV/AIDS services providers Needs Assessment leadership Pavitra Menon Rashid Littlejohn CRE Tips Government News Ero Gray IT record keeping website, resources, announcements Harvard Kennedy School nonprofit accountability Daring to Lead Neighborhood Based Capacity Building Initiative