Seeking Measurable Program Impact

Will Pay for Performance Strategies Improve Impact?
Is Further Innovation Needed?

Posted by Debbie Koh

A few years ago, someone who wanted to give money to a nonprofit would likely head to Charity Navigator’s website, check that the organization’s program expenses amounted to at least 90%, and give it a green light. If the majority of the nonprofit’s money was going straight to programs, it must be an effective organization making a significant impact on the population it served… right?

Donors (whether individuals, governments or other entities) have become more sophisticated in their approach. “Measurable impact” is funders’ new mantra, especially as many have tightened their purse strings in the continued economic uncertainty. It’s no longer sufficient for a nonprofit to point to their program ratio as evidence of their ability to reduce hunger or increase access to health care. Nonprofits must be able to specify the indicators they will measure to demonstrate the larger impact they hope to achieve.

Tying funding directly to outcomes is one way donors are trying to get the most bang for their buck. The popularity of pay-for-performance (P4P) programs, for example, is on the rise – especially in healthcare. Linking compensation to physicians or hospitals in the U.S. is hoped to achieve targets that range from reducing readmission rates to improving patient satisfaction survey scores (see Wagner professor Jan Blustein’s post on P4P in NYC’s public hospitals here). In resource-poor settings where governments seek to increase the utilization of certain health services, a P4P scheme might provide monetary incentives to providers who enroll a target number of patients in a vaccination program, for example.

Social impact bonds (SIBs), another “pay for success” model, are structured so that private investors supply the initial capital for a program, and receive a return on their investment from the government only when the program achieves previously specified targets or outcomes. Goldman Sachs provided a nearly $10 million loan to New York City to help reduce recidivism rates at Rikers Island. A rate reduction of 10 percent will earn back Goldman’s investment; but a rate increase will lose Goldman up to $2.4 million (read more about the program here). New York State recently announced potential funding for up to $100 million in SIBs over the next five years (press release here). Development impact bonds (DIBs) apply the SIB model to international development programs, where donors or host-country governments will be responsible for repaying private investors if the agreed upon targets are met.

Finally, direct cash payments may be the most radical example of connecting aid to social change. Perhaps most well known, the Government of Mexico pays cash to target families through the Oportunidades program when families fulfill certain conditions, such as enrolling their children in school or taking their children to regular health exams. India is experimenting with making direct payments into recipients’ bank accounts; if it goes well, they may expand such payments to replace fuel and food distribution that may be more easily misdirected away from its intended recipients. After all, is there a better way to claim impact than putting money directly into the hands of beneficiaries?

The tools mentioned above may not work in all circumstances; more evidence and testing is certainly required. Achieving social change is a highly complex problem; improving health, for example will require a multitude of approaches whether in the United States or abroad. As someone who works in the traditional “fund a program” model, I welcome innovation in this area. I believe that the more methods we have available, the greater chance of success we have.

Debbie graduated from Wagner in 2010 with her MPA in Health Policy and Management, International Health. She returned to her native California in 2011 and currently works forVenture Strategies Innovations. Follow her on Twitter at @thedebkoh or connect viaLinkedIn. All views expressed are her own.

Accuracy is Only Half the Battle

Posted by Paloma Medina

In healthcare, as in most fields, the only thing better than accurate data is accurate data that reaches the right audience — i.e an audience that can turn that data into action/ change/ impact. How good is a comprehensive data set if it remains locked away in the academic realm? However, transforming data into information that shifts paradigms and moves key people into action requires a distinctly different skill set than assuring the accuracy and relevancy of the same data. Consequently, it is not surprising that the people involved in collecting and making sense of raw data are not the same as the folks thinking about how data can achieve maximum impact. Furthermore, these two types of people, the data wranglers and the designers, tend to occupy different spaces. Though this is slowly changing, the two camps traditionally have gone to different schools, worked for different companies, read different magazines, etc. Wagner for example, is teeming with data wranglers (and thankfully so!).  We have a wealth of analysts, evaluators, aggregators, statisticians and general data enthusiasts who bring a wealth of data management experience into the classroom. What we may be missing in our midst are the designers, the ones who are interested in questions such as:

-How do we turn this data into easy-to-reference knowledge?

-What new audiences could our data reach?

-How can we make our data compete with all the other information our audience is bombarded with?

-What makes data useful, digestible, intriguing?

-Can data motivate and inspire?

In healthcare, these questions become incredibly relevant — whether we are administrators interested in training 200 providers in a new procedure or we are program evaluators attempting to create a better way to collect patient feedback. Considering design in our work increases its efficacy because it takes into account what designers know – that just because it’s important doesn’t mean anyone is going to notice or care. Turning data into something people will pay attention to and easily absorb is about so much more than accuracy and relevancy. Good data design taps into aesthetic theory, psychology, anthropology, sociology, branding strategy and so much more. This is precisely what designers can bring to the table.

My question, then, is:

How might the healthcare field benefit from increased collaboration with the design field?

Great strides are being made in this arena. I propose to explore them further in upcoming weeks. I encourage you to continue the conversation with colleagues, and to email me your questions, tips, and links.  For now, I leave you with this:

Paloma Medina is an MPA HPAM 2012 candidate with a specialization in organizational coaching and development. Her background is in homeless health care, community development and design.