Why donors should ask local communities what matters to them while deciding what success looks like

Have you ever asked a teacher whether something will be on an upcoming test to decide whether to closely pay attention to a particular lesson? Taken the long way back from a lunch break to get enough exercise to meet a goal monitored by a fitness app? Logged on to a virtual meeting to be seen showing up, even as you worked on other tasks?

It’s human nature to adapt your behavior^[1] to meet evaluation criteria – even when meeting those targets comes at the expense^[2] of attaining more meaningful goals. Most donors, whether they are governments providing foreign aid, foundations making grants or individual people who give nonprofits money, expect or demand reports^[3] on what was accomplished with their funding. And what is measured for that purpose and how it’s measured tend to shape entire programs – often missing the mark^[4] on what truly matters to the communities involved.

While spending years conducting fieldwork everywhere from Colombia to the Kenya-Uganda border as a political anthropologist^[5] and a political scientist^[6], we’ve witnessed firsthand the absurdities of the bureaucratic hoops people must jump through to access vital aid. We’ve watched both genuine efforts to abide by the guidelines donors set and the cynical exploitation of them. We have also spent years engaged in international development efforts, both with and through nonprofits that sought to resolve some of the world’s most intractable problems.

There’s a glaring and crucial question we’ve rarely heard asked when projects are being designed: What does success look like to the people meant to benefit from development funding?

Promoting environmental sustainability

We conducted an exploratory field study^[7] in La Reforma, a small coastal town located in the Mexican state of Sinaloa.

We focused on the Leonor Cuadras Oyster Aquaculture Cooperative, a locally led initiative supported by the seafood company Marine Edén and SUCEDE, a Mexican nongovernmental organization that’s dedicated to promoting individual, social and environmental well-being in La Reforma and other nearby communities.

This particular project sought to create jobs for women in La Reforma, while promoting environmental sustainability through oyster farming. The cooperative’s objectives included empowering women, fostering collective work and contributing to local environmental restoration by improving water quality through oyster filtration. Traditional metrics^[8] for projects like this would tally labor hours, harvest size and jobs created – all important but incomplete insights into the whole story.

Our study was unusual because it was designed as an exploratory effort to help shape future metrics in a participatory manner. We sought to understand the cooperative’s internal dynamics and challenges so we could create metrics that reflected what the cooperative members wanted and needed.

After several weeks of fieldwork, multiple focus group discussions and eight interviews with people involved in the cooperative in the last quarter of 2023, we found that success is not solely defined by the number of oysters they produce or the dollar signs next to their names in a report submitted to donors.

In their view, success is framed around dignity, gender equity and the well-being of their families and the environment. We also learned that their work together had increased a sense of collective commitment to the project and each other.

Measuring success in terms that make sense to locals

Most donors love numbers. They want to know how many people attended an event, how much money was spent, how many widgets were produced. But while such outcomes are easily measurable, they are not always meaningful^[9].

In La Reforma, the women who belong to the Leonor Cuadras cooperative told us that they define success differently. Their primary goal isn’t just to grow oysters. They see their co-op as a tool for social transformation, not just a source of income.

One woman we’ll call Aurelia to protect her anonymity proudly shared that working with the cooperative has proved that “we can do things on par with men.”

Julia, another cooperative member, put it this way: “We are not just working for ourselves – we are working for the future of our families and our community.”

This version of success includes improving their family’s prospects and safeguarding their marine environment for future generations. As the oysters they grow naturally filter and clean^[10] the bay’s waters, so too does their collaborative work improve the social fabric of this violence-affected community in ways that won’t show up on a balance sheet.

Finding participatory approaches

When donors impose their own frameworks and set their own goals for the projects they fund, they usually miss what truly defines success for local communities. In La Reforma, the women are acquiring technical skills related to oyster farming, but they seem to see more value in the empowerment that comes with leading a project that reflects their realities and needs.

If the cooperative’s donors had chosen to focus on traditional production metrics, such as the number of participants, the scale of the harvest and the hours of labor involved^[11], they would have surely overlooked the deeper social shifts, such as women’s leadership in a male-dominated profession or a greater commitment to collective well-being.

What if, instead of dictating outcomes from the start, donors worked collaboratively with communities to define success? The cooperative’s members want independence. They hope that someday they will run their own oyster farms or support other aquaculture initiatives. These are aspirations that don’t fit into traditional donor checkboxes. But that kind of approach is critical for the project’s sustainability.

Some donors and development agencies are beginning to integrate this approach. For example, the International Organization for Migration consults with community members when writing performance reviews^[12]. Some donors have embraced an approach called trust-based philanthropy^[13], which largely removes reporting burdens altogether. They focus instead on collaborative relationships with their grantees.

What is measured matters. It can shape the goals and the limits^[14] of projects long before a single dollar is spent.

Setting goals that are more relevant to local conditions requires a radical shift in how development projects are designed and evaluated. Rather than imposing predetermined outcomes, we believe that it is crucial to ask of the communities and individuals on the ground: What does success look like to you?

References

1. ^{^} adapt your behavior (doi.org)
2. ^{^} at the expense (www.plutobooks.com)
3. ^{^} demand reports (doi.org)
4. ^{^} missing the mark (doi.org)
5. ^{^} political anthropologist (wjpcenter.org)
6. ^{^} political scientist (scholar.google.com)
7. ^{^} exploratory field study (www.corioli.org)
8. ^{^} Traditional metrics (www.nature.org)
9. ^{^} not always meaningful (nonprofitaf.com)
10. ^{^} naturally filter and clean (doi.org)
11. ^{^} participants, the scale of the harvest and the hours of labor involved (pdf.usaid.gov)
12. ^{^} consults with community members when writing performance reviews (evaluation.iom.int)
13. ^{^} trust-based philanthropy (theconversation.com)
14. ^{^} can shape the goals and the limits (www.ucpress.edu)