How can funders use evidence to transform project effectiveness?

Posted: 4th May 2023

Photo: Sergiy Kantsyrenko

What is the role of funders in supporting the effectiveness of a sector? In the last few years, a group of conservation funders has been considering effectiveness in the light of evidence, and adapting their processes to encourage the use of evidence in planning and delivery of conservation projects. Readers will no doubt be aware of the huge variability in the effectiveness of the initiatives funders support: some are very successful while others are not. These funders think that one part of that puzzle is ensuring that the initiatives they fund build, as far as possible, on the experiences of others.

The journey started with The Whitley Fund for Nature, which helps scale-up established small conservation projects. As part of selecting which projects to fund, the Whitley team  developed a new approach, in which applicants were asked to reflect on why their project was likely to succeed, on the basis of any existing evidence they had identified.

This process has since been adopted by a number of other organisations ranging from small funders to governments. Twenty-five of these funders came together last year and published a letter in a leading conservation journal (‘Funding evidence-based conservation)  outlining the importance of asking applicants to reflect on the evidence, and providing a set of ten different potential approaches to doing this. The letter appendix provided a practical framework describing how evidence could be included in grant application forms.

Monitoring and evaluation are crucial components of Endangered Landscapes Programme restoration projects, but it can be challenging for projects to collect data prior to funding. Photo: Oliviu Pop.

Use of evidence in funding workshop

On 28th February 2023, the Environmental Funders Network, Conservation Evidence and the Endangered Landscapes Programme supported a workshop held at the Cambridge Conservation Initiative for thirty funders interested in using evidence to increase their effectiveness. Julien Semelin, Head of Environment Investments at Cartier for Nature, began by describing why Cartier considered evidence use as critical. This included improving efficiency and creating effective projects that can then leverage further funding. The group then heard from a series of funders describing the approaches they had adopted.

Current approaches by funders

Some funders (e.g. People’s Trust for Endangered Species) ask applicants to outline the evidence base for their proposed intervention when they first apply; others (e.g. Endangered Landscapes Programme) wait to discuss the evidence available at a later stage of the application process. Several encourage applicants to think about different types of evidence, whether peer-reviewed, expert opinion (including local knowledge), grey literature or personal experience, and then weigh up the importance of each themselves. This approach allows for a range of evidence bases to be considered, from indigenous knowledge (such as ‘right-way science’) to the results of randomised controlled tests. The aim is to encourage reflection on the existing evidence, for example by considering its quality and relevance to the proposed project.

Many of these approaches are still at an early stage but several funders felt that asking about evidence had improved their application process; others shared lessons learned and relayed how they were adapting and improving their processes. Some participants expressed reservations about the approach, in particular the potential for Western science to dominate other forms of knowledge.

Expert opinion is one type of evidence that funders should consider. Photo: Tornike Bubashvili.

Tools for funders

There are, of course, millions of journal articles with conservation findings, as well as a huge body of grey literature (e.g. reports) from conservation organisations and others that detail evidence of what works and what doesn’t. It would be impossible for applicants or funders to read it all! Tools out there can help, however. The open access Conservation Evidence website provides summarised evidence for thousands of conservation actions (filtered from 1.6 million paper titles in 17 languages). Previous workshops bringing together conservation practitioners, funders and researchers have also created a series of tools for assessing and embedding evidence into practice, summarised in the open access book Transforming Conservation: a practical guide to evidence and decision making.

Benefits and costs of using evidence in funding decisions

The benefits of using evidence in funding decisions are two-fold: enabling funders to identify the projects that are likely to deliver, and incentivising applicants to thoroughly explore the viability of proposed options when planning projects. More broadly, this could precipitate a sea change in conservation effectiveness, as practitioners routinely check for evidence when planning any project.

There is concern that asking applicants to provide the evidence base for their proposals could suppress innovation or discourage work on understudied species, issues or locations, where little or no previous evidence exists. The consensus among the funders at the February workshop was that new ideas should be welcomed; in these cases, applicants should be encouraged to design projects that will collect data on the outcomes of these understudied actions and share the results, thereby building the collective evidence base. Bill Sutherland of Conservation Evidence raised an example of how not to do this in bat bridges – these started as a reasonable, novel idea to reduce vehicle collisions with bats, then moved into best practice, without an intervening process of testing: subsequent studies by academics showed that these structures are not effective in reducing bat mortality.

Local and traditional knowledge is an area of evidence that is sometimes overlooked. Photo: Zafer Kizilkaya.

Using evidence is not without its challenges, as conservation deals with many complex problems. A potential issue could be funders and Western conservation practitioners giving primacy to Western academic and practitioner evidence over other forms of traditional or culturally specific knowledge. Trust in different types of evidence may vary from person to person, and decision-making needs to find ways to combine scientific evidence of different kinds with values and local experience. There is still much more to do in this area, particularly around community-based conservation and policy making.

Improving evidence-based funding

The MAVA Foundation has been contributing to this dialogue as it draws to a close in June 2023 with its series of learning reports. With much of MAVA’s funding directed towards organisational support, networks and conservation aimed at changing attitudes and policies, they have much to offer by way of reflecting on the evidence base for more complex approaches to conservation. The Conservation Learning Initiative combined evidence from grantee reports with the wider published evidence base to learn lessons about a number of key conservation strategies including capacity building, forming partnerships and alliances, providing flexible funding, and supporting research and monitoring. The lessons learned have immediate relevance to the wider conservation community, while the approach to learning that was developed can serve as a template to answer a range of future important questions.

Judging by the enthusiasm at the workshop and the progress made in the last few years, it seems there is a real appetite for improving the efficiency of practice. The workshop resulted in more funders deciding to ask applicants to reflect on the evidence and allowed those that are doing this already to share their experiences and work together to improve processes for evidence checking. Next steps identified include the formulation of standard questions that any funder can use to ask applicants about the evidence for their proposed work and the development of approaches by which funders can encourage the testing of actions to generate new evidence. The hope is that evidence checking will  become a routine part of project planning, resulting in more effective conservation and increasing standards, attracting further funding into conservation.

This article was written by Florence Miller, director of the Environmental Funders Network, and Nancy Ockendon, Endangered Landscapes Programme Science Manager. The article was originally published in the Alliance Magazine. A recording of the workshop is available to watch. 

View all News