What are the social impact evaluation methods for R&D projects?

1 Theory of Change

One of the first steps in social impact evaluation is to define your theory of change, which is a logical framework that explains how your R&D project will lead to the desired social outcomes and impacts. A theory of change helps you identify your assumptions, risks, indicators, and evidence sources, and guides your data collection and analysis. You can use various tools to create and visualize your theory of change, such as logic models, outcome maps, or impact pathways.

2 Impact Evaluation

Impact evaluation is a rigorous method that aims to estimate the causal effects of your R&D project on the social outcomes and impacts of interest. Impact evaluation usually involves comparing the situation of the beneficiaries of your project with a counterfactual scenario, which is what would have happened in the absence of your project. To establish a valid counterfactual, you need to use appropriate methods to select or construct a comparison group, such as randomization, matching, or regression. You also need to collect and analyze quantitative and qualitative data from both groups before and after the intervention.

3 Social Return on Investment

Social return on investment (SROI) is a method that quantifies the social value of your R&D project in monetary terms. SROI compares the costs of your project with the benefits it generates for the stakeholders, such as improved health, education, or income. SROI involves six steps: establishing scope and stakeholders, mapping outcomes, evidencing outcomes and giving them a value, establishing impact, calculating the SROI ratio, and reporting, using and embedding. SROI can help you demonstrate the cost-effectiveness and sustainability of your R&D project.

4 Social Network Analysis

Social network analysis (SNA) is a method that examines the structure and dynamics of the social relationships that are influenced by your R&D project. SNA can help you understand how your project affects the social capital, trust, collaboration, learning, and innovation of the stakeholders. SNA involves collecting and analyzing data on the nodes (actors) and ties (relationships) in your network, using tools such as surveys, interviews, or observation. You can also use software to visualize and measure various aspects of your network, such as density, centrality, or clusters.

5 Participatory Evaluation

Participatory evaluation is a method that involves the active engagement of the stakeholders in the design, implementation, and use of the evaluation of your R&D project. Participatory evaluation can help you increase the relevance, ownership, and empowerment of the stakeholders, and foster mutual learning and feedback. Participatory evaluation can use various methods and tools, such as focus groups, workshops, storytelling, or games, to collect and analyze data from the perspectives of the stakeholders.

6 Mixed Methods

Mixed methods is an approach that combines quantitative and qualitative methods to provide a more comprehensive and nuanced understanding of the social impact of your R&D project. Mixed methods can help you address different types of questions, triangulate and validate your findings, and enrich and explain your results. Mixed methods can use various strategies, such as sequential, concurrent, or embedded, to integrate the quantitative and qualitative data and analysis.

7 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?