How do you measure research impact in a changing landscape?

1 What is research impact?

Research impact can be defined as the influence or effect of research on various domains or audiences beyond academia. It can be positive or negative, intended or unintended, direct or indirect, short-term or long-term, and tangible or intangible. Research impact can be measured at different levels, such as individual, project, program, institution, sector, or national. There is no one-size-fits-all approach to measure research impact, as it depends on the context, purpose, and scope of the assessment.

2 Why is research impact important?

Research impact is important for several reasons. First, it can help justify the investment and allocation of resources for research, especially in times of budget constraints and competing priorities. Second, it can help communicate the relevance and value of research to different stakeholders, such as policymakers, practitioners, media, public, and industry. Third, it can help improve the quality and accountability of research, by encouraging researchers to consider the potential implications and applications of their work. Fourth, it can help foster collaboration and innovation, by identifying the gaps and opportunities for knowledge exchange and co-creation.

3 How is research impact measured?

When measuring research impact, there are various methods and tools to consider, depending on the type and level of impact. Bibliometrics, for example, involves analyzing citations, publications, and other outputs of research. Altmetrics involves analyzing online mentions, downloads, views, and other indicators of research attention and engagement. Other methods include case studies (narrative description and evidence of specific examples of research impact), surveys (collection and analysis of feedback and opinions from relevant stakeholders or beneficiaries), interviews (in-depth and structured conversations with key informants or experts), focus groups (moderated and interactive discussions with a group of stakeholders or beneficiaries), and economic analysis (estimation and calculation of the monetary value or return on investment).

4 What are the challenges of measuring research impact?

Measuring research impact presents a number of challenges, such as the complexity of isolating and attributing the causal links between research and impact, the diversity of results and outcomes across disciplines, fields, and sectors, the uncertainty of long-term and indirect effects, the bias in data and evidence of impact, and ethical issues such as privacy, consent, confidentiality, and ownership. All these issues can make it difficult to compare, aggregate, anticipate, measure, ensure validity and reliability, and balance rights and responsibilities.

5 What are the opportunities of measuring research impact?

Measuring research impact can provide researchers, funders, institutions, and stakeholders with valuable insights and lessons regarding the strengths, weaknesses, opportunities, and threats of research. This can enable continuous improvement and enhancement of research, by providing feedback, guidance, and recommendations for future research. Additionally, measuring research impact can increase the recognition and reward of research by highlighting its achievements. Furthermore, it can foster engagement and dialogue with different stakeholders by showcasing the relevance, value, and benefits of research. Ultimately, it can increase the impact of research by informing, influencing, and inspiring change and action in society, economy, environment, culture, and policy.

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?