At a loss for how to demonstrate impact? Laura Meagher and David Edwards outline a dynamic understanding of impact evaluation comprised of ‘building blocks’. These building blocks are five types of impacts; five broad categories of stakeholders; and eight causal factors, along with a set of over-arching reflective questions. The increasing pressure placed upon … Continued
Category: research evaluation
The role of the research assessment in strengthening research and health systems
Research Impact Assessments are regularly regarded as a tiresome part of the research process. However, Annette Boaz and Stephen Hanney find that taking a systems approach to health research demonstrates the value of assessing impact. Drawing on examples from a new review for the WHO Health Evidence Network, they highlight the role that impact assessments … Continued
For China’s ambitious research reforms to be successful, they will need to be supported by new research assessment infrastructures
The Chinese government recently announced that research assessment in China should no longer be predominantly focused on metrics, Web of Science based indicators and what has become known as ‘SCI worship’. In this post Lin Zhang and Gunnar Sivertsen discuss how China’s new research policy might be implemented and the parallels it has to recent attempts to reform … Continued
Future impact – How can we rationally evaluate impact statements?
Making claims about the future impact of research as part of research grant applications has since it’s inception been controversial. As, if impact statements are accurate they suggest that the outcomes of research are already known. As UKRI (the UK’s main research funding body) considers scrapping impact statements, Paul Benneworth and Julia Olmos Peñuela argue … Continued
CRediT Check – Should we welcome tools to differentiate the contributions made to academic papers?
Elsevier is the latest in a lengthening list of publishers to announce their adoption for 1,200 journals of the CASRAI Contributor Role Taxonomy (CRediT). Authors of papers in these journals will be required to define their contributions in relation to a predefined taxonomy of 14 roles. In this post, Elizabeth Gadd weighs the pros and … Continued
2019 In Review: Metrics and research assessment
As governments increasingly look to national research systems as important inputs into the ‘knowledge economy’, developing ways to assess and understand their performance has become focus for policy and critique. This post brings together some of the top posts on research metrics and assessment that appeared on the LSE Impact Blog in 2019. Working to the rule – How bibliometric […]
To make PhDs fit for the 21st century we need to develop evidence based policies
The growth of PhD level education globally and in the UK has changed the nature of what it means to be a PhD holder. However, despite there being more PhDs and more value placed on producing them, there is still a severely limited evidence base for understanding PhD outcomes. Drawing on their recent working paper, Sally Hancock and Paul Wakeling […]
Working to the rule – How bibliometric targets distorted Italian research
As Goodhart’s law states: ‘when a measure becomes a target, it ceases to be a good measure’. Using bibliometrics to measure and assess researchers has become increasingly common, but does implementing these policies therefore devalue the metrics they are based on? In this post Alberto Baccini, Giuseppe De Nicolao and Eugenio Petrovich, present evidence from a study of Italian researchers […]
Is our current research culture on the brink of major change?
The culture of research often appears timeless and self-evident. Despite the current system of research being critiqued for its lack of openness, diversity and at times quality, it has remained largely unchanged for at least a generation. In this post, Liz Allen, highlights how contrary to this view, a growing number of developments are currently taking place across different countries […]
Is who you know as important as what you know? Mapping the invisible colleges supporting academic prestige
A core principle of modern research culture according to the sociologist Robert Merton was ‘universalism’, the idea that the validity of ideas was independent of the status of the person making them. However, as a number of recent studies have shown in practice academia can also be exclusionary. In this post, Margath Walker shows how academic networks – invisible colleges […]