The UK’s periodic research assessment exercise has grown larger and more formalised since its first iteration in 1986. Marcelo Marques, Justin J.W. Powell, Mike Zapp and Gert Biesta have examined what effects it has had on the submitting behaviour of institutions, considering the intended and unintended consequences in the field of education research. Findings reveal growing strategic behaviour, including high […]
Category: REF2021
The creative elements of engagement mean that using metrics to measure impact is not always possible
Engagement activities are often noted to create clear, descriptive pathways to impact. However, the lack of standardised metrics and measures means the monitoring and evaluation of engagement activities remains difficult. Sarah Evans and Clare Deane encourage researchers to think creatively about how to measure engagement; by considering outcomes as well as outputs, ensuring indicators are truly relevant to the audience, […]
2017 in review: round-up of our top posts on research evaluation and impact
Increasing REF’s impact weighting could offer incentive for institutions to address societal, economic and global challenges Challenges posed by events such as Brexit highlight the importance of excellent research programmes. Moreover, they represent a broader context in which the next Research Excellence Framework must consider “impact”. But do current REF proposals go far enough towards doing this? Matthew Guest argues that there […]
The Social Mobility Commission is dead. So what does this mean for the impacts arising from the social sciences research that informed its reports?
Alan Milburn’s resignation from the Social Mobility Commission likely spells the end for the body that has come to be seen as an exemplar for the use of research evidence in public policy debate. But what happens to the REF potential of the social sciences research that has been cited in the commission’s reports? Can REF panels ignore the fact […]
Policy Fellowships Programme: developing enduring relationships between academia and policymakers
Having an impact on policy is an important part of demonstrating the wider contribution of academic work and expertise. The Policy Fellowships Programme was set up as part of a wider commitment to find increased and better ways for scientific expertise and evidence to be considered in public policy. Nicola Buckley and Charlotte Sausman explain the background to the programme, emphasise […]
Institutional support for impact remains at the relatively early stages of embeddedness
An established discourse within UK higher education institutions has developed around the pursuit of “academic excellence with impact”. However, the everyday reality is that, in terms of institutional support and opportunities, the impact element is not as embedded as that of academic excellence. Carlos Galán-Díaz has adapted the EDGE Tool, developed to assess universities’ strategic and practical support for public […]
Where’s the evidence? Obstacles to impact-gathering and how researchers might be better supported in future
Despite the increased importance of demonstrating impact, it remains a concept many academics feel ill-equipped to measure or evidence. Clare Wilkinson reveals how researchers from a broad range of disciplines think about evidencing impact, what obstacles might stand in their way, and how they might be further supported in future. Knowledge around research impact continues to exist in siloes, with […]
Rather than promoting economic value, evaluation can be reclaimed by universities to combat its misuse and negative impacts
To critics across higher education, evaluation frameworks such as the REF and TEF represent mechanisms of control, the generation of a “target and terror” culture. Deirdre Duffy explains how the REF and TEF resonate most closely with impact evaluation, a form of evaluation that can prove useful for a simple cost-benefit analysis but can also be problematic as it encourages […]
Credit for research outputs should go to the originating institution but with a transitional arrangement for this REF cycle
One of the most contentious aspects of the Stern review of the 2014 REF was the recommendation that research outputs should not be portable in future exercises. The subsequent consultation revealed a significant minority to be in support of this, echoing Stern’s concerns that current rules distort investment incentives and encourage rent-seeking. However, a majority opposed this recommendation as stifling […]
If academics are serious about research impact they need to learn from monitoring, evaluation and learning teams
The impact of academic research, particularly on policy and the private sector, is an increasingly important component of research assessment exercises and funding distribution. However, Duncan Green argues that the way many researchers think about their impact continues to be pretty rudimentary. A lack of understanding of who key decision-makers are, a less-than-agile response to real-world events, and difficulties in […]