Category: REF

Can artificial intelligence assess the quality of academic journal articles in the next REF?

In this blog post Mike Thelwall, Kayvan Kousha, Paul Wilson, Mahshid Abdoli, Meiko Makita, Emma Stuart and Jonathan Levitt discuss the results of a recent project for UKRI that made recommendations about whether artificial intelligence (AI) could be us…

The next REF should place greater value on the ‘impact-in-process’ generated by co-produced research.

Impact has in the past two REF cycles established itself as an integral criteria of research assessment in the UK. However, the kinds of impacts that are valued and the ways in which the ‘reach’ and ‘significance’ of impact are interpreted by instituti…

Industry not harvest: Principles to minimise collateral damage in impact assessment at scale

The recent institutional submissions and conclusion of the first phase of the REF, coupled with the announcement of a wide-ranging review of research assessment in the UK, has provided space for renewed thinking on the state of research assessment. In …

Assessing research impact – a tale of 7 impact studies

How to assess research impact? Sarah Morton draws on her own experience of assessing impact arguing that despite diverse topics, settings and countries, there are patterns of successful impact that can help move our learning forward. She outlines her five top lessons for designing and evaluating impact in a research project.    I am not … Continued

Impact a-gender? Calling out the gendered nature of research impact and assessment

Discussions about research impact are often littered with particular language that serves to demonstrate how different forms of impact are valued, promoted and sustained. Drawing on evidence from qualitative datasets, comprising interviews with researchers and research impact evaluators, Jennifer Chubb and Gemma Derrick argue that the language of research impact and assessment is frequently structured … Continued

Knowledge exchange or research impact – what is the difference between REF and KEF?

The UK research system has historically been innovative in its approach to measuring and assessing the impacts of academic research. However, the recent development of the Knowledge Exchange Framework (KEF), has elicited scepticism as to how this framework will significantly differ from the impact element of the Research Excellence Framework (REF). In this post Hamish McAlpine and Steven Hill outline […]

2018 in review: round-up of our top posts on research evaluation and impact

The concept of research impact pervades contemporary academic discourse – but what does it actually mean? Research impact is often talked about, but how clear is it what this term really means? Kristel Alla, Wayne Hall, Harvey Whiteford, Brian Head and Carla Meurk find that academic literature discusses research impact but often without properly defining it, with academic discourses mostly drawing on bureaucratic definitions originating from the […]

A Tale of Two Agendas – or why we need to think differently about impact of research in international development

In addition to the established impact agenda, those doing research for development now also have to contend with the ODA research agenda, primarily aimed at generating impact in developing countries. But as Valeria Izzi observes, while there are clear similarities between the two, so far remarkably little reflection has gone into how they fit together and interplay. There is a […]