Category: hefcemetrics

Choosing the Right Criteria: Universities need to identify what behaviours should be valued and reward accordingly.

If universities are to thrive, evaluation criteria must capture and recognise exemplary contributions. To discontinue the legacy of poor indicators, Athene Donald calls for the focus on quality to be in more fundamental ways. For example, the mobility of an individual to accept overseas posts and attend international conferences has been frequently used as a proxy for excellence. Moving around […]

Time for REFlection: HEFCE look ahead to provide rounded evaluation of the REF.

Head of Research Policy at the Higher Education Funding Council for England, Steven Hill, presents an overview of the work HEFCE are currently commissioning which they are hoping will build a robust evidence base for research assessment. He argues that attention on the costs, benefits, problems and solutions of the REF are an obvious starting point, but it is also important that the higher […]

Taking pleasure in small numbers: How intimately are social media stats governing us?

Critical academics have long been wary of the way formal quantitative data get used to rank, assess and differentially value universities, departments and people. Do similar concerns apply to social networking statistics? Or, is this data on likes, views and followers quite a different matter? At a time when pressures exist to grow one’s numbers, Davina Cooper asks whether there can […]

Time to abandon the gold standard? Peer review for the REF falls far short of internationally accepted standards.

The REF2014 results are set to be published next month. Alongside ongoing reviews of research assessment, Derek Sayer points to the many contradictions of the REF. Metrics may have problems, but a process that gives such extraordinary gatekeeping power to individual panel members is far worse. Ultimately, measuring research quality is fraught with difficulty. Perhaps we should instead be asking which features […]

The rejection of metrics for the REF does not take account of existing problems of determining research quality.

Amidst heavy scepticism over the role of metrics in research assessments, Martin Smith wonders whether the flaws of the current system have been fully recognised. There is no system of research assessment that is perfect and peer review may well be a better, although problematic, measure of quality than metrics. But the REF has become disproportionate. The question that arises is […]

Is the fear of metrics symptomatic of a deeper malaise? On fiefdoms and scapegoats of the academic community.

This Monday marks the end of the open consultation for HEFCE’s Independent Review of the Role of Metrics in Research Assessment. Steve Fuller expands on his submission and also responds to other prominent critiques offered. He argues that academics, especially interdisciplinary scholars, should welcome the opportunity to approach the task of citation differently. Whilst many complain of the high citation rates of […]