Category: research assessment

Developing a “responsible assessment” system to improve research impact: a case study from Catalonia

Many lessons can be drawn from the burgeoning discourse on research impact assessment. Paula Adam, Maite Solans-Domènech, Núria Radó-Trilla, Toni Dedeu and Albert Barberà explain how they have applied these to the design of a health research assessment system in Catalonia, one that helps to embed impact from the early stages of a research programme. Emphasising the importance of values, […]

There is an absence of scientific authority over research assessment as a professional practice, leaving a gap that has been filled by database providers

Research metrics have become more established as a means to assess research performance. This is understandable given research institutions’ and funders’ demand for assessment techniques that are relatively cheap and universally applicable, even though use of such metrics remains strongly contested within scientific communities. But to what extent does the academic research field of evaluative citation analysis confer legitimacy to […]

Into oblivion: a closer look at the business, management and accounting research literature in Ibero-America

Faced with institutional requirements to publish in top-tier, international journals, researchers from Ibero-American countries often express concern that their work is becoming distant from their local communities. The value of participating in international debates and being able to influence the direction of research globally is sometimes provided as justification for this. But does this withstand scrutiny? Julián David Cortés-Sánchez has […]

Making research evaluation processes in Europe more transparent

Researchers repeatedly cite career advancement as a key incentive for their practices and behaviours. This is critical to understanding the pace of change in scholarly communications, as those researchers inclined to innovate or experiment with new forms of research outputs, methodologies, or communication styles risk being penalised by the evaluation system used by many research institutions that are slow to […]

How to compare apples with oranges: using interdisciplinary “exchange rates” to evaluate publications across disciplines

Academic research performance is typically assessed on the basis of scientific productivity. While the number of publications may provide an accurate and useful metric of research performance within one discipline, interdisciplinary comparisons of publication counts prove much more problematic. To solve this problem, Timo Korkeamäki, Jukka Sihvonen, and Sami Vähämaa introduce interdisciplinary “exchange rates”, which can be used to convert […]

Six principles for assessing scientists for hiring, promotion, and tenure

The negative consequences of relying too heavily on metrics to assess research quality are well known, potentially fostering practices harmful to scientific research such as p-hacking, salami science, or selective reporting. The “flourish or perish” culture defined by these metrics in turn drives the system of career advancement in academia, a system that empirical evidence has shown to be problematic […]

Book Review: Publish or Perish: Perceived Benefits versus Unintended Consequences by Imad A. Moosa

Academics today have to publish to succeed. In Publish or Perish: Perceived Benefits versus Unintended Consequences, Imad A. Moosa assesses the disastrous consequences of this view for academics, both personally and academically. Review by James Hartley. This review originally appeared on LSE Review of Books and is published under a CC BY-NC-ND 2.0 UK license. Publish or Perish: Perceived Benefits Versus Unintended Consequences. Imad […]

A brief history of research impact: how has impact assessment evolved in the UK and Australia?

Over the last couple of decades there has been an international push around the assessment of the wider societal impact of research. Kate Williams and Jonathan Grant document the evolution of research impact assessment in the UK and Australia, and how policies in the two countries have been seemingly interdependent, a back-and-forth process developed through international learning. Continued political commitment […]

Looming REF deadlines lead to a rush in publication of lower quality research

The increased significance of research assessments and their implications for funding and career prospects has had a knock-on effect on academic publication patterns. Moqi Groen-Xu, Pedro A. Teixeira, Thomas Voigt and Bernhard Knapp report on research that reveals a marked increase in research productivity immediately prior to an evaluation deadline, which quickly reverses once the deadline has passed. Moreoever, the […]