Category: metrics

Invisible impact and insecure academics: structural barriers to engagement and why we should do it anyway

Participatory Action Research (PAR) is a form of research that involves prolonged and deep engagement with local communities and can produce profound social impacts. In this post, Dr Katrina Raynor describes how current approaches to impact assessment and the structure of the academic labour market impede researchers from engaging with PAR and raise particular challenges for insecurely employed early career […]

Introducing the Observatory of International Research: A simple research discovery tool for everyone

Andreas Pacher presents the Observatory of International Research (OOIR), a research tool that provides users with easy to use overviews and information for whole fields of social science research. Reflecting on the advantages and limitations of other discovery tools and the potential for information overload, Andreas points to the utility of OOIR in producing search results that are both broad […]

Book Review: The Data Gaze: Capitalism, Power and Perception by David Beer

In The Data Gaze: Capitalism, Power and Perception, David Beer explores how we are being put under the extractive, analytic and predictive lens of a data gaze that seeks to define our world in increasingly granular detail. Critically probing into the data analytics industry and the imaginary that gives it legitimacy, Beer offers a thoroughly readable take on the structures that are constructing and […]

Book Review: The Data Gaze: Capitalism, Power and Perception by David Beer

In The Data Gaze: Capitalism, Power and Perception, David Beer explores how we are being put under the extractive, analytic and predictive lens of a data gaze that seeks to define our world in increasingly granular detail. Critically probing into the data analytics industry and the imaginary that gives it legitimacy, Beer offers a thoroughly readable take on the structures that are constructing and […]

Now is the time to update our understanding of scientific impact in light of open scholarship

Sascha Friesike, Benedikt Fecher and Gert. G. Wagner outline three systemic shifts in scholarly communication that render traditional bibliometric measures of impact outdated and call for a renewed debate on how we understand and measure research impact. New digital research infrastructures and the advent of online distribution channels are changing the realities of scientific knowledge creation and dissemination. Yet, the […]

The evaluative inquiry: a new approach to research evaluation

Contemporary research evaluation systems are often criticised for negative effects they can have on academic environments and even on knowledge production itself. Established in response to many of these criticisms, the evaluative inquiry is a new, less standardised approach to research assessment. Tjitske Holtrop outlines the four principles that give shape to the evaluative inquiry’s method: employing versatile methods; shifting […]

The growing, high-stakes audit culture within the academy has brought about a different kind of publishing crisis

The spate of high-profile cases of fraudulent publications has revealed a widening replication, or outright deception, crisis in the social sciences. To Marc Spooner, researchers “cooking up” findings and the deliberate faking of science is a result of extreme pressures to publish, brought about by an increasingly pervasive audit culture within the academy. By now most readers will have heard […]

Flipping a journal to open access will boost its citation performance – but to what degree varies by publisher, field and rank

Many observers have drawn the logical conclusion that the increased exposure and visibility afforded by open access leads to improved citation performance of open access journals. Yang Li, Chaojiang Wu, Erjia Yan and Kai Li report on research examining the perceived open access advantage, paying particular attention to journals which have “flipped” to open access from a subscription model. Findings […]

Developing approaches to research impact assessment and evaluation: lessons from a Canadian health research funder

Assessing research impact is complex and challenging, but essential for understanding the link between research funding investments and outcomes both within and beyond academia. Julia Langton provides an overview of how a Canadian health research funder approaches impact assessment; urging caution in the use of quantitative data, highlighting the importance of organisation-wide capacity-building, and outlining the value of a community […]

Better, fairer, more meaningful research evaluation – in seven hashtags

Considering the future of research assessment, Elizabeth Gadd outlines how she believes research evaluation could be made better, fairer, and more meaningful. The resulting seven guiding principles, neatly framed as hashtags, range from understanding our responsibilities to researchers as people, through to ensuring our evaluations are a more formative process, offering valuable, constructive feedback. Imperial College recently held an event […]