Category: metrics

How will the emerging generation of scholars transform scholarly communication?

Presenting evidence from the Harbingers Study, a three-year longitudinal study of Early Career Researchers (ECRs), David Nicholas assesses the extent to which the new wave of researchers are driving changes in scholarly practices. Finding that innovative practices are often constrained by institutional structures and precarious employment, he suggests that the pace of change in these areas is always going to […]

The changing imperative to demonstrate social science impact

In less than a decade the impact agenda has evolved from being a controversial idea to an established part of most national research systems. Over the same period the conceptualisation of research impact in the social sciences and the ability to create and measure research impact through digital communication media has also developed significantly. In this post, Ziyad Marar argues […]

Knowledge exchange or research impact – what is the difference between REF and KEF?

The UK research system has historically been innovative in its approach to measuring and assessing the impacts of academic research. However, the recent development of the Knowledge Exchange Framework (KEF), has elicited scepticism as to how this framework will significantly differ from the impact element of the Research Excellence Framework (REF). In this post Hamish McAlpine and Steven Hill outline […]

Assessing Impact Assessment – What can be learnt from Australia’s Engagement and Impact Assessment?

The impact agenda is an international and evolutionary phenomenon that has undergone numerous iterations. Discussing the development and recent release of the results of the Australian Engagement and Impact Assessment (EIA), Ksenia Sawczak considers the effectiveness of this latest exercise in impact assessment, finding it to provide an inadequate account of the impact of Australian research and ultimately a shaky evidence […]

Measuring Inequality – Creating an indicator to assess gender bias in universities

Higher education and research institutions are increasingly coming to terms with the issue of gender inequality. However, efforts to move in this direction are often isolated and difficult to compare and benchmark against each other. In this post, Caroline Wagner presents a new initiative from the Centre for Science and Technology Studies at Leiden (CWTS), to assess gender inequality in […]

The “impact” of the Journal Impact Factor in the review, tenure, and promotion process

The Journal Impact Factor (JIF) – a measure reflecting the average number of citations to recent articles published in a journal – has been widely critiqued as a measure of individual academic performance. However, it is unclear whether these criticisms and high profile declarations, such as DORA, have led to significant cultural change. In this post, Erin McKiernan, Juan Pablo Alperin and […]

The careers of carers – A numerical adjustment cannot level the playing field for researchers who take time off to care for children

Quantitative measures of the effect of caring for children on research outputs (published papers and citations) have been used by some universities as a tool to address gender bias in academic grant and job applications. In this post Adrian Barnett argues that these adjustments fail to capture the real impacts of caring for children and should be replaced with contextual […]

Book Review: Scholarly Communication and Measuring Research – What Does Everyone Need to Know?

Academics are required to not only find effective ways to communicate their research, but also to increasingly measure and quantify its quality, impact and reach. In Scholarly Communication: What Everyone Needs to Know, Rick Anderson puts us in the picture. And in Measuring Research: What Everyone Needs to Know, Cassidy Sugimoto and Vincent Lariviere critically assess over 20 tools currently available for evaluating the quality […]

Are altmetrics able to measure societal impact in a similar way to peer review?

Altmetrics have become an increasingly ubiquitous part of scholarly communication, although the value they indicate is contested. In this post, Lutz Bornmann and Robin Haunschild present evidence from their recent study examining the relationship of peer review, altmetrics, and bibliometric analyses with societal and academic impact. Drawing on evidence from REF2014 submissions, they argue altmetrics may provide evidence for wider […]

Book Review: Hacking Life: Systematized Living and its Discontents by Joseph M. Reagle, Jr.

In Hacking Life: Systematized Living and its Discontents, Joseph M. Reagle, Jr. explores the cultural trend of life hacking in its myriad forms as rooted in both the increasing pressures to perform to the maximum of our abilities and technological advances that are enabling us to monitor and quantify the world in unprecedented detail. The book not only lays bare an increasingly popular […]