Category: Rankings

The methodology used for the Times Higher Education World University Rankings’ citations metric can distort benchmarking

The Times Higher Education World University Rankings can influence an institution’s reputation and even its future revenues. However, Avtar Natt argues that the methodology used to calculate its citation metrics can have the effect of distorting benchmarking exercises. The fractional counting approach applied to only a select number of papers with high author numbers has led to a situation whereby […]

The effect of NSS scores and league tables on student demand and university application rates is relatively small.

As competition for student recruitment continues to intensify, policymakers and administrators are encouraging an emphasis on ‘student experience’. The National Student Survey (NSS) scores are one indicator that attempts to measure this. But do students really take any notice of NSS scores in making their university choices? Stephen Gibbons shares findings which suggest the effect of changes in NSS scores on demand […]

Without a balance between research and teaching, there will be nothing “higher” about UK education.

There are a surge of rumours circulating over how higher education will be affected by the government’s Comprehensive Spending Review at the end of the November. Responding to the latest suggestions, Martin Eve writes below directly to Jo Johnson, the Minister for Universities and Science. Whilst there are many causes for concern outlined, of particular concern is the emphasis put on teaching at the […]

Literacy as Numbers: The efficacy, merits and validity of transnational literacy assessment programmes.

Debates about the nature of literacy and how to account for the diversity of learning are far from resolved. A new book, Literacy as Numbers, looks at how literacy itself is being reframed around globalized assessment regimes. Camilla Addey delves into how these comparable numbers, now so heavily relied on in national policy, are produced, and how they are shaping our understanding of the meanings and purposes […]

Predicting the results of the REF using departmental h-index: A look at biology, chemistry, physics, and sociology.

Can metrics be used instead of peer review for REF-type assessments? With the stakes so high, any replacement would have to be extremely accurate. Olesya Mryglod, Ralph Kenna, Yurij Holovatch and Bertrand Berche looked at two metric candidates, including the departmental h-index, and four subject areas: biology, chemistry, physics and sociology. The correlations are significant, but comparisons with RAE indicate that while […]

Proof over promise: Moving citation metric systems beyond journal impact towards a career impact approach.

Publishing in a high-impact journal carries the implicit promise that the article will also be highly cited. But the proof of this logic remains unsubstantiated. By combining more accurate citation metrics, like the hIa-index and the citation-per-author-per-year metric, Anne-Wil Harzing and Wilfred Mijnhardt provide a more substantial alternative to the narrow journal-based metric. This combined metric provides a more reliable comparison between academics […]

University rankings wield immense influence over Higher Ed and society at large – with positive and perverse effects.

In a time of growing demand for and on higher education, university rankings have transformed university strategy. Ellen Hazelkorn finds their crude simplicity is what makes rankings so infectious. Yet, quality is a complex concept. Most of the indicators used are effectively measures of socio-economic advantage, and privilege the most resource-intensive institutions and-or countries. In response and reaction to the limited nature […]