Why do reputation surveys in THE cause big ranking swings?

Question

Accepted Answer

Reputation Surveys Contribute Significantly to Ranking Volatility in THE World University Rankings

Reputation surveys play a substantial role in the fluctuations observed in the Times Higher Education (THE) World University Rankings due to the disproportionate impact of a small number of votes. These surveys, which gauge perceptions of teaching and postgraduate supervision quality, can lead to considerable shifts in a university's position, even if its underlying academic performance remains consistent. Furthermore, the ability for institutions to opt in or out of the rankings entirely can artificially alter the landscape, potentially displacing other universities without any change in their own submitted data.
Influence of a Limited Number of Votes

The methodology of the THE World University Rankings incorporates reputation surveys, which are particularly susceptible to yielding large swings in university placings. The article highlights that even a modest number of votes cast in these surveys can translate into significant increases or decreases in a university's overall ranking. This sensitivity means that perceptions, as captured by these surveys, can outweigh more quantifiable metrics, leading to instability in the rankings year after year.
Universities' Ability to Opt In or Out

Another factor contributing to the instability of the THE rankings is the voluntary nature of participation for universities. Institutions have the option to choose whether or not to be included in the rankings. When universities decide to enter or withdraw from the competition, this can directly impact the positions of other participating institutions. A university's absence, even if its own performance metrics have not changed, can effectively push other universities down the rankings or even out of the published list entirely.
Perceived Quality vs. Quantifiable Metrics

The reputation surveys within the THE rankings are presented as a measure of teaching quality, but the article suggests a disconnect between this stated purpose and the actual indicators used. Beyond the general reputation survey, the components include metrics related to postgraduate supervision and the number of doctoral students, which may not accurately reflect the quality of undergraduate teaching. This focus on subjective perceptions and specific, potentially unrepresentative, indicators means that the rankings may not always align with a comprehensive assessment of a university's academic strengths or educational offerings.

Reading history

Hide →

This history is cleared when the page is closed.

Why do reputation surveys in THE cause big ranking swings?

Loading

Was this article helpful?

Helpful

Not helpful

Report an issue

1

0

0

Share with friends