Normalization
Once the data is collected and the weightings are decided upon, the next thing to do is to calculate standard scores for each column of data so that they are compatible with each other and allow us to combine the data reliably and apply the weightings fairly in the calculation of the overall score. Before 2007, the approach taken here was an over-simplistic one — find the top scoring institution, award them 100 notional points and scale the remaining entries proportionally to that top performer. This approach had some disadvantages:
- Anomalous application of weightings
- Lack of control for “outliers”
- The smallest of errors in the assessment of the top performing institution could have dramatic effects
From 2007, a more complicated, but widely used standardization or normalization method has been adopted involving z-scores. There are numerous online sources explaining how this works:
There are even a range of video podcasts available on YouTube, including this one:
Calculations
Once the scores are calculated, their position on the normal curve is plotted resulting in their score for each indicator. The resulting scores are finally scaled between 1 and 100 for each indicator to result in a set of results compatible with those for the other indicators
Standard Deviations and Means for Individual Indicators in 2011
| Indicator | Mean | Standard Deviation |
| Academic Reputation | 69.31 | 57.54 |
| Employer Reputation | 5.67 | 10.66 |
| Faculty Student | 0.09 | 0.05 |
| Citations per Faculty | 24.83 | 29.55 |
| International Faculty | 0.14 | 0.13 |
| International Students | 0.11 | 0.10 |
