Quality vs Impact: A comparison of Performance-Based Research Fund quality scores with citations

Quality vs Impact: A comparison of Performance-Bas…
01 Aug 2007
pdf
Quality vs Impact: A comparison of Performance-Bas…
01 Aug 2007
doc

This report compares the academic impact of research produced by New Zealand universities, in the form of citations per full-time equivalent (FTE) researcher, with the quality of research at the universities, as measured by Performance-Based Research Fund (PBRF) average quality scores, across ten broad subject areas.

Key Results

  • Each of the ten broad subject panels analysed in this report exhibit a positive association between the quality of research and the academic impact of research – that is, a higher level of academic quality is associated with a higher level of academic impact. However, the strength of this relationship varies between the subject panels and between 2003 and 2006.
  • Overall, the ‘biological sciences’ panel displays the strongest degree of association between research quality and academic impact. Other panels with a reasonable degree of association between academic impact and research quality are ‘engineering, technology and architecture’, ‘education’ and ‘medicine and public health’. Of the remaining subject panels, the lowest degree of association between academic impact and research quality is in the ‘business and economics’ panel.
  • The degree of variation between research quality and academic impact found in this report would suggest that the peer review process used in the PBRF quality evaluations is not simply mirroring what is shown in citations data. However, given the limitations of the data used in this analysis, further research, which links the citations directly to the researchers in the PBRF Quality Evaluation, would more conclusively indicate the strength of the association between research quality and academic impact.
Page last modified: 17 Jul 2023