External analysis completed – SNSF evaluation procedures put to the test
External experts have analysed the SNSF's CV format and evaluation procedure. Their final report offers valuable insights and recommendations to support the SNSF in refining its procedures.
The SNSF adapted its evaluation procedures in 2022 to ensure they are more transparent and fairer. It harmonised the procedures for almost all funding schemes (Unified Evaluation Procedure, UEP) and introduced the innovations detailed below.
The evaluation panel members vote individually and anonymously to ensure an independent assessment. All ratings are made according to a standardised scale from 1 to 9. The scientific evaluation is conducted separately from the funding decision, and if applications are of equal quality, the final selection may be determined by a random draw.
The SNSF has also introduced a new, standardised CV format. The new CV enables researchers to present their most significant scientific contributions as short reports and provide a limited number of research outputs instead of extensive lists of publications. The format is intended to help implement the DORA principles.
External analysis confirms progress and potential for optimisation
The SNSF commissioned an external analysis of the evaluation procedures (UEP) and the new CV format at the beginning of 2024 to determine the effectiveness of these changes and the possible need for revisions. Following a public call, a consortium of international experts from CultureBase, SIRIS Academic and Different Angles was selected to carry out the evaluation. The evaluation team spoke to applicants, external experts and panel members in surveys and interviews and conducted data analyses as part of its assessment.
The final report shows that the innovations introduced in 2022 - such as increased transparency, fairness, and the DORA principles - have been well received. However, further optimisation is possible during implementation. Key recommendations for the SNSF include better communication regarding the evaluation process and setting clearer expectations for the new CV format.
What happens next?
The SNSF bodies will discuss the evaluation findings and prioritise the recommendations. The results of further ongoing analyses will also be included in these considerations.
All details of the analyses, findings and recommendations can be found in the publicly available final report.