WG: Reliability Scoring Method

Goal: To ensure that the scoring method fairly represents the reliability of the research scored by it.

Critical success factors:

  • A simple, understandable score (e.g. from 1-100).

  • A clear explanation of how the score was arrived at using the CAWE

Necessary conditions and actions:

  • A process to update the score of papers/research when bounties are claimed

  • A process to update the score of papers/research when a paper has been updated to address identified weaknesses

  • The score is relatively stable over time and across disciplines

  • An automated process to update the score of previously scored papers when the CAWE or score methodology is updated

  • Permit additional scoring approaches allowing for more nuanced evaluations

Last updated