The peer assessment of research grant applications has a long history of controversy and criticisms. Its validity, nevertheless, has been a difficult task in the absence of the assessment standards. For improvement of the assessment validity, a validity of success rate as a functional component of the peer assessment of research grant applications is studied in this paper. Two different kinds of true peers were conceptualized and defined – one is for inherent true peers independent of, and the other for apparent true peers dependent on, how assessment is arranged – to find the low and upper bounds of assessment uncertainty. Validity order was derived for various generic cases of assessment arrangement using the set theory concept for the apparent true peers. Formulas for validity of success rate for research grant applications were derived, which may be useful for assessment planning and streamlining diverted anecdotal opinions on the funding success rate in the literature. A case study was conducted using Australian Research Council (ARC) data available in the literature to demonstrate practicality and significance for the derived validity formulas of success rate.

中文翻译：

---

研究资助申请同行评估的成功率有效性

研究资助申请的同行评估有着悠久的争议和批评历史。然而，在缺乏评估标准的情况下，其有效性一直是一项艰巨的任务。为了提高评估的有效性，本文研究了作为研究资助申请同行评估的功能组成部分的成功率的有效性。概念化和定义了两种不同类型的真正同伴——一种是独立于固有的真正同伴，另一种是依赖于评估安排的明显真实同伴——以找到评估不确定性的下限和上限。有效性顺序是使用集合论概念为表观真实对等评估安排的各种一般情况得出的。推导出研究资助申请成功率的有效性公式，这可能有助于评估计划和简化文献中关于资助成功率的轶事意见。使用文献中可用的澳大利亚研究委员会 (ARC) 数据进行了一项案例研究，以证明导出的成功率有效性公式的实用性和重要性。