Abstract Impact assessments in grant applications can be biased, random, or inconsistent. One reason is that there is not a framework to assist the review process. To develop fair and transparent evaluative criteria, it is necessary to understand what kinds of outcome and impact can reasonably be achieved and expected. Using content analysis, 100 UK Research Excellence Framework (REF) 2014 impact case studies were analysed based on the definition of the output, outcome, and impact in the logic model. The analysis shows that (1) outcomes and medium-term impacts, not long-term impacts, are reported in the case studies, (2) impacts can be categorised as use and experience based, and (3) there is a need to recognise the creation and co-creation of impacts. A framework for impact evaluation in grant applications has been developed. In this framework, the criteria for evaluating impact statements focus on process-oriented impacts and that ‘impacts’ can be outputs, outcomes, and medium-term impacts.

中文翻译：

---

解构影响：拨款申请中影响评估的框架

摘要 拨款申请中的影响评估可能是有偏见的、随机的或不一致的。一个原因是没有一个框架来协助审查过程。为了制定公平和透明的评估标准，有必要了解可以合理地实现和预期什么样的结果和影响。使用内容分析，根据逻辑模型中输出、结果和影响的定义，分析了 100 个英国卓越研究框架 (REF) 2014 影响案例研究。分析表明，(1) 案例研究报告了结果和中期影响，而不是长期影响，(2) 影响可以归类为基于使用和经验，以及 (3) 有必要认识到影响的创造和共同创造。已经制定了拨款申请中的影响评估框架。