BACKGROUND Public research funding agencies and research organisations are increasingly accountable for the wider impacts of the research they support. While research impact assessment (RIA) frameworks and tools exist, little is known and shared of how these organisations implement RIA activities in practice. METHODS We conducted a review of academic literature to search for research organisations' published experiences of RIAs. We followed this with semi-structured interviews from a convenience sample (n = 7) of representatives of four research organisations deploying strategies to support and assess research impact. RESULTS We found only five studies reporting empirical evidence on how research organisations put RIA principles into practice. From our interviews, we observed a disconnect between published RIA frameworks and tools, and the realities of organisational practices, which tended not to be reported. We observed varying maturity and readiness with respect to organisations' structural set ups for conducting RIAs, particularly relating to leadership, skills for evaluation and automating RIA data collection. Key processes for RIA included efforts to engage researcher communities to articulate and plan for impact, using a diversity of methods, frameworks and indicators, and supporting a learning approach. We observed outcomes of RIAs as having supported a dialogue to orient research to impact, underpinned shared learning from analyses of research, and provided evidence of the value of research in different domains and to different audiences. CONCLUSIONS Putting RIA principles and frameworks into practice is still in early stages for research organisations. We recommend that organisations (1) get set up by considering upfront the resources, time and leadership required to embed impact strategies throughout the organisation and wider research 'ecosystem', and develop methodical approaches to assessing impact; (2) work together by engaging researcher communities and wider stakeholders as a core part of impact pathway planning and subsequent assessment; and (3) recognise the benefits that RIA can bring about as a means to improve mutual understanding of the research process between different actors with an interest in research.

中文翻译：

---

组织如何实施研究影响评估（RIA）原则和良好做法？对四个国际研究资助和行政组织的叙述性回顾和探索性研究。

背景技术公共研究资助机构和研究组织越来越对它们所支持的研究的广泛影响负责。尽管存在研究影响评估（RIA）框架和工具，但对于这些组织如何在实践中实施RIA活动知之甚少。方法我们对学术文献进行了综述，以寻找研究机构发布的RIA经验。接下来，我们对来自四个研究组织代表的便捷样本（n = 7）进行了半结构化访谈，他们采用了部署策略来支持和评估研究影响。结果我们发现只有五项研究报告了有关研究组织如何将RIA原则付诸实践的经验证据。通过访谈，我们发现已发布的RIA框架和工具之间存在脱节，以及组织实践的现实，这往往没有得到报道。我们观察到有关组织进行RIA的结构设置的成熟度和准备程度各不相同，尤其是与领导力，评估和RIA数据收集自动化的技能有关。RIA的关键流程包括努力使研究者社区参与，以阐明和计划影响，使用多种方法，框架和指标，并支持学习方法。我们观察到RIA的成果支持对话以使研究具有影响力，支持了研究分析的共享学习，并为不同领域和不同受众提供了研究价值的证据。结论对于研究机构而言，将RIA原则和框架付诸实践仍处于初期阶段。我们建议组织（1）通过预先考虑将影响策略嵌入整个组织和更广泛的研究“生态系统”并开发有条理的方法来评估影响所需的资源，时间和领导力；（2）通过将研究者社区和更广泛的利益相关者作为影响路径规划和后续评估的核心部分来开展合作；（3）认识到RIA可以带来的好处，可以增进对研究感兴趣的不同参与者之间对研究过程的相互了解。（2）通过将研究者社区和更广泛的利益相关者作为影响路径规划和后续评估的核心部分来进行合作；（3）认识到RIA可以带来的好处，可以增进对研究感兴趣的不同参与者之间对研究过程的相互了解。（2）通过将研究者社区和更广泛的利益相关者作为影响路径规划和后续评估的核心部分来开展合作；（3）认识到RIA可以带来的好处，可以增进对研究感兴趣的不同参与者之间对研究过程的相互了解。