当前位置: X-MOL 学术Research Evaluation › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Formative, embedded evaluation to strengthen interdisciplinary team science: Results of a 4-year, mixed methods, multi-country case study
Research Evaluation ( IF 2.9 ) Pub Date : 2018-08-03 , DOI: 10.1093/reseval/rvy023
Susan Roelofs 1 , Nancy Edwards 1 , Sarah Viehbeck 2, 3 , Cody Anderson 4
Affiliation  

Evaluation of interdisciplinary, team science research initiatives is an evolving and challenging field. This descriptive, longitudinal, mixed methods case study examined how an embedded, formative evaluation approach contributed to team science in the interdisciplinary Research into Policy to Enhance Physical Activity (REPOPA) project, which focused on physical activity policymaking in six European countries with divergent policy systems and researcher–policymaker networks. We assessed internal project collaboration, communication, and networking in four annual data collection cycles with REPOPA team members. Data were collected using work package team and individual interviews, and quantitative collaboration and social network questionnaires. Interviews were content analyzed; social networks among team members and with external stakeholder were examined; collaboration scores were compared across 4 years using analysis of variance (ANOVA). Annual monitoring reports with action recommendations were prepared and discussed with consortium members. Results revealed consistently high response rates. Collaboration and communication scores, high at baseline, improved slightly, but ANOVA results were nonsignificant. Internal network changes tracked closely with implementation progress. External stakeholders were primarily governmental, with a marked shift from local/provincial level to national/international during the project. Diversity (disciplinary, organizational, and geopolitical) was a project asset influencing and also challenging collaboration, implementation, and knowledge translation strategies. In conclusion, formative evaluation using an embedded, participatory approach demonstrated utility, acceptability, and researcher engagement. A trusting relationship between evaluators and other project members built on joint identification of team science objectives for the evaluation at project outset, codeveloping guiding principles, and encouraging team reflexivity throughout the evaluation.

中文翻译:

形成性的,嵌入式评估,以加强跨学科团队的科学性:4年混合方法的结果,多国案例研究

跨学科,团队科学研究计划的评估是一个不断发展且充满挑战的领域。这项描述性,纵向,混合方法的案例研究研究了嵌入式,形成性评估方法如何在跨学科的增强体育活动政策研究(REPOPA)项目中为团队科学做出了贡献,该研究重点是六个不同政策体系的欧洲国家的体育活动政策和研究者-政策制定者网络。我们与REPOPA团队成员在四个年度数据收集周期中评估了内部项目合作,沟通和网络连接。使用工作包团队和个人访谈以及定量协作和社交网络问卷调查收集数据。访谈内容进行了分析;研究了团队成员之间以及与外部利益相关者之间的社交网络;使用方差分析(ANOVA)比较了4年的协作得分。编写了年度行动报告并提出了行动建议,并与财团成员进行了讨论。结果显示始终如一的高响应率。基线时的协作和沟通得分较高,但略有改善,但ANOVA结果并不显着。内部网络的变化与实施进度密切相关。外部利益相关者主要是政府,在项目期间从地方/省级转移到国家/国际级。多样性(学科,组织和地缘政治)是一个项目资产,会影响并挑战协作,实施和知识翻译策略。结论,使用嵌入式参与式方法进行的形成性评估显示出实用性,可接受性和研究人员参与度。评估人员与其他项目成员之间的信任关系建立在项目开始时共同确定团队科学目标以进行评估,共同制定指导原则并在整个评估过程中鼓励团队反思的基础上。
更新日期:2018-08-03
down
wechat
bug