ABSTRACT

Interventions to improve mental health can target individuals, working groups, their leaders, or organisations, also known as the Individual, Group, Leader, and Organisational (IGLO) levels of intervention. Evaluating such interventions in organisational settings is complex and requires sophisticated evaluation designs taking into account the intervention process. In the present systematic literature review, we present state of the-art of quantitative measures of process evaluation. We identified 39 papers. We found that measures had been developed to explore the organisational context, the intervention design, and the mental models of the intervention and its activities. Quantitative process measures are often poorly validated, and only around half of the studies linked the process to intervention outcomes. Fifteen studies used mixed methods for process evaluation. Most often, a qualitative process evaluation was used to understand unexpected intervention outcomes. Despite the existence of theoretical process evaluation frameworks, these were not often employed, and even when included, frameworks were rarely acknowledged, and only selected elements were included. Based on our synthesis, we propose a new framework for evaluating interventions, the Integrative Process Evaluation Framework (IPEF), together with reflections on how we may optimise the use of quantitative process evaluation in conjunction with a qualitative process evaluation.

摘要

改善心理健康的干预措施可以针对个人、工作团体、他们的领导或组织，也称为个人、团体、领导和组织 (IGLO) 级别的干预。在组织环境中评估此类干预措施很复杂，需要考虑干预过程的复杂评估设计。在目前的系统文献综述中，我们介绍了过程评估定量测量的最新技术水平。我们确定了 39 篇论文。我们发现已经制定了措施来探索组织背景、干预设计以及干预及其活动的心智模型。定量过程测量通常没有得到很好的验证，只有大约一半的研究将过程与干预结果联系起来。十五项研究使用混合方法进行过程评估。大多数情况下，定性过程评估用于了解意想不到的干预结果。尽管存在理论过程评估框架，但这些框架并不经常使用，即使包含在内，框架也很少被认可，并且仅包含选定的元素。基于我们的综合，我们提出了一个评估干预的新框架，即综合过程评估框架 (IPEF)，以及对我们如何优化定量过程评估与定性过程评估的使用的思考。这些框架并不经常使用，即使包括在内，框架也很少被承认，而且只包括选定的要素。基于我们的综合，我们提出了一个评估干预的新框架，即综合过程评估框架 (IPEF)，以及对我们如何优化定量过程评估与定性过程评估的使用的思考。这些框架并不经常使用，即使包括在内，框架也很少被承认，而且只包括选定的要素。基于我们的综合，我们提出了一个评估干预的新框架，即综合过程评估框架 (IPEF)，以及对我们如何优化定量过程评估与定性过程评估的使用的思考。