The test-retest reliability of functional neuroimaging data has recently been a topic of much discussion. Despite early conflicting reports, converging reports now suggest that test-retest reliability is poor for standard univariate measures — namely, voxel-based and region-level task-based activation and edge-level functional connectivity. To better understand the implications of these recent studies requires understanding the nuances of test-retest reliability as commonly measured by the intraclass correlation coefficient (ICC). Here we provide a guide to the measurement and interpretation of test-retest reliability in functional neuroimaging and review major findings in the literature. We highlight the importance of making choices that improve reliability so long as they do not diminish validity, pointing to the potential of multivariate approaches that improve both. Finally, we discuss the implications of recent reports of low test-retest reliability in the context of ongoing work in the field.

功能神经影像数据的重测可靠性最近成为了很多讨论的话题。尽管早期的报告相互矛盾，但现在的趋同报告表明，标准单变量测量（即基于体素和区域级任务的激活以及边缘级功能连接）的重测可靠性很差。为了更好地理解这些近期研究的意义，需要了解重测信度的细微差别，通常通过组内相关系数 (ICC) 来衡量。在这里，我们提供了功能神经影像学中重测可靠性的测量和解释指南，并回顾了文献中的主要发现。我们强调了在不降低有效性的情况下做出提高可靠性的选择的重要性，并指出了提高两者的多变量方法的潜力。最后，我们讨论了最近关于低重测可靠性报告在该领域正在进行的工作的背景下的影响。