The cognitive reflection test (CRT) became popular for its impressive power to predict how well people reason and make decisions. Despite the popularity of the CRT, a major issue complicates its interpretation: The numerical nature of the CRT confounds reflection ability with mathematical ability. We have addressed this issue by developing the verbal CRT (CRT-V), a novel 10-item measure of cognitive reflection (https://osf.io/xehbv/), using nonmathematical problems with good statistical and psychometric properties and with low familiarity. First, we selected suitable items with relatively low familiarity and optimal difficulty as identified in two different populations (Studies 1 and 2) and with high content validity as judged by an expert panel (Study 3). Second, we demonstrated good criterion and construct validity for the test in different populations with a wide range of variables (Studies 4–6, 8) and a good internal consistency (Studies 4–8) and test–retest reliability (Study 7). The CRT-V was less associated with math anxiety, objective and subjective numeracy than the original CRT, and it was test equivalent across gender, age groups and administration setting. In contrast with the original CRT (Hedge's g = 0.29, 95% confidence interval [CI] [0.17, 0.40]), the CRT-V showed no gender differences (Hedge's g = −0.06, 95% CI [−0.18, 0.06]). The CRT-V can complement existing, numerical, tests of cognitive reflection.

中文翻译：

---

不用数学测量认知反思：语言认知反思测试的开发和验证

认知反思测试 (CRT) 因其令人印象深刻的能力而广受欢迎，它可以预测人们推理和决策的能力。尽管 CRT 很受欢迎，但一个主要问题使它的解释变得复杂：CRT 的数值性质混淆了反射能力和数学能力。我们通过开发语言 CRT (CRT-V)，一种新颖的 10 项认知反射测量 (https://osf.io/xehbv/)，使用具有良好统计和心理测量特性且具有低熟悉。首先，我们选择了在两个不同人群（研究 1 和 2）中确定的具有相对较低熟悉度和最佳难度的合适项目，并且由专家小组判断具有高内容效度（研究 3）。第二，我们在具有广泛变量（研究 4-6、8）和良好的内部一致性（研究 4-8）和重测信度（研究 7）的不同人群中证明了该测试的良好标准和结构效度。与原始 CRT 相比，CRT-V 与数学焦虑、客观和主观计算能力的相关性更低，并且在不同性别、年龄组和管理环境中的测试等效。与原始 CRT（Hedge 的g = 0.29, 95% 置信区间 [CI] [0.17, 0.40])，CRT-V 显示无性别差异（Hedge's g = -0.06, 95% CI [-0.18, 0.06]）。CRT-V 可以补充现有的、数字的、认知反射测试。