ABSTRACT The trustworthiness of low-stakes assessment results largely depends on examinee effort, which can be measured by the amount of time examinees devote to items using solution behavior (SB) indices. Because SB indices are calculated for each item, they can be used to understand how examinee motivation changes across items within a test. Latent class analysis (LCA) was used with the SB indices from three low-stakes assessments to explore patterns of solution behavior across items. Across tests, the favored models consisted of two classes, with Class 1 characterized by high and consistent solution behavior (>90% of examinees) and Class 2 by lower and less consistent solution behavior (<10% of examinees). Additional analyses provided supportive validity evidence for the two-class solution with notable differences between classes in self-reported effort, test scores, gender composition, and testing context. Although results were generally similar across the three assessments, striking differences were found in the nature of the solution behavior pattern for Class 2 and the ability of item characteristics to explain the pattern. The variability in the results suggests motivational changes across items may be unique to aspects of the testing situation (e.g., content of the assessment) for less motivated examinees.

中文翻译：

---

低风险评估中跨项目的解决方案行为模式

摘要低风险评估结果的可信度在很大程度上取决于应试者的努力程度，这可以通过应试者使用解决方案行为（SB）指标投入项目的时间来衡量。因为SB指数是针对每个项目计算的，所以可以用来了解考生在测试中各个项目之间的动机变化。潜在类别分析（LCA）与来自三个低风险评估的SB指数一起使用，以探索跨项目的解决方案行为模式。在整个测试中，受青睐的模型由两类组成，第一类的特征是较高且一致的解决方案行为（> 90％的应试者），第二类的特征是较低和不太一致的解决方案行为（<10％的应试者）。额外的分析为两类解决方案提供了支持性效度证据，各类之间在自我报告的努力，测试分数，性别组成和测试环境方面存在显着差异。尽管在这三个评估中结果通常相似，但是在第2类的解决方案行为模式的性质以及项目特征解释该模式的能力方面发现了惊人的差异。结果的可变性表明，对于动机较弱的考生，跨项目的动机变化可能是测试情况方面（例如评估内容）所独有的。在类别2的解决方案行为模式的性质以及项目特征解释该模式的能力方面发现了显着差异。结果的可变性表明，对于动机较弱的考生，跨项目的动机变化可能是测试情况方面（例如评估内容）所独有的。在类别2的解决方案行为模式的性质以及项目特征解释该模式的能力方面发现了显着差异。结果的可变性表明，对于动机较弱的考生，跨项目的动机变化可能是测试情况方面（例如评估内容）所独有的。