Abstract

This is the first standard setting study in Malaysia aimed at developing Performance-Level Descriptors (PLDs) and determining cut scores that differentiate undergraduates with low, moderate and high employability skills using a newly developed Situational judgment Test (SJT). SJT items from five domains critical for future job employment: 1) critical thinking and problem solving, 2) enterprising, 3) integrity, 4) leadership and 5) teamwork were developed. Modified Angoff method involving PLDs and cut scores were developed by five subject-matter experts. Two test instruments were used: 10 practice and 36 original bilingual Malay-English SJT items. The PLDs and two cut scores to distinguish low, moderate and high employability skills were validly developed, without compromising consequential validity. The findings benefit undergraduates with low employability as they can be trained with current global job readiness skills by the universities, which also forms the practice implication of this study. Another practical implication is academicians can be further encouraged to understand the theoretical framework of establishing standard setting for employability.

摘要

这是马来西亚第一个标准制定研究，旨在开发绩效水平描述符 (PLD) 并使用新开发的情境判断测试 (SJT) 确定区分具有低、中等和高就业技能的本科生的分数。开发了对未来工作就业至关重要的五个领域的 SJT 项目：1) 批判性思维和解决问题的能力，2) 进取心，3) 诚信，4) 领导力和 5) 团队合作。五位主题专家开发了涉及 PLD 和削减分数的改进 Angoff 方法。使用了两种测试工具：10 种练习和 36 种原始的马来-英语双语 SJT 项目。有效地开发了用于区分低、中和高就业技能的 PLD 和两个分数，而不会影响结果有效性。研究结果有利于就业能力低的本科生，因为他们可以通过大学接受当前全球就业准备技能的培训，这也构成了本研究的实践意义。另一个实际意义是可以进一步鼓励院士理解建立就业能力标准的理论框架。