Observation-based risk assessments are often used for evaluation of biomechanical workload and the condition of the workplace ergonomics. However, the inter- and intra-rater reliability of the methods used for the assessments are insufficiently studied. The OCRA checklist method, included as a reference method in the ISO and CEN standards regarding upper limb repetitive risk assessment, was in this study investigated regarding its reliability. Eleven ergonomists were educated within the method. Each ergonomist risk-assessed ten video-recorded manual work tasks, on two occasions. The average inter-rater agreement of the five overall risk levels was 39% and the linearly weighted kappa was 0.43, the intra-rater dittos were 45% and 0.52. Both indicating a moderate reliability, but lower than what could be expected. The levels might be sufficient for coarse surveys. However, for risk assessments before and after an intervention, complementing technical methods should be considered.

中文翻译：

---

视频录制的手动工作任务中OCRA检查表方法的评分者间和评估者内部可靠性。

基于观察的风险评估通常用于评估生物力学工作量和工作场所人体工程学的状况。然而，评估中所使用的方法在评估者之间和评估者内部的可靠性还不够充分。本研究调查了OCRA检查表方法，该方法已作为ISO和CEN标准中有关上肢重复性风险评估的参考方法，并对其可靠性进行了研究。在该方法中，有11位人体工程学专家受到了教育。每个人机工程学专家两次评估了十个视频记录的手动工作任务的风险。五个总体风险水平的平均评分者之间一致性为39％，线性加权kappa为0.43，评分者内部同上程度分别为45％和0.52。两者均表明中等可靠性，但低于预期。这些水平可能足以进行粗略调查。但是，对于干预前后的风险评估，应考虑补充技术方法。