In our prior work, we presented a novel approach to the evaluation of quality in use of corporate web sites based on an original quality model (QM-U) and a related methodology (EQ-EVAL). This article focuses on two research questions. The first one aims at investigating whether expected quality obtained through the application of EQ-EVAL methodology by employing a small panel of evaluators is a good approximation of actual quality obtained through experimentation with real users. To answer this research question, a comparative study has been carried out involving 5 evaluators and 50 real users. The second research question aims at demonstrating that the adoption of the EQ-EVAL methodology can provide useful information for web site improvement. Three original indicators, namely coherence, coverage and ranking have been defined to answer this question, and an additional study comparing the assessments of two panels of 5 and 10 evaluators, respectively, has been carried out. The results obtained in both studies are largely positive and provide a rational support for the adoption of the EQ-EVAL methodology.

中文翻译：

---

评估公司网站的使用质量

在我们之前的工作中，我们提出了一种基于原始质量模型（QM-U）和相关方法（EQ-EVAL）的企业网站使用质量评估的新方法。本文重点讨论两个研究问题。第一个旨在调查通过应用 EQ-EVAL 方法获得的预期质量是否与通过真实用户实验获得的实际质量良好近似。为了回答这个研究问题，我们进行了一项比较研究，涉及 5 名评估者和 50 名真实用户。第二个研究问题旨在证明采用 EQ-EVAL 方法可以为网站改进提供有用的信息。三个原始指标，即连贯性，已经定义了覆盖范围和排名来回答这个问题，并且已经进行了一项额外的研究，分别比较了两个小组的评估，分别由 5 名和 10 名评估者组成。两项研究中获得的结果在很大程度上是积极的，并为采用 EQ-EVAL 方法提供了合理的支持。