The ColorChecker dataset is one of the most widely used image sets for evaluating and ranking illuminant estimation algorithms. However, this single set of images has at least 3 different sets of ground-truth (i.e., correct answers) associated with it. In the literature it is often asserted that one algorithm is better than another when the algorithms in question have been tuned and tested with the different ground-truths. In this short correspondence we present some of the background as to why the 3 existing ground-truths are different and go on to make a new single and recommended set of correct answers. Experiments reinforce the importance of this work in that we show that the total ordering of a set of algorithms may be reversed depending on whether we use the new or legacy ground-truth data.

中文翻译：

---

为 ColorChecker 数据集的光源估计提供单一真实值


ColorChecker 数据集是用于评估和排名光源估计算法的最广泛使用的图像集之一。然而，这组图像至少有 3 组不同的真实值（即正确答案）与之相关。在文献中，当所讨论的算法已经使用不同的基本事实进行调整和测试时，经常断言一种算法比另一种算法更好。在这篇简短的信件中，我们介绍了一些背景知识，解释为什么 3 个现有的基本事实不同，并继续提出一组新的单一推荐正确答案。实验强调了这项工作的重要性，因为我们表明，根据我们使用新的还是旧的地面实况数据，一组算法的总顺序可能会颠倒。