The OWL Reasoner Evaluation competition is an annual competition (with an associated workshop) that pits OWL 2 compliant reasoners against each other on various standard reasoning tasks over naturally occurring problems. The 2015 competition was the third of its sort and had 14 reasoners competing in six tracks comprising three tasks (consistency, classification, and realisation) over two profiles (OWL 2 DL and EL). In this paper, we discuss the design, execution and results of the 2015 competition with particular attention to lessons learned for benchmarking, comparative experiments, and future competitions.

中文翻译：

---

OWL Reasoner Evaluation (ORE) 2015 竞赛报告

OWL Reasoner Evaluation 竞赛是一年一度的竞赛（有一个相关的研讨会），让 OWL 2 兼容的推理者在自然发生的问题的各种标准推理任务上相互竞争。2015 年的比赛是同类比赛中的第三场，有 14 名推理机在六个轨道上进行比赛，包括三个任务（一致性、分类和实现），超过两个配置文件（OWL 2 DL 和 EL）。在本文中，我们讨论了 2015 年竞赛的设计、执行和结果，特别关注了基准测试、比较实验和未来竞赛的经验教训。