With the rapid growth of image collections, image classification and annotation has been active areas of research with notable recent progress. Bag-of-Visual-Words (BoVW) model, which relies on building visual vocabulary, has been widely used in this area. Recently, attention has been shifted to the use of advanced architectures which are characterized by multi-level processing. Hierarchical Max-Pooling (HMAX) model has attracted a great deal of attention in image classification. To improve image classification and annotation, several approaches based on ontologies have been proposed. However, image classification and annotation remain a challenging problem due to many related issues like the problem of ambiguity between classes. This problem can affect the quality of both classification and annotation results. In this paper, we propose an ontology-based image classification and annotation approach. Our contributions consist of the following: (1) exploiting ontological relationships between classes during both image classification and annotation processes; (2) combining the outputs of hypernym–hyponym classifiers to lead to a better discrimination between classes; and (3) annotating images by combining hypernym and hyponym classification results in order to improve image annotation and to reduce the ambiguous and inconsistent annotations. The aim is to improve image classification and annotation by using ontologies. Several strategies have been experimented, and the obtained results have shown that our proposal improves image classification and annotation.

中文翻译：

---

基于本体的图像分类和注释

随着图像收集的快速增长，图像分类和注释一直是活跃的研究领域，最近取得了显着进展。Bag-of-Visual-Words (BoVW) 模型依赖于构建视觉词汇，已在该领域得到广泛应用。最近，注意力已经转移到使用以多级处理为特征的高级架构上。Hierarchical Max-Pooling（HMAX）模型在图像分类中引起了广泛的关注。为了改进图像分类和注释，已经提出了几种基于本体的方法。然而，由于许多相关问题，例如类之间的歧义问题，图像分类和注释仍然是一个具有挑战性的问题。这个问题会影响分类和注释结果的质量。在本文中，我们提出了一种基于本体的图像分类和注释方法。我们的贡献包括以下内容：（1）在图像分类和注释过程中利用类之间的本体关系；(2) 结合上位词-下位词分类器的输出，以更好地区分类别；(3) 结合上位词和下位词分类结果对图像进行标注，以改进图像标注，减少标注的歧义和不一致。目的是通过使用本体来改进图像分类和注释。已经尝试了几种策略，所获得的结果表明我们的提议改进了图像分类和注释。(1) 在图像分类和注释过程中利用类之间的本体关系；(2) 结合上位词-下位词分类器的输出，以更好地区分类别；(3) 结合上位词和下位词分类结果对图像进行标注，以改进图像标注，减少标注的歧义和不一致。目的是通过使用本体来改进图像分类和注释。已经尝试了几种策略，所获得的结果表明我们的提议改进了图像分类和注释。(1) 在图像分类和注释过程中利用类之间的本体关系；(2) 结合上位词-下位词分类器的输出，以更好地区分类别；(3) 结合上位词和下位词分类结果对图像进行标注，以改进图像标注，减少标注的歧义和不一致。目的是通过使用本体来改进图像分类和注释。已经尝试了几种策略，所获得的结果表明我们的提议改进了图像分类和注释。(3) 结合上位词和下位词分类结果对图像进行标注，以改进图像标注，减少标注的歧义和不一致。目的是通过使用本体来改进图像分类和注释。已经尝试了几种策略，所获得的结果表明我们的提议改进了图像分类和注释。(3) 结合上位词和下位词分类结果对图像进行标注，以改进图像标注，减少标注的歧义和不一致。目的是通过使用本体来改进图像分类和注释。已经尝试了几种策略，所获得的结果表明我们的提议改进了图像分类和注释。