Purpose

To meet the emerging demand for fine-grained annotation and semantic enrichment of cultural heritage images, this paper proposes a new approach that can transcend the boundary of information organization theory and Panofsky's iconography theory.

Design/methodology/approach

After a systematic review of semantic data models for organizing cultural heritage images and a comparative analysis of the concept and characteristics of deep semantic annotation (DSA) and indexing, an integrated DSA framework for cultural heritage images as well as its principles and process was designed. Two experiments were conducted on two mural images from the Mogao Caves to evaluate the DSA framework's validity based on four criteria: depth, breadth, granularity and relation.

Findings

Results showed the proposed DSA framework included not only image metadata but also represented the storyline contained in the images by integrating domain terminology, ontology, thesaurus, taxonomy and natural language description into a multilevel structure.

Originality/value

DSA can reveal the aboutness, ofness and isness information contained within images, which can thus meet the demand for semantic enrichment and retrieval of cultural heritage images at a fine-grained level. This method can also help contribute to building a novel infrastructure for the increasing scholarship of digital humanities.

中文翻译：

---

文化遗产图像深度语义标注数据建模与评价

目的

为了满足对文化遗产图像细粒度标注和语义丰富的新兴需求，本文提出了一种可以超越信息组织理论和潘诺夫斯基图像学理论边界的新方法。

设计/方法/方法

在对用于组织文化遗产图像的语义数据模型进行系统回顾和对深度语义标注（DSA）和索引的概念和特征进行比较分析后，设计了一个用于文化遗产图像的集成DSA框架及其原理和过程。对莫高窟的两幅壁画图像进行了两次实验，以根据深度、广度、粒度和关系四个标准评估 DSA 框架的有效性。

发现

结果表明，所提出的 DSA 框架不仅包含图像元数据，还通过将领域术语、本体、同义词库、分类法和自然语言描述集成到多级结构中来表示图像中包含的故事情节。

原创性/价值

DSA可以揭示图像中包含的aboutness、ofness和isness信息，从而在细粒度层面满足文化遗产图像语义丰富和检索的需求。这种方法还有助于为日益增长的数字人文学科建设新的基础设施。