To solve the problems of the great learning difficulty, the long learning period, wide range of knowledge points but weak knowledge connection, and low sharing of Oracle Bone Studies (OBS), a solution of constructing a multi-modal knowledge graph is proposed. Because OBS research involves various kinds of modal data, and these modalities need to be combined together to solve some problems. The OBS multi-modal knowledge graph can provide a unified semantic space for multi-source heterogeneous data. Through multi-modal fusion and information complementation, the defects of a single modality in information processing can be resolved. This multi-modal knowledge graph organizes and manages the basic data better to serve Oracle Bone Inscriptions (OBI) information processing research. Taking OBI detection and recognition as examples, we studied the applications of OBS multi-modal knowledge graph. The experimental results demonstrate that the proposed method reaches 81.3% accuracy in detection and 80.43% accuracy in recognition, and it has 3.7% in detection and 14.8% in recognition improved to the conventional methods.

为了解决学习难度大，学习周期长，知识点范围广，知识联系薄，Oracle Bone Studies（OBS）共享性低的问题，提出了一种构建多模态知识图的解决方案。由于OBS研究涉及各种模式数据，因此需要将这些模式组合在一起以解决一些问题。OBS多模式知识图可以为多源异构数据提供统一的语义空间。通过多模式融合和信息补充，可以解决信息处理中单一模式的缺陷。该多模式知识图可以更好地组织和管理基本数据，以服务于Oracle Bone Inscriptions（OBI）信息处理研究。以OBI检测与识别为例，我们研究了OBS多模态知识图的应用。实验结果表明，与传统方法相比，该方法检测精度达到81.3％，识别精度达到80.43％，检测率达到3.7％，识别率达到14.8％。