Purpose

With the increasing abundance of network resources and big data, multi-modal information search (MMIS) has been paid more and more attention, but the research results of MMIS are relatively few. This paper attempts to put forward constructive suggestions for the design of multi-modal information system, so that the system can have a better user experience, help users improve the efficiency of obtaining information and optimize the information service mode.

Design/methodology/approach

A research model of influencing factors is established by using the TAM (technology acceptance model) theory. The influencing factors of users' multi-modal information search behavior (MMISB) are analyzed by using questionnaire, experiment and the structural equation model. On the basis of this, some suggestions are put forward to build the multi-modal search (MMS) system and improve the efficiency of MMIS.

Findings

The research shows that users' MMISB is directly related to their search intention, and the search intention can influence users' cognition of the usefulness and ease of MMIS through their own information search ability and system characteristics. The user's MMIS ability is affected by the demand expression ability and retrieval ability cognition; the user's cognition of system characteristics is affected by the system function and information quality. This shows that the user's MMISB is closely related to the user's cognitive situation, but due to the author's limited time and research ability, only the questionnaire survey method cannot be used to in-depth research and explore the influencing factors of MMIS. Therefore, in the future research, we should combine the interview method to further track the user's emotional factors and scene factors.

Originality/value

For the first time, TAM theory is combined with cross-modal retrieval behavior and the paper explores the influencing factors and evaluation indexes of users' MMISB. The second, the questionnaire was compiled to investigate the influencing factors of the MMISB of the university group, and the reliability analysis, validity analysis, correlation analysis and structural equation model analysis of the survey data are carried out . The survey data and analysis results are original, which can provide a theoretical basis for improving the service level of MMIS.

中文翻译：

---

影响多模态信息搜索行为的因素

目的

随着网络资源和大数据的日益丰富，多模态信息搜索（Multi-modal Information Search，MMIS）受到越来越多的关注，但MMIS的研究成果相对较少。本文试图对多模态信息系统的设计提出建设性的建议，使系统具有更好的用户体验，帮助用户提高获取信息的效率，优化信息服务模式。

设计/方法/途径

运用TAM（技术接受模型）理论建立了影响因素的研究模型。采用问卷调查、实验和结构方程模型分析了用户多模态信息搜索行为（MMISB）的影响因素。在此基础上，提出构建多模态搜索（MMS）系统，提高MMIS效率的建议。

发现

研究表明，用户的MMISB与其搜索意愿直接相关，搜索意愿可以通过自身的信息搜索能力和系统特性影响用户对MMIS有用性和易用性的认知。用户的MMIS能力受需求表达能力和检索能力认知的影响；用户对系统特性的认知受系统功能和信息质量的影响。由此可见，用户的MMISB与用户的认知情况密切相关，但由于笔者时间和研究能力有限，无法仅采用问卷调查的方式对MMIS的影响因素进行深入研究和探究。因此，在今后的研究中，应结合访谈法进一步跟踪用户的

原创性/价值

首次将TAM理论与跨模态检索行为相结合，探讨了用户MMISB的影响因素和评价指标。其次,编制问卷调查高校群体MMISB的影响因素,并对调查数据进行信度分析、效度分析、相关分析和结构方程模型分析。调查数据和分析结果具有原创性，可为提高MMIS服务水平提供理论依据。