Digital technology has made it easier for researchers to conduct and produce multimodal data. In terms of a social semiotic understanding, multimodal means that data are produced from different sign resources, such as field protocols combined with visual recordings or document analysis consisting of audiovisual material. The increase in multimodal data brings the challenge of developing analytical tools not only to collect data but also to examine them. In this article, I introduce a research approach for how to integrate multimodal data within the framework of grounded theory by extending the coding process with a social semiotic understanding of data as a combination of different sign modes. This approach makes it possible not only to analyze data based on different modes separately but also to analyze their combination, for example, the interweaving of text and image.

数字技术使研究人员更容易进行和产生多模式数据。就社会符号学的理解而言，多模式意味着从不同的标志资源中产生数据，例如与视频记录或由视听材料组成的文档分析相结合的现场协议。多峰数据的增加带来了开发分析工具的挑战，这些工具不仅要收集数据，还要检查它们。在本文中，我将介绍一种研究方法，该方法通过将编码过程扩展为对数据的社会符号学理解为不同符号模式的组合，从而在扎根理论的框架内整合多峰数据。这种方法不仅可以分别分析基于不同模式的数据，还可以分析其组合，例如，