Abstract The human–machine collaboration system is a key means of manufacturing. Its surveillance, prognostic, and health management are related to safety and manufacturing persistence. This paper begins with the mission requirements of intelligent manufacturing. The study is based on the visual question answering (VQA) technology with a digital twin to increase efficiency. The research contents are as follows: (1) A method of modeling human–machine collaboration based on digital twins is proposed. (2) A VQA is adopted in the digital twin. The video and neural language are considered. (3) VQA technology is introduced into the modeling of the human–machine collaboration system for consistent integration. With VQA technology, humans and machines can collaborate. Human–machine interaction and product counting are implemented in a case study to provide a comprehensive perception.

中文翻译：

---

通过视觉问答改进人机协作中的视觉语言交互模式的数字孪生

摘要 人机协作系统是制造的关键手段。其监测、预后和健康管理与安全性和制造持久性有关。本文从智能制造的任务需求入手。该研究基于视觉问答 (VQA) 技术和数字双胞胎，以提高效率。研究内容如下：（1）提出了一种基于数字孪生的人机协作建模方法。(2) 数字孪生采用 VQA。考虑了视频和神经语言。(3) VQA技术被引入到人机协作系统的建模中以实现一致集成。借助 VQA 技术，人机可以协作。