Handicraft is a traditional cultural form which can improve children’s hands-on ability and spatial imagination ability. In addition, storytelling is another beneficial activity that can improve children’s language skill and creative power in their growing process. By combining handicraft elements and storytelling via mixed reality technology, this paper presents a new storytelling genre, which supports children and parents learning how to make handicraft and then use them as tangible interaction tools to design, create, tell and share stories, together with gesture interaction. Taking origami as an example, we design and implement a system and conduct a user study. Findings illustrate that our system has good usability and can motivate users’ interest in handicraft and storytelling and even promote parent–child interaction effectively.

中文翻译：

---

一种新的讲故事类型：通过混合现实技术结合手工艺元素和讲故事

手工艺是一种可以提高孩子动手能力和空间想象能力的传统文化形式。此外，讲故事是另一项有益的活动，可以在孩子成长的过程中提高他们的语言技能和创造力。通过混合现实技术将手工艺元素与讲故事相结合，本文提出了一种新的讲故事类型，支持孩子和父母学习如何制作手工艺品，然后将其作为有形的交互工具来设计、创作、讲述和分享故事，并结合手势相互作用。以折纸为例，我们设计并实现了一个系统，并进行了用户研究。结果表明，我们的系统具有良好的可用性，可以激发用户对手工和讲故事的兴趣，甚至可以有效地促进亲子互动。