For many social events such as public performances, multiple hand-held cameras may capture the same event. This footage is often collected by amateur cinematographers who typically have little control over the scene and may not pay close attention to the camera. For these reasons, each individually captured video may fail to cover the whole time of the event, or may lose track of interesting foreground content such as a performer. We introduce a new algorithm that can synthesize a single smooth video sequence of moving foreground objects captured by multiple hand-held cameras. This allows later viewers to gain a cohesive narrative experience that can transition between different cameras, even though the input footage may be less than ideal. We first introduce a graph-based method for selecting a good transition route. This allows us to automatically select good cut points for the hand-held videos, so that smooth transitions can be created between the resulting video shots. We also propose a method to synthesize a smooth photorealistic transition video between each pair of hand-held cameras, which preserves dynamic foreground content during this transition. Our experiments demonstrate that our method outperforms previous state-of-the-art methods, which struggle to preserve dynamic foreground content.

中文翻译：

---

多台具有动态前景的手持摄像机的相干视频生成

对于许多社交活动，例如公共表演，多个手持摄像机可能会捕获同一事件。这些镜头通常是由业余摄影师收集的，他们通常对场景几乎没有控制权，可能不会密切注意相机。由于这些原因，每个单独捕获的视频可能无法覆盖事件的整个时间，或者可能失去对诸如表演者之类的有趣前景内容的跟踪。我们引入了一种新算法，可以合成由多个手持摄像机捕获的移动前景对象的单个平滑视频序列。这样，即使输入素材可能不够理想，以后的观看者也可以获得在不同摄像机之间转换的凝聚力叙事体验。我们首先介绍一种基于图的方法来选择良好的过渡路线。这使我们能够为手持视频自动选择合适的切入点，从而可以在生成的视频镜头之间创建平滑的过渡。我们还提出了一种在每对手持摄像机之间合成平滑的逼真的过渡视频的方法，该方法可以在过渡期间保留动态前景内容。我们的实验表明，我们的方法优于以前的最新方法，后者难以保留动态前景内容。