We present a system that converts annotated broadcast video of tennis matches into interactively controllable video sprites that behave and appear like professional tennis players. Our approach is based on controllable video textures and utilizes domain knowledge of the cyclic structure of tennis rallies to place clip transitions and accept control inputs at key decision-making moments of point play. Most importantly, we use points from the video collection to model a player’s court positioning and shot selection decisions during points. We use these behavioral models to select video clips that reflect actions the real-life player is likely to take in a given match-play situation, yielding sprites that behave realistically at the macro level of full points, not just individual tennis motions. Our system can generate novel points between professional tennis players that resemble Wimbledon broadcasts, enabling new experiences, such as the creation of matchups between players that have not competed in real life or interactive control of players in the Wimbledon final. According to expert tennis players, the rallies generated using our approach are significantly more realistic in terms of player behavior than video sprite methods that only consider the quality of motion transitions during video synthesis. The supplementary material/video are available at our https://cs.stanford.edu/~haotianz/research/vid2player/ project website.

中文翻译：

---

Vid2Player：行为和外观像职业网球运动员的可控视频精灵

我们提出了一个系统，该系统将带注释的网球比赛广播视频转换为可交互控制的视频精灵，其行为和外观都像职业网球运动员。我们的方法基于可控的视频纹理，并利用网球集会循环结构的领域知识来放置剪辑转换并在关键决策时刻接受控制输入。最重要的是，我们使用视频集合中的点来模拟球员在得分期间的球场定位和投篮选择决策。我们使用这些行为模型来选择反映现实生活中的玩家在给定的比赛情况下可能采取的动作的视频剪辑，从而产生在宏观层面上表现逼真的精灵，而不仅仅是单个网球运动。我们的系统可以在职业网球运动员之间生成类似于温网转播的新积分，从而实现新的体验，例如在没有参加过现实生活的球员之间创建对决或在温网决赛中对球员进行交互控制。根据网球专家的说法，使用我们的方法生成的集会在球员行为方面比只考虑视频合成过程中运动过渡质量的视频精灵方法要真实得多。补充材料/视频可在我们的 https://cs.stanford.edu/~haotianz/research/vid2player/ 项目网站上找到。例如在现实生活中没有参加过比赛的球员之间创建对决或在温布尔登决赛中对球员进行交互控制。根据网球专家的说法，使用我们的方法生成的集会在球员行为方面比只考虑视频合成过程中运动过渡质量的视频精灵方法要真实得多。补充材料/视频可在我们的 https://cs.stanford.edu/~haotianz/research/vid2player/ 项目网站上找到。例如在现实生活中没有参加过比赛的球员之间创建对决或在温布尔登决赛中对球员进行交互控制。根据网球专家的说法，使用我们的方法生成的集会在球员行为方面比只考虑视频合成过程中运动过渡质量的视频精灵方法要真实得多。补充材料/视频可在我们的 https://cs.stanford.edu/~haotianz/research/vid2player/ 项目网站上找到。