当前位置: X-MOL 学术arXiv.cs.MM › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
FVV Live: A real-time free-viewpoint video system with consumer electronics hardware
arXiv - CS - Multimedia Pub Date : 2020-07-01 , DOI: arxiv-2007.00558
Pablo Carballeira, Carlos Carmona, C\'esar D\'iaz, Daniel Berj\'on, Daniel Corregidor, Juli\'an Cabrera, Francisco Mor\'an, Carmen Doblado, Sergio Arnaldo, Mar\'ia del Mar Mart\'in, Narciso Garc\'ia

FVV Live is a novel end-to-end free-viewpoint video system, designed for low cost and real-time operation, based on off-the-shelf components. The system has been designed to yield high-quality free-viewpoint video using consumer-grade cameras and hardware, which enables low deployment costs and easy installation for immersive event-broadcasting or videoconferencing. The paper describes the architecture of the system, including acquisition and encoding of multiview plus depth data in several capture servers and virtual view synthesis on an edge server. All the blocks of the system have been designed to overcome the limitations imposed by hardware and network, which impact directly on the accuracy of depth data and thus on the quality of virtual view synthesis. The design of FVV Live allows for an arbitrary number of cameras and capture servers, and the results presented in this paper correspond to an implementation with nine stereo-based depth cameras. FVV Live presents low motion-to-photon and end-to-end delays, which enables seamless free-viewpoint navigation and bilateral immersive communications. Moreover, the visual quality of FVV Live has been assessed through subjective assessment with satisfactory results, and additional comparative tests show that it is preferred over state-of-the-art DIBR alternatives.

中文翻译:

FVV Live:具有消费电子硬件的实时自由视点视频系统

FVV Live 是一种新颖的端到端自由视点视频系统,专为低成本和实时操作而设计,基于现成的组件。该系统旨在使用消费级摄像头和硬件生成高质量的自由视点视频,从而降低部署成本并易于安装,适用于沉浸式事件广播或视频会议。该论文描述了系统的架构,包括在多个捕获服务器中获取和编码多视图加深度数据以及在边缘服务器上进行虚拟视图合成。系统的所有模块都旨在克服硬件和网络的限制,这些限制直接影响深度数据的准确性,从而影响虚拟视图合成的质量。FVV Live 的设计允许任意数量的摄像机和捕获服务器,并且本文中呈现的结果对应于使用九个基于立体的深度相机的实现。FVV Live 具有低运动到光子和端到端延迟,可实现无缝的自由视点导航和双边沉浸式通信。此外,通过主观评估对 FVV Live 的视觉质量进行了评估,结果令人满意,另外的比较测试表明,它优于最先进的 DIBR 替代品。
更新日期:2020-07-02
down
wechat
bug