当前位置: X-MOL 学术IEEE Trans. Vis. Comput. Graph. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A Log-Rectilinear Transformation for Foveated 360-degree Video Streaming
IEEE Transactions on Visualization and Computer Graphics ( IF 4.7 ) Pub Date : 2021-03-22 , DOI: 10.1109/tvcg.2021.3067762
David Li , Ruofei Du , Adharsh Babu , Camelia D. Brumar , Amitabh Varshney

With the rapidly increasing resolutions of 360° cameras, head-mounted displays, and live-streaming services, streaming high-resolution panoramic videos over limited-bandwidth networks is becoming a critical challenge. Foveated video streaming can address this rising challenge in the context of eye-tracking-equipped virtual reality head-mounted displays. However, conventional log-polar foveated rendering suffers from a number of visual artifacts such as aliasing and flickering. In this paper, we introduce a new log-rectilinear transformation that incorporates summed-area table filtering and off-the-shelf video codecs to enable foveated streaming of 360° videos suitable for VR headsets with built-in eye-tracking. To validate our approach, we build a client-server system prototype for streaming 360° videos which leverages parallel algorithms over real-time video transcoding. We conduct quantitative experiments on an existing 360° video dataset and observe that the log-rectilinear transformation paired with summed-area table filtering heavily reduces flickering compared to log-polar subsampling while also yielding an additional 10% reduction in bandwidth usage.

中文翻译:

圆弧360度平移视频流的对数-线性变换

随着360°摄像头,头戴式显示器和实时流媒体服务分辨率的快速提高,在有限带宽网络上流传输高分辨率全景视频正成为一项严峻的挑战。集中式视频流可以在配备了眼动仪的虚拟现实头戴式显示器的背景下解决这一日益严峻的挑战。然而,常规的对数极偏心的渲染遭受许多视觉伪像的困扰,例如混叠和闪烁。在本文中,我们介绍了一种新的对数-直线变换,该变换结合了求和区域表过滤和现成的视频编解码器,可实现适用于内置眼动追踪的VR头戴设备的中心化360°视频流。为了验证我们的方法,我们构建了用于流式传输360°视频的客户端-服务器系统原型,该原型利用并行算法进行实时视频转码。我们对现有的360°视频数据集进行了定量实验,观察到与对数极坐标子采样相比,对数直线变换与求和面积表滤波配对可大大减少闪烁,同时还可减少带宽使用量的10%。
更新日期:2021-04-20
down
wechat
bug