当前位置: X-MOL 学术IEEE Signal Process. Lett. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Perception-Based Pseudo-Motion Response for 360-Degree Video Streaming
IEEE Signal Processing Letters ( IF 3.9 ) Pub Date : 2022-09-08 , DOI: 10.1109/lsp.2022.3205272
Jiaqi Zhang 1 , Lu Yu 1 , Hualong Yu 1
Affiliation  

Streaming high-quality 360-degree video over constrained networks with low latency is very challenging due to high bandwidth requirement. Tile-based viewport adaptive streaming that proactively delivers predicted visible fields with higher quality is bandwidth-friendly, but limited prediction accuracy of head movement results in degraded viewport quality. In this letter, we propose a perception-based pseudo-motion response strategy to mitigate the damage to viewport quality, benefiting from human perception thresholds for head rotation losses and gains in virtual environment. It employs imperceptible virtual rotation losses when the imminent physical viewports may exceed the high-quality region, and immediate losses compensation once the prediction performs well. Experiments results show that our proposed strategy achieves an additional average 1.43% coding gain compared to traditional tile-based video streaming. Most notably, the proposed method is compatible with any tile-based video streaming.

中文翻译:

360 度视频流的基于感知的伪运动响应

由于高带宽要求,在受限网络上以低延迟流式传输高质量 360 度视频非常具有挑战性。主动提供更高质量的预测可见场的基于切片的视口自适应流对带宽友好,但头部运动的有限预测精度会导致视口质量下降。在这封信中,我们提出了一种基于感知的伪运动响应策略,以减轻对视口质量的损害,受益于虚拟环境中头部旋转损失和增益的人类感知阈值。当即将到来的物理视口可能超过高质量区域时,它采用难以察觉的虚拟旋转损失,一旦预测表现良好,立即损失补偿。实验结果表明,我们提出的策略实现了额外的平均 1。与传统的基于图块的视频流相比,编码增益为 43%。最值得注意的是,所提出的方法与任何基于图块的视频流兼容。
更新日期:2022-09-08
down
wechat
bug