The process of rate-distortion (RD) optimization plays a key role for video coding, which aims to achieve a tradeoff between compression efficiency and video quality distortion. Although the conventional objective distortion metric mean squared error performs well in computational complexity, it is not always in accordance with the perceptual quality perceived by human visual system (HVS). Taking the characteristics of HVS into consideration, a perceptually weighted mean squared error (PWMSE) based RD model is proposed in this work. First, a low-pass filter is employed to process the original distortion information in order to simulate visual signal processing and obtain the perceptual distortion. Then, masking modulation in both temporal and spatial domains is introduced into distortion model, and a novel Lagrange multiplier is derived accordingly. The proposed PWMSE based RD model is applied to the high efficiency video coding standard, and comparative experimental results demonstrate its effectiveness. The project page can be found in https://mic.tongji.edu.cn/ab/40/c9778a174912/page.htm.

中文翻译：

---

基于感知加权均方误差的 HEVC 率失真优化

率失真 (RD) 优化过程对视频编码起着关键作用，旨在实现压缩效率和视频质量失真之间的权衡。尽管传统的客观失真度量均方误差在计算复杂度方面表现良好，但它并不总是与人类视觉系统（HVS）感知的感知质量一致。考虑到HVS的特点，本文提出了一种基于感知加权均方误差（PWMSE）的RD模型。首先，采用低通滤波器对原始失真信息进行处理，以模拟视觉信号处理，获得感知失真。然后，将时空域的掩蔽调制引入到失真模型中，并据此推导出一个新的拉格朗日乘数。提出的基于 PWMSE 的 RD 模型应用于高效视频编码标准，对比实验结果证明了其有效性。项目页面见https://mic.tongji.edu.cn/ab/40/c9778a174912/page.htm。