Mean squared error (MSE) is adopted as the distortion metric for the rate-distortion optimization (RDO) and rate control (RC) in most of the existing video coding standards, e.g., H.265/High-Efficiency Video Coding (HEVC) and H.264/Advanced Video Coding (AVC), because the pixel-wise MSE can represent the image fidelity efficiently. As videos are usually used for visual enjoyment, recently, researchers found that the MSE is not always consistent with perceptual quality, and proposed some perceptual quality-based video coding methods by exchanging the MSE with other perceptual quality metrics completely, like the structure similarity index (SSIM), just noticeable distortion (JND), etc. We believe that a sophisticated video encoder should guarantee both the subject quality and the data fidelity. By investigating the properties of the human visual system (HVS), hybrid distortion-based RDO and RC methods are proposed to improve subjective quality while avoiding fidelity degradation. Experimental results demonstrate that the proposed methods can improve subjective quality efficiently, while preserving the image fidelity of the reconstructed videos as much as possible.

中文翻译：

---

基于混合失真的H.265 / HEVC速率失真优化和速率控制

在大多数现有视频编码标准（例如H.265 /高效视频编码（HEVC））中，均方误差（MSE）被用作速率失真优化（RDO）和速率控制（RC）的失真度量。和H.264 /高级视频编码（AVC），因为逐像素MSE可以有效地表示图像保真度。由于视频通常用于视觉享受，因此最近，研究人员发现MSE并不总是与感知质量保持一致，因此通过将MSE与其他感知质量指标（例如结构相似性指标）完全交换，提出了一些基于感知质量的视频编码方法（SSIM），明显的失真（JND）等。我们认为，复杂的视频编码器应同时保证拍摄对象的质量和数据保真度。通过研究人类视觉系统（HVS）的属性，提出了基于混合失真的RDO和RC方法，以提高主观质量，同时避免保真度下降。实验结果表明，所提出的方法可以有效地提高主观质量，同时尽可能保留重构视频的图像保真度。