We present a novel hierarchical coding scheme for light fields based on transmittance patterns of low-rank multiplicative layers and Fourier disparity layers. The proposed scheme identifies multiplicative layers of light field view subsets optimized using convolutional neural networks for different scanning orders. Our approach exploits the hidden low-rank structure in the multiplicative layers obtained from the subsets of different scanning patterns. The spatial redundancies in the multiplicative layers can be efficiently removed by performing low-rank approximation at different ranks on the Krylov subspace. The intra-view and inter-view redundancies between approximated layers are further removed by HEVC encoding. Next, a Fourier disparity layer representation is constructed from the first subset of the approximated light field based on the chosen hierarchical order. Subsequent view subsets are synthesized by modeling the Fourier disparity layers that iteratively refine the representation with improved accuracy. The critical advantage of the proposed hybrid layered representation and coding scheme is that it utilizes not just spatial and temporal redundancies in light fields, but also efficiently exploits intrinsic similarities among neighboring sub-aperture images in both horizontal and vertical directions as specified by different predication orders. In addition, the scheme is flexible to realize a range of multiple bitrates at the decoder within a single integrated system. Comparison with state-of-the-art light field coders exhibits superior compression performance of the proposed scheme for real-world light fields. We achieve substantial bitrate savings and also maintain good light field reconstruction quality.

我们提出了一种新的基于低秩乘法层和傅里叶视差层的透射模式的光场分层编码方案。所提出的方案识别使用卷积神经网络针对不同扫描顺序优化的光场视图子集的乘法层。我们的方法利用了从不同扫描模式的子集获得的乘法层中隐藏的低秩结构。通过在 Krylov 子空间上执行不同秩的低秩逼近，可以有效地去除乘法层中的空间冗余。HEVC编码进一步去除了近似层之间的视图内和视图间冗余。下一个，傅里叶视差层表示是根据所选择的层次顺序从近似光场的第一个子集构建的。随后的视图子集通过对傅里叶视差层进行建模来合成，这些层以更高的精度迭代地细化表示。所提出的混合分层表示和编码方案的关键优势在于，它不仅利用了光场中的空间和时间冗余，而且还有效地利用了由不同预测顺序指定的水平和垂直方向上相邻子孔径图像之间的内在相似性. 此外，该方案可以灵活地在单个集成系统内的解码器处实现多种比特率。与最先进的光场编码器的比较显示出所提出的方案对现实世界光场的卓越压缩性能。我们实现了显着的比特率节省，并保持了良好的光场重建质量。