The 360 cameras have served as a convenient tool for people to record their special moments or everyday lives. The supported panoramic view allowed for an immersive experience with a virtual reality (VR) headset, thus adding viewer enjoyment. Nevertheless, they cannot deliver the best angular resolution images that a perspective camera may support. We put forward a solution by placing the perspective camera planar image onto the pertinent 360 camera equirectangular image region of interest (ROI) through planar-equirectangular image stitching. The proposed method includes (1) tangent image-based stitching pipeline to solve the equirectangular image spherical distortion, (2) feature matching scheme to increase correct feature match count, (3) ROI detection to find the relevant ROI on the equirectangular image, and (4) human visual system (HVS)-based image alignment to tackle the parallax error. The qualitative and quantitative experiments showed improvement of the proposed planar-equirectangular image stitching over existing approaches on a collected dataset: (1) less distortion on the stitching result, (2) 29.0% increased on correct matches, (3) $5.72$ ROI position error from the ground truth and (4) lower aggregated alignment-distortion error over existing alignment approaches. We discuss possible improvement points and future research directions.

中文翻译：

---

平面矩形矩形图像拼接

360摄像机是人们记录自己的特殊时刻或日常生活的便捷工具。受支持的全景视图使您可以通过虚拟现实（VR）耳机获得身临其境的体验，从而增加了观看者的享受。但是，它们无法提供透视相机可能支持的最佳角分辨率图像。我们提出了一种解决方案，即通过平面-矩形图像拼接将透视相机平面图像放置在相关的360相机等边矩形图像感兴趣区域（ROI）上。所提出的方法包括（1）基于切线图像的缝合流水线解决等矩形图像的球面畸变;（2）特征匹配方案以增加正确的特征匹配数;（3）ROI检测以找到等矩形图像上的相关ROI; （4）基于人类视觉系统（HVS）的图像对齐以解决视差错误。定性和定量实验表明，与现有方法相比，所提出的平面-矩形矩形图像拼接在采集的数据集上有所改进：（1）拼接结果失真较小；（2）正确匹配后，拼接结果增加了29.0％，（3）$5。72$来自地面真相的ROI位置误差和（4）比现有的对准方法更低的聚集对准失真误差。我们讨论了可能的改进点和未来的研究方向。