Over the past decade, the evolution of video-sharing platforms has attracted a significant amount of investments on contextual advertising. The common contextual advertising platforms utilize the information provided by users to integrate 2D visual ads into videos. The existing platforms face many technical challenges such as ad integration with respect to occluding objects and 3D ad placement. This paper presents a Video Advertisement Placement & Integration (Adverts) framework, which is capable of perceiving the 3D geometry of the scene and camera motion to blend 3D virtual objects in videos and create the illusion of reality. The proposed framework contains several modules such as monocular depth estimation, object segmentation, background-foreground separation, alpha matting and camera tracking. Our experiments conducted using Adverts framework indicates the significant potential of this system in contextual ad integration, and pushing the limits of advertising industry using mixed reality technologies.

中文翻译：

---

用于 3D 产品展示位置的广告创建系统

在过去十年中，视频共享平台的发展吸引了大量对上下文广告的投资。常见的上下文广告平台利用用户提供的信息将 2D 视觉广告集成到视频中。现有平台面临许多技术挑战，例如与遮挡对象和 3D 广告放置相关的广告集成。本文提出了一种视频广告投放和集成（广告）框架，该框架能够感知场景的 3D 几何形状和相机运动，以混合视频中的 3D 虚拟对象并创建现实的错觉。所提出的框架包含多个模块，例如单目深度估计、对象分割、背景-前景分离、alpha 抠图和相机跟踪。