The Visual Computer ( IF 3.5 ) Pub Date : 2021-01-02 , DOI: 10.1007/s00371-020-02027-9 Saptarshi Chakraborty , Alok Singh , Dalton Meitei Thounaojam
Shot boundary detection is mainly considered as a stepping stone in the broad arena of content-based video retrieval. Ample systematic investigation has been carried out in the terrain of shot boundary detection. The attainment of shot boundary detection procedures is greatly hindered due to the presence of unforeseen illumination change and motion effects in a video. This work proposes a novel bifold-stage technique to recognize abrupt transition in videos, invariant to motion, and illumination effects. In the first stage, the local ternary patterns feature is used to extract information from each frame in a video. Then, a set of novel adaptive thresholds such as \({\gamma }\) and \({{{\beta }}}\) are used to find the possible transition frames. In the confirmation stage, Lab color difference along with an adaptive threshold \({\delta }\) is used to extract actual transition frames. The experimental result depicts that the motion effect is also scaled down in the initial stage. The Lab color difference passed down in the second stage also handles the illumination and motion effects which are not managed in the initial stage. Experimentation is done using TRECVid 2001 and 2007 standard datasets and palpable that the proposed technique outperforms most of the contemporary shot boundary detection approaches.
中文翻译:
一种新颖的双阶段镜头边界检测算法:运动和照明不变
在基于内容的视频检索的广阔领域中,镜头边界检测主要被视为踏脚石。在镜头边界检测领域进行了足够的系统研究。由于视频中存在不可预见的照明变化和运动效果,因此大大限制了镜头边界检测程序的实现。这项工作提出了一种新颖的双阶段技术,以识别视频中的突然转变,运动和照明效果不变。在第一阶段,使用本地三元模式特征从视频中的每个帧中提取信息。然后,设置一组新颖的自适应阈值,例如\({\ gamma} \)和\({{{\ beta}}} \\用于查找可能的过渡帧。在确认阶段,Lab色差与自适应阈值\({\ delta} \)一起用于提取实际的过渡帧。实验结果表明,运动效果在初始阶段也按比例缩小。在第二阶段传递的Lab色差还可以处理初始阶段无法管理的照明和运动效果。使用TRECVid 2001和2007标准数据集进行了实验,可以看出,该技术优于大多数现代镜头边界检测方法。