当前位置:
X-MOL 学术
›
arXiv.cs.MM
›
论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Estimating Blink Probability for Highlight Detection in Figure Skating Videos
arXiv - CS - Multimedia Pub Date : 2020-07-02 , DOI: arxiv-2007.01089 Tamami Nakano, Atsuya Sakata, Akihiro Kishimoto
arXiv - CS - Multimedia Pub Date : 2020-07-02 , DOI: arxiv-2007.01089 Tamami Nakano, Atsuya Sakata, Akihiro Kishimoto
Highlight detection in sports videos has a broad viewership and huge
commercial potential. It is thus imperative to detect highlight scenes more
suitably for human interest with high temporal accuracy. Since people
instinctively suppress blinks during attention-grabbing events and
synchronously generate blinks at attention break points in videos, the
instantaneous blink rate can be utilized as a highly accurate temporal
indicator of human interest. Therefore, in this study, we propose a novel,
automatic highlight detection method based on the blink rate. The method trains
a one-dimensional convolution network (1D-CNN) to assess blink rates at each
video frame from the spatio-temporal pose features of figure skating videos.
Experiments show that the method successfully estimates the blink rate in 94%
of the video clips and predicts the temporal change in the blink rate around a
jump event with high accuracy. Moreover, the method detects not only the
representative athletic action, but also the distinctive artistic expression of
figure skating performance as key frames. This suggests that the
blink-rate-based supervised learning approach enables high-accuracy highlight
detection that more closely matches human sensibility.
中文翻译:
估计花样滑冰视频中亮点检测的眨眼概率
体育视频中的亮点检测具有广泛的收视率和巨大的商业潜力。因此,必须以高时间精度检测更适合人类兴趣的高光场景。由于人们在吸引注意力的事件期间本能地抑制眨眼,并在视频中的注意断点处同步产生眨眼,因此瞬时眨眼率可以用作人类兴趣的高度准确的时间指标。因此,在本研究中,我们提出了一种基于眨眼率的新型自动高光检测方法。该方法训练一维卷积网络 (1D-CNN) 以根据花样滑冰视频的时空姿势特征评估每个视频帧的眨眼率。实验表明,该方法成功估计了 94% 视频剪辑中的眨眼率,并高精度地预测了跳跃事件周围眨眼率的时间变化。此外,该方法不仅检测具有代表性的运动动作,还检测花样滑冰表演的独特艺术表现作为关键帧。这表明基于眨眼率的监督学习方法可以实现更接近人类敏感性的高精度高光检测。
更新日期:2020-07-03
中文翻译:
估计花样滑冰视频中亮点检测的眨眼概率
体育视频中的亮点检测具有广泛的收视率和巨大的商业潜力。因此,必须以高时间精度检测更适合人类兴趣的高光场景。由于人们在吸引注意力的事件期间本能地抑制眨眼,并在视频中的注意断点处同步产生眨眼,因此瞬时眨眼率可以用作人类兴趣的高度准确的时间指标。因此,在本研究中,我们提出了一种基于眨眼率的新型自动高光检测方法。该方法训练一维卷积网络 (1D-CNN) 以根据花样滑冰视频的时空姿势特征评估每个视频帧的眨眼率。实验表明,该方法成功估计了 94% 视频剪辑中的眨眼率,并高精度地预测了跳跃事件周围眨眼率的时间变化。此外,该方法不仅检测具有代表性的运动动作,还检测花样滑冰表演的独特艺术表现作为关键帧。这表明基于眨眼率的监督学习方法可以实现更接近人类敏感性的高精度高光检测。