Many video enhancement algorithms rely on optical flow to register frames in a video sequence. Precise flow estimation is however intractable; and optical flow itself is often a sub-optimal representation for particular video processing tasks. In this paper, we propose task-oriented flow (TOFlow), a motion representation learned in a self-supervised, task-specific manner. We design a neural network with a trainable motion estimation component and a video processing component, and train them jointly to learn the task-oriented flow. For evaluation, we build Vimeo-90K, a large-scale, high-quality video dataset for low-level video processing. TOFlow outperforms traditional optical flow on standard benchmarks as well as our Vimeo-90K dataset in three video processing tasks: frame interpolation, video denoising/deblocking, and video super-resolution.

中文翻译：

---

使用面向任务的流程增强视频

许多视频增强算法依靠光流来注册视频序列中的帧。然而，精确的流量估计是棘手的。并且光流本身通常是特定视频处理任务的次优表示。在本文中，我们提出了面向任务的流 (TOFlow)，这是一种以自我监督的、特定于任务的方式学习的运动表示。我们设计了一个具有可训练运动估计组件和视频处理组件的神经网络，并联合训练它们以学习面向任务的流程。为了进行评估，我们构建了 Vimeo-90K，这是一个用于低级视频处理的大规模高质量视频数据集。TOFlow 在标准基准测试以及我们的 Vimeo-90K 数据集上在三个视频处理任务中优于传统光流：帧插值、视频去噪/去块和视频超分辨率。