Several recent studies on compressive video sensing realized scene capture beyond the fundamental trade-off limit between spatial resolution and temporal resolution using random space-time sampling. However, most of these studies obtained results for higher-frame-rate video that was produced in simulation experiments or using an optically simulated random sampling camera, because there are currently no commercially available image sensors with random exposure or sampling capabilities. We fabricated a prototype complementary metal-oxide-semiconductor (CMOS) image sensor with quasi pixel-wise exposure timing that can realize nonuniform space-time sampling. The prototype sensor resets exposures independently by columns and fixes these exposures by rows for each 8 × 8-pixel block. This CMOS sensor is not fully controllable the pixels and has line-dependent control, but offers greater flexibility when compared with regular CMOS or charge-coupled device sensors with global or rolling shutters. We propose a method of realizing pseudo-random sampling for high-speed video acquisition that uses the flexibility of the CMOS sensor. We reconstruct the high-speed video sequence from images produced in pseudo-random sampling using a pre-learned decoder.

中文翻译：

---

使用具有准像素明智曝光功能的CMOS图像传感器进行高速成像

压缩视频感测的一些最新研究使用随机时空采样实现了超出空间分辨率和时间分辨率之间基本权衡限制的场景捕获。但是，这些研究中的大多数都获得了在模拟实验或使用光学模拟的随机采样相机中产生的更高帧频视频的结果，因为当前尚无具有随机曝光或采样功能的商用图像传感器。我们制造了具有准像素曝光定时的原型互补金属氧化物半导体（CMOS）图像传感器，可以实现不均匀的时空采样。原型传感器针对每个8×8像素块按列独立地重置曝光，并按行固定这些曝光。这种CMOS传感器不能完全控制像素，并且具有与行有关的控制，但是与常规CMOS或带全局或滚动百叶窗的电荷耦合器件传感器相比，具有更大的灵活性。我们提出一种利用CMOS传感器的灵活性实现用于高速视频采集的伪随机采样的方法。我们使用预先学习的解码器从伪随机采样中产生的图像中重建高速视频序列。