当前位置: X-MOL 学术IEEE Trans. Circuit Syst. II Express Briefs › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A 0.82 μW CIS-Based Action Recognition SoC With Self-Adjustable Frame Resolution for Always-on IoT Devices
IEEE Transactions on Circuits and Systems II: Express Briefs ( IF 4.4 ) Pub Date : 2021-03-18 , DOI: 10.1109/tcsii.2021.3067151
Junha Ryu , Gwangtae Park , Dongseok Im , Ji-Hoon Kim , Hoi-Jun Yoo

An always-on video-based human action recognition (HAR) system on chip (SoC) integrated with a CMOS image sensor (CIS) is proposed for the Internet of Things (IoT) devices. The proposed SoC is the first always-on integrated circuit (IC) performing the full process of HAR in a single chip. To resolve large power consumption from vision sensor and compute-intensive DNN operation, the proposed SoC operates in two different modes; 1) in adaptive frame resolution based human action recognition (AFR-HAR) mode, CIS resolution prediction algorithm and self-adjustable CIS reduce 42.9–91.8% of readout power by adaptively adjusting frame resolution. 2) In motion event detection (MED) mode, the motion event detection unit (MEDU) skips unnecessary imaging and DNN computation by monitoring motion events and leads to over 99% power saving. The proposed HAR SoC is simulated in 65-nm CMOS technology and occupies 8.56 mm 2 . It consumes only 0.82 ${\mu }\text{W}$ when no motion is detected and 0.31–8.52 mW for evaluating human actions on the ActivityNet dataset.

中文翻译:

具有0.82μWCIS的动作识别SoC,具有可自行调节的帧分辨率,适用于永远在线的IoT设备

针对物联网(IoT)设备,提出了一种基于视频的全人类动作识别(HAR)片上系统(SoC),该系统与CMOS图像传感器(CIS)集成在一起。拟议的SoC是第一个在单个芯片中执行HAR完整过程的始终在线集成电路(IC)。为了解决视觉传感器和计算密集型DNN操作带来的大量功耗,建议的SoC以两种不同的模式工作;1)在基于自适应帧分辨率的人类动作识别(AFR-HAR)模式下,CIS分辨率预测算法和自调整CIS通过自适应调整帧分辨率而降低了42.9–91.8%的读取功率。2)在运动事件检测(MED)模式下,运动事件检测单元(MEDU)通过监视运动事件来跳过不必要的成像和DNN计算,从而节省了超过99%的电量。 2 。它仅消耗0.82 $ {\ mu} \ text {W} $ 当未检测到运动时,则使用0.31–8.52 mW来评估ActivityNet数据集上的人为行为。
更新日期:2021-05-04
down
wechat
bug