当前位置: X-MOL 学术Pattern Recogn. Lett. › 论文详情
Controlling information capacity of binary neural network
Pattern Recognition Letters ( IF 3.255 ) Pub Date : 2020-07-25 , DOI: 10.1016/j.patrec.2020.07.033
Dmitry Ignatov; Andrey Ignatov

Despite the growing popularity of deep learning technologies, high memory requirements and power consumption are essentially limiting their application in mobile and IoT areas. While binary convolutional networks can alleviate these problems, the limited bitwidth of weights is often leading to significant degradation of prediction accuracy. In this paper, we present a method for training binary networks that maintains a stable predefined level of their information capacity throughout the training process by applying Shannon entropy based penalty to convolutional filters. The results of experiments conducted on the SVHN, CIFAR and ImageNet datasets demonstrate that the proposed approach can statistically significantly improve the accuracy of binary networks.

更新日期:2020-08-01

 

全部期刊列表>>
欢迎访问IOP中国网站
自然职场线上招聘会
GIANT
产业、创新与基础设施
自然科研线上培训服务
材料学研究精选
胸腔和胸部成像专题
屿渡论文,编辑服务
何川
苏昭铭
陈刚
姜涛
李闯创
李刚
北大
隐藏1h前已浏览文章
课题组网站
新版X-MOL期刊搜索和高级搜索功能介绍
ACS材料视界
天合科研
x-mol收录
上海纽约大学
张健
陈芬儿
厦门大学
史大永
吉林大学
卓春祥
张昊
杨中悦
试剂库存
down
wechat
bug