当前位置: X-MOL 学术IEEE Trans. Inform. Theory › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Inference under Information Constraints I: Lower Bounds from Chi-Square Contraction
IEEE Transactions on Information Theory ( IF 2.2 ) Pub Date : 2020-12-01 , DOI: 10.1109/tit.2020.3028440
Jayadev Acharya , Clement L. Canonney , Himanshu Tyagiz

Multiple players are each given one independent sample, about which they can only provide limited information to a central referee. Each player is allowed to describe its observed sample to the referee using a channel from a family of channels $\mathcal {W}$ , which can be instantiated to capture, among others, both the communication- and privacy-constrained settings. The referee uses the players’ messages to solve an inference problem on the unknown distribution that generated the samples. We derive lower bounds for the sample complexity of learning and testing discrete distributions in this information-constrained setting. Underlying our bounds is a characterization of the contraction in chi-square distance between the observed distributions of the samples when information constraints are placed. This contraction is captured in a local neighborhood in terms of chi-square and decoupled chi-square fluctuations of a given channel, two quantities we introduce. The former captures the average distance between distributions of channel output for two product distributions on the input, and the latter for a product distribution and a mixture of product distribution on the input. Our bounds are tight for both public- and private-coin protocols. Interestingly, the sample complexity of testing is order-wise higher when restricted to private-coin protocols.

中文翻译:

信息约束下的推理 I:卡方收缩的下限

多名球员每人都有一个独立的样本,他们只能向中央裁判提供有限的信息。允许每个玩家使用来自频道系列 $\mathcal {W}$ 的频道向裁判描述其观察到的样本,该频道可以被实例化以捕获通信和隐私受限的设置等。裁判使用玩家的消息来解决生成样本的未知分布的推理问题。我们推导出在这种信息受限的设置中学习和测试离散分布的样本复杂性的下限。我们的界限的基础是在放置信息约束时观察到的样本分布之间的卡方距离收缩的特征。这种收缩是根据给定通道的卡方和解耦卡方波动在局部邻域中捕获的,我们引入了两个量。前者捕获输入上两个产品分布的通道输出分布之间的平均距离,后者捕获输入上的产品分布和产品分布的混合。我们对公共和私人硬币协议的限制都很严格。有趣的是,当仅限于私有硬币协议时,测试的样本复杂性按顺序更高。后者用于输入的产品分布和产品分布的混合。我们对公共和私人硬币协议的限制都很严格。有趣的是,当仅限于私有硬币协议时,测试的样本复杂性按顺序更高。后者用于输入的产品分布和产品分布的混合。我们对公共和私人硬币协议的限制都很严格。有趣的是,当仅限于私有硬币协议时,测试的样本复杂性按顺序更高。
更新日期:2020-12-01
down
wechat
bug