Research on mixed devices in web surveys is in its infancy. Using a randomized experiment, we investigated device effects (desktop PC, tablet and mobile phone) for six response formats and four different numbers of scale points. N = 5,077 members of an online access panel participated in the experiment. An exact test of measurement invariance and Composite Reliability were investigated. The results provided full data comparability for devices and formats, with the exception of continuous Visual Analog Scale (VAS), but limited comparability for different numbers of scale points. There were device effects on reliability when looking at the interactions with formats and number of scale points. VAS, use of mobile phones and five point scales consistently gained lower reliability. We suggest technically less demanding implementations as well as a unified design for mixed-device surveys.

在网络调查中对混合设备的研究还处于起步阶段。使用随机实验，我们调查了六种响应格式和四种不同数量的刻度点的设备效果（台式电脑、平板电脑和手机）。N = 5,077 名在线访问小组成员参与了该实验。研究了测量不变性和复合可靠性的精确检验。结果为设备和格式提供了完整的数据可比性，连续视觉模拟量表 (VAS) 除外，但对于不同数量的量表点的可比性有限。在查看与格式和比例点数量的交互时，设备对可靠性有影响。VAS、手机的使用和五点量表的可靠性始终较低。