Previous research reveals that the visual design of open-ended questions should match the response task so that respondents can infer the expected response format. Based on a web survey including specific probes in a list-style open-ended question format, we experimentally tested the effects of varying numbers of answer boxes on several indicators of response quality. Our results showed that using multiple small answer boxes instead of one large box had a positive impact on the number and variety of themes mentioned, as well as on the conciseness of responses to specific probes. We found no effect on the relevance of themes and the risk of item non-response. Based on our findings, we recommend using multiple small answer boxes instead of one large box to convey the expected response format and improve response quality in specific probes. This study makes a valuable contribution to the field of web probing, extends the concept of response quality in list-style open-ended questions, and provides a deeper understanding of how visual design features affect cognitive response processes in web surveys.

先前的研究表明，开放式问题的视觉设计应与响应任务相匹配，以便受访者可以推断出预期的响应格式。基于包含列表式开放式问题格式的特定调查的网络调查，我们通过实验测试了不同数量的答案框对几个响应质量指标的影响。我们的结果表明，使用多个小答案框而不是一个大框对提到的主题的数量和种类以及对特定调查的响应的简洁性有积极影响。我们发现对主题的相关性和项目不响应的风险没有影响。根据我们的发现，我们建议使用多个小答案框而不是一个大框来传达预期的响应格式并提高特定探测的响应质量。