In complex visual representations, there are several possible challenges for the visual perception that might be eased by adding sound as a second modality (i.e. sonification). It was hypothesized that sonification would support visual perception when facing challenges such as simultaneous brightness contrast or the Mach band phenomena. This hypothesis was investigated with an interactive sonification test, yielding objective measures (accuracy and response time) as well as subjective measures of sonification benefit. In the test, the participant’s task was to mark the vertical pixel line having the highest intensity level. This was done in a condition without sonification and in three conditions where the intensity level was mapped to different musical elements. The results showed that there was a benefit of sonification, with higher accuracy when sonification was used compared to no sonification. This result was also supported by the subjective measurement. The results also showed longer response times when sonification was used. This suggests that the use and processing of the additional information took more time, leading to longer response times but also higher accuracy. There were no differences between the three sonification conditions.

中文翻译：

---

声化支持感知亮度对比

在复杂的视觉表示中，视觉感知存在一些可能的挑战，可以通过将声音作为第二种形式（即超音波）添加来缓解。据推测，当面临诸如同时亮度对比或马赫带现象的挑战时，超声处理将支持视觉感知。通过交互式的声波测验对这一假设进行了研究，得出了客观的测量值（准确性和响应时间）以及主观的声波测量收益。在测试中，参与者的任务是标记强度最高的垂直像素线。这是在没有声音的情况下以及在将强度级别映射到不同音乐元素的三个条件下完成的。结果表明，进行超声波处理有好处，与未使用超声波处理相比，使用超声波处理时具有更高的准确性。主观测量也支持该结果。结果还表明，使用超声波处理时，响应时间更长。这表明附加信息的使用和处理花费了更多时间，从而导致更长的响应时间以及更高的准确性。三种超声条件之间没有差异。