当前位置: X-MOL 学术Int. J. Soc. Robotics › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Designing AI for Explainability and Verifiability: A Value Sensitive Design Approach to Avoid Artificial Stupidity in Autonomous Vehicles
International Journal of Social Robotics ( IF 3.8 ) Pub Date : 2021-05-15 , DOI: 10.1007/s12369-021-00790-w
Steven Umbrello , Roman V. Yampolskiy

One of the primary, if not most critical, difficulties in the design and implementation of autonomous systems is the black-boxed nature of the decision-making structures and logical pathways. How human values are embodied and actualised in situ may ultimately prove to be harmful if not outright recalcitrant. For this reason, the values of stakeholders become of particular significance given the risks posed by opaque structures of intelligent agents. This paper explores how decision matrix algorithms, via the belief-desire-intention model for autonomous vehicles, can be designed to minimize the risks of opaque architectures. Primarily through an explicit orientation towards designing for the values of explainability and verifiability. In doing so, this research adopts the Value Sensitive Design (VSD) approach as a principled framework for the incorporation of such values within design. VSD is recognized as a potential starting point that offers a systematic way for engineering teams to formally incorporate existing technical solutions within ethical design, while simultaneously remaining pliable to emerging issues and needs. It is concluded that the VSD methodology offers at least a strong enough foundation from which designers can begin to anticipate design needs and formulate salient design flows that can be adapted to the changing ethical landscapes required for utilisation in autonomous vehicles.



中文翻译:

设计可解释性和可验证性的AI:避免自动驾驶汽车人为愚蠢的价值敏感设计方法

自治系统的设计和实现中的主要(即使不是最关键的)困难之一是决策结构和逻辑路径的黑盒性质。如果不是完全顽固的话,人类价值观如何在原地体现和实现可能最终被证明是有害的。因此,鉴于智能代理的不透明结构所带来的风险,利益相关者的价值变得尤为重要。本文探讨了如何通过自动驾驶汽车的信念-愿望-意图模型来设计决策矩阵算法,以最大程度地减少不透明架构的风险。主要通过对设计一个明确的方向可解释性和可验证性的价值。为此,本研究采用了“价值敏感设计”(VSD)方法作为将这些价值纳入设计的原则性框架。VSD被认为是一个潜在的起点,它为工程团队提供了一种系统的方式,以将现有技术解决方案正式纳入道德设计中,同时又能顺应新出现的问题和需求。结论是,VSD方法论至少提供了足够强大的基础,设计师可以从中开始预期设计需求,并制定出显着的设计流程,以适应自动驾驶汽车使用中不断变化的道德环境。

更新日期:2021-05-17
down
wechat
bug