当前位置: X-MOL 学术Decis. Support Syst. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Removing order effects from human-classified datasets: A machine learning method to improve decision making systems
Decision Support Systems ( IF 7.5 ) Pub Date : 2022-10-21 , DOI: 10.1016/j.dss.2022.113891
Dmitry Romanov , Valentin Molokanov , Nikolai Kazantsev , Ashish Kumar Jha

Although recent developments in Artificial Intelligence (AI) and machine learning (ML) aim to enhance the fairness and transparency of decision-making systems, research has found that neural networks (or other similar AI techniques) are still effected by human cognitive biases due to the training datasets. In this study, we focus on order effects, i.e., when the input of information impacts human perception and the decisions resulting from this information. We propose the Order Effect Removal Method (OERM) for handling the order effect which leads to bias and for helping organizations remove these biases from their training datasets and, therefore, from automated decision-making systems. Using design science principles to theoretically create, test, and validate the method, we can eliminate the order bias even in basic classification systems. Furthermore, the method can be applied in a multidisciplinary context, where an AI-based algorithm substitutes for manual work.



中文翻译:

从人类分类数据集中去除顺序效应:一种改进决策系统的机器学习方法

尽管人工智能 (AI) 和机器学习 (ML) 的最新发展旨在提高决策系统的公平性和透明度,但研究发现,由于以下原因,神经网络(或其他类似的 AI 技术)仍会受到人类认知偏差的影响训练数据集。在这项研究中,我们关注顺序效应,即信息输入何时影响人类感知和由此信息产生的决策。我们提出了顺序效应去除方法 (OERM) 来处理导致偏差的顺序效应,并帮助组织从他们的训练数据集中去除这些偏差,从而从自动决策系统中去除这些偏差。使用设计科学原理从理论上创建、测试和验证该方法,我们甚至可以在基本分类系统中消除顺序偏差。

更新日期:2022-10-21
down
wechat
bug