-
Views
-
Cite
Cite
Gianclaudio Malgieri, Giovanni Comandé, Why a Right to Legibility of Automated Decision-Making Exists in the General Data Protection Regulation, International Data Privacy Law, Volume 7, Issue 4, November 2017, Pages 243–265, https://doi.org/10.1093/idpl/ipx019
Close - Share Icon Share
Extract
...
Introduction: the walls of the black box society
In the data-driven economy, the importance of algorithms has grown exponentially while artificial Intelligence applied to customer data management remains problematic for several reasons. Automated decision-making based on complex algorithms can not only determine the acceptance of a mortgage, the price of an insurance policy,1 but can also lead to ‘subtler’ issues. For instance, they can be used to exploit consumers’ specific vulnerabilities in order to distort their purchasing attitudes.2 Oftentimes, these algorithms are not only unknown but also unintelligible by individuals. In some cases, eg where machine-learning technologies are deployed, decision-making algorithms may be unintelligible also to their data controller.3 This situation has led to define the current Information Society as a ‘black box’ society.4 In other terms, as we have explained elsewhere,5 the problem of these algorithms is the lack of ‘readability’ and ‘legibility’ from individuals directly concerned by them.
