当前位置: X-MOL 学术Bus. Inf. Syst. Eng. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Discovering Data Quality Problems
Business & Information Systems Engineering ( IF 7.9 ) Pub Date : 2019-07-22 , DOI: 10.1007/s12599-019-00608-0
Ruojing Zhang , Marta Indulska , Shazia Sadiq

Existing methodologies for identifying data quality problems are typically user-centric, where data quality requirements are first determined in a top-down manner following well-established design guidelines, organizational structures and data governance frameworks. In the current data landscape, however, users are often confronted with new, unexplored datasets that they may not have any ownership of, but that are perceived to have relevance and potential to create value for them. Such repurposed datasets can be found in government open data portals, data markets and several publicly available data repositories. In such scenarios, applying top-down data quality checking approaches is not feasible, as the consumers of the data have no control over its creation and governance. Hence, data consumers – data scientists and analysts – need to be empowered with data exploration capabilities that allow them to investigate and understand the quality of such datasets to facilitate well-informed decisions on their use. This research aims to develop such an approach for discovering data quality problems using generic exploratory methods that can be effectively applied in settings where data creation and use is separated. The approach, named LANG, is developed through a Design Science approach on the basis of semiotics theory and data quality dimensions. LANG is empirically validated in terms of soundness of the approach, its repeatability and generalizability.

中文翻译:

发现数据质量问题

现有的识别数据质量问题的方法通常以用户为中心,首先按照完善的设计指南、组织结构和数据治理框架以自上而下的方式确定数据质量要求。然而,在当前的数据环境中,用户经常面临新的、未开发的数据集,他们可能没有任何所有权,但被认为具有相关性和潜力,可以为他们创造价值。这种重新利用的数据集可以在政府开放数据门户、数据市场和几个公开可用的数据存储库中找到。在这种情况下,应用自上而下的数据质量检查方法是不可行的,因为数据的消费者无法控制其创建和治理。因此,数据消费者——数据科学家和分析师——需要具备数据探索能力,使他们能够调查和了解此类数据集的质量,以促进对其使用做出明智的决策。本研究旨在开发一种使用通用探索性方法发现数据质量问题的方法,该方法可有效应用于数据创建和使用分离的环境中。该方法名为 LANG,是在符号学理论和数据质量维度的基础上通过设计科学方法开发的。LANG 在方法的合理性、可重复性和普遍性方面得到了经验验证。本研究旨在开发一种使用通用探索性方法发现数据质量问题的方法,该方法可有效应用于数据创建和使用分离的环境中。该方法名为 LANG,是在符号学理论和数据质量维度的基础上通过设计科学方法开发的。LANG 在方法的合理性、可重复性和普遍性方面得到了经验验证。本研究旨在开发一种使用通用探索性方法发现数据质量问题的方法,该方法可有效应用于数据创建和使用分离的环境中。该方法名为 LANG,是在符号学理论和数据质量维度的基础上通过设计科学方法开发的。LANG 在方法的合理性、可重复性和普遍性方面得到了经验验证。
更新日期:2019-07-22
down
wechat
bug