Semantic of data dependencies to improve the data quality

Houda Zaidi, Yann Pollet, Faouzi Boufarès, Naoufel Kraiem

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Data quality in databases is a critical challenge because the cost of anomalies may be very high, especially for large databases. Therefore, the correction of these anomalies represents an issue that has become more and more important both in enterprises and in academia. In this work, we address the problems of intra-column and inter-columns anomalies in big data. We propose a new approach for data cleaning that takes into account the semantic dependencies between the columns of a data source. The novelty of our proposal is the reduction of the size of the search space in the process of functional dependency discovery based on data semantics. In this paper, we present the first steps of our work. They allow recognizing the semantics of data and correct intra-column anomalies.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
PublisherSpringer Verlag
Pages53-61
Number of pages9
Volume9344
ISBN (Print)9783319237800
DOIs
Publication statusPublished - 2015
Event5th International Conference on Model and Data Engineering, MEDI 2015 - Rhodes, Greece
Duration: Sep 26 2015Sep 28 2015

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9344
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other5th International Conference on Model and Data Engineering, MEDI 2015
CountryGreece
CityRhodes
Period9/26/159/28/15

    Fingerprint

Keywords

  • Big data
  • Data cleaning
  • Data quality
  • Data structure
  • Functional dependencies
  • Semantic dependencies

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Zaidi, H., Pollet, Y., Boufarès, F., & Kraiem, N. (2015). Semantic of data dependencies to improve the data quality. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 9344, pp. 53-61). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9344). Springer Verlag. https://doi.org/10.1007/978-3-319-23781-7_5