Answers are grounded in this paper and cite their sources.
Fundamental to data cleaning is the need to account for multiple data representations. We propose a formal framework that can be used to reason about and manipulate data representations. The framework is declarative and combines elements of a generative grammar with database querying. It also incorporates actions in the spirit of programming language compilers. This framework has multiple applications such as parsing and data normalization. Data normalization is interesting in its own right in preparing data for analysis as well as in pre-processing data for further cleansing. We empirically study the utility of the framework over several real-world data cleaning scenarios and find that with the right normalization, often the need for further cleansing is minimized.
No takes yet. Share an insight, caveat, or question.
Arasu et al. (2009) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: