Skip to main content

New ways of specifying data edits

Buy Article:

$51.00 plus tax (Refund Policy)

Abstract:

Summary. 

┬áData editing is the process by which data that are collected in some way (a statistical survey for example) are examined for errors and corrected with the help of software. Edits, the logical conditions that should be satisfied by the data, are specified by subject-matter experts with a procedure which could be tedious and could lead to mistakes with practical implications. To render the process of edit specification more efficient we provide a new step—the definition of the so-called abstract data model of a survey—which describes the structure of the phenomenon that is studied in a survey. The existence of this model enables experts to identify all combinations of variables which should be checked by edits and to avoid the definition of conflicting edits. Furthermore, we introduce an automatic data validation strategy—TREEVAL—that consists of fast tree growing to derive automatically the functional form of edits and of a statistical criterion to clean the incoming data. The TREEVAL strategy is cast within a total quality management framework. The application of the methodologies proposed is demonstrated with the help of a real life application.

Keywords: Classification and regression trees; Data editing; Data quality; Fast partitioning algorithm; Object-oriented analysis; TREEVAL; Total quality management

Document Type: Research Article

DOI: https://doi.org/10.1046/j.1467-985X.2003.00745.x

Affiliations: 1: Panteion University and Agilis, Athens, Greece. 2: University of Cassino, Italy. 3: Agilis, Athens, Greece. 4: University of Cagliari, Italy. 5: University of Naples Federico II, Italy.

Publication date: 2004-05-01

  • Access Key
  • Free content
  • Partial Free content
  • New content
  • Open access content
  • Partial Open access content
  • Subscribed content
  • Partial Subscribed content
  • Free trial content
Cookie Policy
X
Cookie Policy
Ingenta Connect website makes use of cookies so as to keep track of data that you have filled in. I am Happy with this Find out more