The Role of Data Pre-Processing in Intelligent Data Analysis

Abstract

This paper first provides a brief overview of some frequently encountered real world problems in data analysis. These are problems that have to be solved through data pre-processing so that the nature of the data is better understood and the data analysis is performed more accurately and efficiently. The architecture of a data analysis tool for which a data pre-processing mechanism has been developed and tested is also explained. An example is then given of the use of this data pre-processing mechanism for two purposes: (i) to filter out a set of semiconductor data, and (ii) to find out more about the nature of these data and make the induction process more efficient.Cet article pr\ue9sente d'abord un bref aper\ue7u de quelques-uns des probl\ue8mes les plus courants de l'analyse des donn\ue9es. Il s'agit de probl\ue8mes qui doivent \ueatre r\ue9solus gr\ue2ce au pr\ue9traitement des donn\ue9es pour que la nature de ces donn\ue9es soit mieux comprise et que l'analyse soit effectu\ue9e de fa\ue7on plus efficace et plus exacte. On explique \ue9galement l'architecture d'un outil d'analyse de donn\ue9es pour lequel on a d\ue9velopp\ue9 et test\ue9 un m\ue9canisme de pr\ue9traitement. Un exemple illustre l'utilisation de ce m\ue9canisme \ue0 deux fins : (i) filtrer ou \ue9liminer par filtrage un ensemble de donn\ue9es de semi-conducteurs et (ii) mieux saisir la nature de ces donn\ue9es pour rendre le processus d'induction plus efficace.NRC publication: Ye