Skip to main content
Article thumbnail
Location of Repository

Quelques stratégies pour l’exploitation de gros corpus en analyse des données textuelles

By Saadi Lahlou and Helka Folch

Abstract

Our work carried out as part of the Scriptorium project has confronted us with a variety of problems that have to be faced by analysts engaging in text-mining as applied to large heterogeneous corpora (intranet, www, document-based DB). This paper presents several solutions concerning the following points : the extraction of relevant sub-sections of the corpus, meta-data, efficient storage, historisation. We introduce two original solutions : document storage based on collections of self-describing texts with embedded meta-data in the form of mark-up (instead of a DBMS or file-based approach : full text indexing at such a scale is heavy) ; use of an extractor based on the software product TOPIC to retrieve relevant paragraphs and assemble them into homogeneous sub-corpora of exploitable size (< 10 Mega). We shall also describe the strategies we have adopted for comparing different analyses of the corpus in a historical perspective, in particular the transformation of ALCESTE class profiles into TOPIC concepts aimed at providing fixed, quantifiable measurements of the density of certain topics in the texts. This paper was given at the 4èmes Journées Internationales d’Analyse des Donnés Textuelles. Nice, France, 18-21 février 1998. It was published in the proceedings volume and is freely available at http://www.cavi.univ-paris3.fr/lexicometrica/jadt/jadt1998/JADT1998.ht

Topics: BF Psychology, P Philology. Linguistics
Publisher: Université de Nice Sophia Antipolis
Year: 1998
OAI identifier: oai:eprints.lse.ac.uk:33005
Provided by: LSE Research Online

Suggested articles

Citations

  1. (1990). ALCESTE, une méthode d'analyse des données textuelles. Application au texte doi
  2. (1997). Bilan technique de la plate-forme SCRIPTORIUM - août
  3. (1996). La modélisation de représentations sociales à partir de l’analyse d’un corpus de définitions.
  4. (1995). Scriptorium : le projet.
  5. (1996). Test de fonctionnement de l'outil Scriptorium sur un petit corpus.
  6. (1997). Utilisation de Scriptorium pour l’analyse de discours syndicaux et directoriaux a EDF-GDF sur la période 1991-1995. HN-51/97/ 016.

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.