Manioc : Portail | resultats 1 - 1 pour la recherche: Presses Universitaires de Louvain (distribution I6DOC/CIACO)

1 document satisfait la requête. Vérifiez les termes recherchés ou relancez la recherche sur le texte intégral

Analyse spectrale des textes: détection automatique des frontières de langue et de discours
Auteur(s) : Vaillant, Pascal Nock, Richard Henry, Claudia
Auteurs secondaires : Groupe de Recherche en Informatique et Mathématiques Appliquées Antilles-Guyane (GRIMAAG) ; Université des Antilles et de la Guyane (UAG) Centre de Recherche en Economie, Gestion, Modélisation et Informatique Appliquée (CEREGMIA) ; Université des Antilles et de la Guyane (UAG) ACI Jeunes Chercheurs JC 9009, 2003-2006 (Ministère de l'Enseignement Supérieur et de la Recherche, Fonds National pour la Science) : « Nouveaux paradigmes de classification : aspects théoriques et application à l'acquisition de connaissances » (Richard Nock, Pascal Vaillant) Piet Mertens, Cédrick Fairon, Anne Dister et Patrick Watrin

Éditeur(s) : HAL CCSD Presses Universitaires de Louvain (distribution I6DOC/CIACO)
Résumé : In French. 10 pages, 5 figures, LaTeX 2e using EPSF and custom package taln2006.sty (designed by Pierre Zweigenbaum, ATALA). Proceedings of the 13th annual French-speaking conference on Natural Language Processing: `Traitement Automatique des Langues Naturelles' (TALN 2006), Louvain (Leuven), Belgium, 10-13 April 2003
National audience
We propose a theoretical framework within which information on the vocabulary of a given corpus can be inferred on the basis of statistical information gathered on that corpus. Inferences can be made on the categories of the words in the vocabulary, and on their syntactical properties within particular languages. Based on the same statistical data, it is possible to build matrices of syntagmatic similarity (bigram transition matrices) or paradigmatic similarity (probability for any pair of words to share common contexts). When clustered with respect to their syntagmatic similarity, words tend to group into sublanguage vocabularies, and when clustered with respect to their paradigmatic similarity, into syntactic or semantic classes. Experiments have explored the first of these two possibilities. Their results are interpreted in the frame of a Markov chain modelling of the corpus' generative processe(s): we show that the results of a spectral analysis of the transition matrix can be interpreted as probability distributions of words within clusters. This method yields a soft clustering of the vocabulary into sublanguages which contribute to the generation of heterogeneous corpora. As an application, we show how multilingual texts can be visually segmented into linguistically homogeneous segments. Our method is specifically useful in the case of related languages which happened to be mixed in corpora.
Verbum ex machina : Actes de la 13ème conférence annuelle sur le Traitement Automatique des Langues Naturelles
Louvain (Leuven), Belgium

hal-00327607
https://hal.archives-ouvertes.fr/hal-00327607
ARXIV : 0810.1212

| Plus