Comparative Analysis of Text Representation Methods Using Classification
PBN-AR
Instytucja
Wydział Elektroniki, Telekomunikacji i Informatyki (Politechnika Gdańska)
Informacje podstawowe
Główny język publikacji
ENG
Czasopismo
CYBERNETICS AND SYSTEMS
ISSN
0196-9722
EISSN
Wydawca
DOI
URL
Rok publikacji
2014
Numer zeszytu
2
Strony od-do
180-199
Numer tomu
45
Identyfikator DOI
Liczba arkuszy
Autorzy
(liczba autorów: 1)
Słowa kluczowe
DOCUMENTS CATEGORIZATION, INFORMATION RETRIEVAL, TEXT CLASSIFICATION, TEXT REPRESENTATION, WIKIPEDIA
Streszczenia
Język
Treść
In our work, we review and empirically evaluate five different raw methods of text representation that allow automatic processing of Wikipedia articles. The main contribution of the article—evaluation of approaches to text representation for machine learning tasks—indicates that the text representation is fundamental for achieving good categorization results. The analysis of the representation methods creates a baseline that cannot be compensated for even by sophisticated machine learning algorithms. It confirms the thesis that proper data representation is a prerequisite for achieving high-quality results of data analysis. Evaluation of the text representations was performed within the Wikipedia repository by examination of classification parameters observed during automatic reconstruction of human-made categories. For that purpose, we use a classifier based on a support vector machines method, extended with multilabel and multiclass functionalities. During classifier construction we observed parameters such as learning time, representation size, and classification quality that allow us to draw conclusions about text representations. For the experiments presented in the article, we use data sets created from Wikipedia dumps. We describe our software, called Matrix’u, which allows a user to build computational representations of Wikipedia articles. The software is the second contribution of our research, because it is a universal tool for converting Wikipedia from a human-readable form to a form that can be processed by a machine. Results generated using Matrix’u can be used in a wide range of applications that involve usage of Wikipedia data.
Inne
System-identifier
132262