IngentaConnect On Machine Learning Methods for Chinese Document Categorization

Authors: He J.¹; Tan A-H.²; Tan C-L.³

Source: Applied Intelligence, Volume 18, Number 3, May 2003 , pp. 311-322(12)

Publisher: Springer

Abstract:

This paper reports our comparative evaluation of three machine learning methods, namely k Nearest Neighbor (kNN), Support Vector Machines (SVM), and Adaptive Resonance Associative Map (ARAM) for Chinese document categorization. Based on two Chinese corpora, a series of controlled experiments evaluated their learning capabilities and efficiency in mining text classification knowledge. Benchmark experiments showed that their predictive performance were roughly comparable, especially on clean and well organized data sets. While kNN and ARAM yield better performances than SVM on small and clean data sets, SVM and ARAM significantly outperformed kNN on noisy data. Comparing efficiency, kNN was notably more costly in terms of time and memory than the other two methods. SVM is highly efficient in learning from well organized samples of moderate size, although on relatively large and noisy data the efficiency of SVM and ARAM are comparable.

Keywords: text categorization; machine learning; comparative experiments

Language: English

Document Type: Research article

Affiliations: 1: School of Computing, National University of Singapore, 10 Kent Ridge Crescent, Singapore 119260 heji@comp.nus.edu.sg 2: Nanyang Technological University, School of Computer Engineering, Blk N4, 2A-13 Nanyang Avenue, Singapore 639798. asahtan@ntu.edu.sg 3: School of Computing, National University of Singapore, 10 Kent Ridge Crescent, Singapore 119260. tancl@comp.nus.edu.sg

The full text electronic article is available for purchase. You will be able to download the full text electronic article after payment.

$47.00 plus tax