IngentaConnect A Multilingual Text Mining Approach Based on Self-Organizing Maps

Abstract:

This paper describes our work on developing a language-independent technique for discovery of implicit knowledge from multilingual information sources. Text mining has been gaining popularity in the knowledge discovery field, particularity with the increasing availability of digital documents in various languages from all around the world. However, currently most text mining tools mainly focus only on processing monolingual documents (particularly English documents): little attention has been paid to apply the techniques to handle the documents in Asian languages, and further extend the mining algorithms to support the aspects of multilingual information sources. In this work, we attempt to develop a language-neutral method to tackle the linguistics difficulties in the text mining process. Using a variation of automatic clustering techniques, which apply a neural net approach, namely the Self-Organizing Maps (SOM), we have conducted several experiments to uncover associated documents based on a Chinese corpus, Chinese-English bilingual parallel corpora, and a hybrid Chinese-English corpus. The experiments show some interesting results and a couple of potential paths for future work in the field of multilingual information discovery. Besides, this work is expected to act as a starting point for exploring the impacts on linguistics issues with the machine-learning approach to mining sensible linguistics elements from multilingual text collections.

Keywords: multilingual text mining; self-organizing maps; knowledge extraction; web mining; information retrieval

Language: English

Document Type: Research article

Affiliations: 1: Department of Electrical Engineering, National Kaohsiung University of Applied Sciences, Kaohsiung, Taiwan. leechung@mail.ee.kaus.edu.tw 2: Department of Electrical Engineering, National Kaohsiung University of Applied Sciences, Kaohsiung, Taiwan. hcyang@mail.cju.edu.tw

The full text electronic article is available for purchase. You will be able to download the full text electronic article after payment.

$47.00 plus tax Refund Policy