Academic
Publications
Research on the Construction and Filter Method of Stop-word List in Text Preprocessing

Research on the Construction and Filter Method of Stop-word List in Text Preprocessing,10.1109/ICICTA.2011.64,Zhou Yao,Cao Ze-wen

Research on the Construction and Filter Method of Stop-word List in Text Preprocessing   (Citations: 1)
BibTex | RIS | RefWorks Download
In the text preprocessing of text mining, a stop- word list is constructed to filter the segment results of the text documents so that the dimensionality of the text feature space can be cut down primarily. This paper summarized the definition, extraction principles and method of stop-word, and constructed a customizing Chinese-English stop-word list with the classical stop-word list based on the difference of text documents' domain. Three different filter algorithms were designed and implemented in the process of the stop-word filter and their efficiency was compared emphatically. The experiment indicated that the hash-filter method was the fastest. � Key word: text mining; text preprocessing; stop-word list; stop- word filter; hash algorithm
Cumulative Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.
Sort by: