Academic
Publications
Efficient Text Classification Using Term Projection
Efficient Text Classification Using Term Projection  
BibTex | RIS | RefWorks Download
In this paper, we propose an efficient text classification method using term projection. Firstly, we use a modified χ2 statistic to project terms into predefined categories, which is more efficient compared to other clustering methods. Afterwards, we utilize the generated clusters as features to represent the documents. The classification is then performed in a rule-based manner or via SVM. Experiment results show that our modified χ2 statistic feature selection method outperforms traditional χ2 statistic especially at lower dimensionalities. And our method is also more efficient than Latent Semantic Analysis (LSA) on homogeneous dataset. Meanwhile, we can reduce the feature dimensionality by three orders of magnitude to save training and testing cost, and maintain comparable accuracy. Moreover, we could use a small training set to gain an approximately 4.3% improvement on heterogeneous dataset as compared to traditional method, which indicates that our method has better generalization capability.
Conference: Asia Information Retrieval Symposium - AIRS , pp. 230-241, 2009
Cumulative Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.