Dissertation > Excellent graduate degree dissertation topics show

The Research and Implementation of Chinese Text Classification System

Author: WangXinLi
Tutor: HeZuoLian
School: Tianjin University
Course: Applied Computer Technology
Keywords: text classification Chinese segmentation feature weight feature selection
CLC: TP391.1
Type: Master's thesis
Year: 2007
Downloads: 185
Quote: 7
Read: Download Dissertation

Abstract


With the development of information technology, the amount of texts increases explosively. How to find the required information from massive information quickly and correctly, become an important problem in the information processing field. Text classification, the automated assigning of natural language texts to predefined categories based on their contents, is a path to solving the problem above.The key technique of Chinese text classification, including Chinese segmentation, feature selection, feature weight and classification methods is discussed. The widely used feature selection methods, such as mutual information, information gain, chi-statistic and so on, are based on different rules, they may score the same feature very differently. In order to overcome the shortage of single method, this paper considers the combinations of two or more feature selection methods. Experiment results show that the combination of two methods is better than that of single method and the combination of three or more methods. Also,the combination of feature selection methods, which perform well are all based on chi-statistic. The traditional feature weight methods (such as TF-IDF, the weight based on entropy) just consider the importance of features on the whole text collection. They can not reflect the importance differences of one feature in different text categories. Against this problem, this paper presents an improved method, which uses the mutual information to reflect the correlation between features and text categories. Then, this paper realizes the Rocchio and KNN classification methods, and the experimental results show that the modified weight method can actually improve the classification performance.

Related Dissertations

  1. Research on Text Classification Based on Biomimetic Pattern Recongnition,TP391.1
  2. Tourism Comments on the Internet’s Semantic Analysis and Usefulness Research,TP391.1
  3. Feature Extraction, Selection and Combination in Lipreading,TP391.41
  4. Text Categorization Based on Rough Set Theory,TP18
  5. Rule-based and statistical study of Chinese Automatic Segmentation,TP391.1
  6. Research and Implementation of Data Cleaning Key Technology Oriented Web Text,TP391.1
  7. Study on an Improved Chinese Segmentation Algorithm and Its Application in Lucene,TP391.1
  8. The Research and Implementation of Web Page Classification in Enterprise Search Engine,TP393.092
  9. Design and Implementation of the Intelligent Mail-head Analysis Mechanisms Based on LDAP,TP393.098
  10. Information Geometry Based Pure High-order Interaction Model and Its Applications,TP391.1
  11. ICBC editing system research and product innovation to achieve,TP391.1
  12. The Research of Tibetan Text Categorization Base on N-Gram Information,TP391.1
  13. Research on Network Traffic Classification Based on Bayes Theory,TP393.06
  14. An Unsupervised Feature Selection Method Based on the Degree of Feature Cooperation,TP18
  15. Engine mechanical fault diagnosis system, feature extraction algorithm,TK407
  16. Feature Selection Based on Frequency of Mutual Information and Its Application to SNP Association Study,Q987
  17. Study on Chinese Text Classification Combined with Ontology,TP391.1
  18. The Study and Implementation of Topic Search and Web Mining,TP391.3
  19. Research of Web Text Classification Based on Decision Tree Classification Algorithm,TP391.1
  20. Theory Analysis and Application Research of Intelligent Search Engine,TP391.3
  21. Automatic distribution of software defects,TP311.52

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile