Dissertation > Excellent graduate degree dissertation topics show

Research on Content-Based Chinese Junk Short Messages Classification Technology

Author: WangHong
Tutor: ZhangYanPing
School: Anhui University
Course: Applied Computer Technology
Keywords: Junk Short Message Text Classification Bayesian Classifiers Feature Selection
CLC: TP391.1
Type: Master's thesis
Year: 2011
Downloads: 70
Quote: 0
Read: Download Dissertation

Abstract


With the rapid development of mobile communication technology and the rapid increase in mobile penetration, with the features of simple usage, fast delivery and low-cost SMS became an integral way of communication in our daily life. However, low-cost transmission makes us receive a lot of junk short message every day. These junk short messages are harmful to the social security and poison social atmosphere. What is more, it influences users’ normal life. The current junk short message filtering technology includes black and white list technology, filtering rules and based on keyword matching filter etc.In order to solve the problems caused by junk short messages, the article firstly gives a detailed introduction and analysis on features, causes, damages and the current status of junk short message in our country, at the same time the article summarizes the current status of message classification techniques. Secondly, the article introduces 3 methods for dividing Chinese words,4 kinds of text representation,7 kinds of feature selection method,4 kinds of feature weight assignment method and 7 kinds text classification algorithm. Finally the article uses an improved Bayesian classification combining black and white list filtering mechanism to filter messages. The Message classification model includes message preprocessing, feature selection, weighting calculation, classifier training and message testing. It receives a good classification result, what is more, by using new training dataset, it can train personalized classifier to adapt the changes of short message and meet user’s needs. The experimental results prove that the improved Bayesian classifier can reduce the error rate of normal SMS. In detail, this article contains the following main elements:1) Introduced several feature selection methods and making a comparison between their advantages and disadvantages in the classification model;2) For the current Chinese text corpus lack of publicity and standard, I collect and establish a standardized and what can meet the experimental requirements Chinese text corpus;3) On the basis of the short message text corpus I achieved an improved Bayesian classification model to increase the through rate of normal SMS. Then I analyzed and compared the model’s performance and effect; 4) Classification model can produce personalized classifier to adapt the change of messages, what it can meet the needs of users;5) According to the evaluation standards of Text Classification I evaluated the Bayesian classifier from experiment. Then according to the evaluation, I set the basic parameters of the classifier model;6) This article summarizes the the results, outlooks the further works, for the future work to lay a foundation.

Related Dissertations

  1. Research on Text Classification Based on Biomimetic Pattern Recongnition,TP391.1
  2. Tourism Comments on the Internet’s Semantic Analysis and Usefulness Research,TP391.1
  3. Feature Extraction, Selection and Combination in Lipreading,TP391.41
  4. Based on Data Distribution Characteristics of Text Classification,TP391.1
  5. Research on Ontology-based Scientific Papers of Chinese Classification,TP391.1
  6. Chinese Keyword Extraction Method Based on Word Span and Its Application in Text Classification,TP391.1
  7. Research on Improved K Neighbor Support Vector Machine Algorithm Faced Text Classification,TP391.1
  8. The Research on Cllective Multi-Label Classification,TP391.1
  9. Research on Feature Extraction, Selection and Classification Algorithms for Pulmonary CAD,TP391.41
  10. Text classification based on Bayesian filtering technology research and implementation,TP393.098
  11. Research for Event Extraction Method in Specific Domain Based on Tree Conditional Random Field,TP391.1
  12. The Research of Text Classification Based on Hadoop,TP391.1
  13. Term Weight-Based Chinese Text Classification Algorithm,TP391.1
  14. Research and Implementation of Feature Selection in Chinese Text Classification,TP391.1
  15. Research on Feature Selection for Gene Expression Data,Q78
  16. Spam Filtering System Study Based on Non-negative Matrix Factorization,TP393.098
  17. Study on Graduation Thesis Pre-Inspection Management System,G311
  18. Text based on SVM multi-class classification,TP391.1
  19. Design and Implementation of the Intelligent Mail-head Analysis Mechanisms Based on LDAP,TP393.098
  20. Application Research of Genetic Algorithm in Supporting Marketing of Forestry Enterprise,TP18
  21. Information Geometry Based Pure High-order Interaction Model and Its Applications,TP391.1

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile