Dissertation > Excellent graduate degree dissertation topics show

Hot Blog Topic Mining Approach

Author: LiuXu
Tutor: ChenQingCai
School: Harbin Institute of Technology
Course: Computer Science and Technology
Keywords: Topic Ming Text Mining Text Cluster
CLC: TP393.092
Type: Master's thesis
Year: 2010
Downloads: 244
Quote: 0
Read: Download Dissertation

Abstract


With the rapid development of Internet, the data on Internet is growing explosively. How to obtain useful information from internet fast and accurately becomes a focus of people. Topic detection and tracking has been a hot research spot, it has broad application prospects such as monitoring public opinion. Our research goal is to mining domestic and international hot events through the blog in order to feedback to the user in real-time. Most traditional clustering algorithms can not solve the problems on topic mining well, so it is hard to apply. In this thesis, we propose a novel algorithm on hot event mining. It is similar withthe clustering algorithms based on partition methods, but the size of bucket is not set before, it is set by the title keyword. We cluster documents in every bucket to micro-cluster by single-pass algorithm, and merge the similar micro-cluster in different buckets by hierarchical clustering. We propose event templete, seed documents, time window, feature selection and modified similarity function to improve the performance of our algorithm.In our experiment, we construct three datasets. Dataset1 contains 13252 news pages with 28 events totally. Dataset2 contains 1589 blog pages with 40 events totally. Dataset3 is TDT4 corpos. Our algorithm gets 93.04% precision result and 91.73% recall result on Dataset1, and gets 92.18% precision result and 82.37% recall result on Dataset2. The cost is 0.48 in TDT4.This thesis revise and improve the system on hot blog events mining based on our proposed algorithm. It has run for 15 months approximately and detected thousands of hot events whose total related blog stories number is more than 226,373. We choose 648 events in random and tag artificially, the precision of the tagged reach to 83%,which provides a strong guarantee to detect the event automaticlly.

Related Dissertations

  1. G2C-oriented Cross-platform Web Text Mining Models and Methods Study,TP391.1
  2. Research on Sentiment Orientation Analysis of Blog Article Based on Blog Search,TP391.1
  3. The Study of Martial Intelligence Analysis System Based on Data Mining,TP319
  4. Research and Application of Web Text Classification,TP391.1
  5. Research on Web Text Data Mining,TP393.09
  6. An improved concept-based Chinese Text Clustering Algorithm WEB,TP18
  7. Research on Web Text Mining Based on XML and SVM,TP391.1
  8. Chinese text clustering algorithm based on suffix tree,TP391.1
  9. A Research of Text Mining-based Spam Filtering,TP393.098
  10. XML-based Web data mining technology research and implementation,TP393.092
  11. The Cluster Analysis on WEB Text Mining,TP311.13
  12. FOIL Web -based text classifier algorithm,TP393.09
  13. Study of Component Analysis Algorithm and the Application in the Feature Extraction from Web Text,TP391.1
  14. Web Text Mining Technology and Its Implementation,TP393.092
  15. De-duplication Technology Research and Implementation of Large-scale Short Texts Orient,TP391.1
  16. Non-negative matrix factorization and its application in Chinese Text Mining Applications,O212.4
  17. The Research about Knowledge Discovery in Digital Libraries,G250.76
  18. SVM- based XML and Web Text Mining,TP311.13
  19. Emotional Music Review Analysis and Intelligent Search Technology,TP391.3
  20. Fast Text Categorization Research,TP391.1

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Computer network > General issues > The application of computer network > Web browser
© 2012 www.DissertationTopic.Net  Mobile