Dissertation > Excellent graduate degree dissertation topics show

Inverted Index Based Micro-blog Topic Detection

Author: LiuHongYu
Tutor: ChenQingCai
School: Harbin Institute of Technology
Course: Computer technology
Keywords: topic detection and tracking inverted-index AP algorithm dynamicwindow
CLC: TP393.092
Type: Master's thesis
Year: 2013
Downloads: 19
Quote: 0
Read: Download Dissertation

Abstract


With the rapid development of micro-blog, an emerging social network, moreand more users use it and post news. There is a great demand in detecting hotevents in micro-blog data, because of the fast propagation of micro-blog and greatsignificance of news spread. However there is huge challenge in topic detectionand tracking because of the large-scale, much noise and shorter text of micro-blogdata.After analysis the shortcomings of the traditional topic detection and trackingalgorithm, this paper proposed an inverted index based method to increase theprocessing of the algorithm, but have no harm to the accuracy of the algorithm.Some artificial rules are established to remove the noise after analysis themicro-blog data. Topic detection and tracking algorithm is processed after invertedindex is build. When get the new events, sort the events based on the entropy ofthe event and number of user. The top20events of the list are merged with the oldevents. The old events are collected based on the aging theory. This paper alsoanalysis the result of AP cluster algorithm on micro-blog data.In order to verify the efficiency increasing of the algorithm, the processingtime of inverted index based algorithm and traditional SINGLE-PASS algorithmare compared on several different scale data set. The inverted index algorithm is6times faster than the SINGLE-PASS algorithm. A test set was build by artificiallabel because of no standard corpus. The test set include26events, total of2817documents. The algorithm shows to get a better result after analysis the experimentresults. The effective of different weight compute method is also compared. Andthe disadvantages and advantages of AP clustering algorithm and SINGLE-PASSalgorithm is compared.Because of the large scale of micro-blog data, some event get by thealgorithm is not interested. After sort the event by using the entropy and thenumber of user, the event which users interested in can be put in the front.A micro-blog topic detection and tracking system was design andimplemented by using the algorithm proposed before.

Related Dissertations

  1. Research on Topic Detection and Tracking Based on Probability Topic Model,TP391.1
  2. Internet News Hot Mining System Research and Implementation,TP393.09
  3. Research on Vertical Search Engine on Mobile Platform,TP391.3
  4. A Novel Feature Clustering based Algorithm for Detecing Network motifs,TP391.41
  5. Encyclopedia of Chinese knowledge -based search systems design and implementation,TP391.3
  6. Research and Implementation on Key Techniques of Online Public Opinion Analysis,TP393.09
  7. Research and Implementation on Personalized Search Technique Based on Semantic Annotation,TP391.3
  8. Research on Constructivism Remote Education Based on Web Mining,TP391.6
  9. Text Clustering Method in Topic Detection and Person Name Disambiguation,TP391.1
  10. Research and Implementation of Desktop Search Engine Based on Android,TP391.3
  11. The Research on Topic Search Technology Based on Topic Detection and Tracking,TP391.3
  12. Content-Based Fast Audio Retrieval,TP391.3
  13. Based on the topic of Internet data detection and tracking technology Research and Implementation,TP391.3
  14. A Landmark Compact Routing Scheme Based on Affinity Propagation Algorithm,TP393.02
  15. Website Crawler and Retrieval System Based on Lucene,TP393.092
  16. The Research and Implementation on Secure Index Technology Based on Full-text Searching System,TP391.3
  17. Study on Topic Detection and Tracking on Food Security,TS201.6
  18. Research on Syllable Lattice Based Chinese Spoken Document Retrieval Method,TP391.3
  19. On Text Classification and Its Applications,TP391.1
  20. Topic Detection and Tracking Research Based on Semantic Structures and Temporal Features,TP391.1
  21. Data Index Technology Research Based on Parallel Computing Platform,TP391.3

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Computer network > General issues > The application of computer network > Web browser
© 2012 www.DissertationTopic.Net  Mobile