Dissertation > Excellent graduate degree dissertation topics show

Research on Vertical Search Engine and Key Techniques

Author: XuHouJin
Tutor: DengChengYu
School: Yanshan University
Course: Computer System Architecture
Keywords: Vertical Search Engine Framework Topic crawling Text clustering Net Spider
CLC: TP391.3
Type: Master's thesis
Year: 2010
Downloads: 164
Quote: 2
Read: Download Dissertation

Abstract


With the rapid development of the Internet, the Web has become a service network providing mass information, which includes all kinds of information resources and sites distributed all over the world. The Search Engine is a kind of search tools helping Web users to look up information what they need. Some normal Search Engines test to index all the pages of the Web for providing various services for users. But with the diverse development of information, the normal Search Engine can’t fill with the need of professional user. Users need some searching technique and method for acquiring related topic resources. Vertical Search Engine is produced by the pushing of the requirement.In this paper, according to the difference between Normal Search Engine and Vertical Search Engine firstly, combining the specialized,refined and deep feature of Vertical Search Engine at the same time, and then introducing module of judging topic, module of extracting information and module of clustering to Vertical Search Engine framework which is proposed.Bases on the professional crawling algorithm which is core of net spider of Vertical Search Engine, the paper research Best-First algorithm extensively and deeply based on PageRank. First, the problem is that PageRank algorithm calculates page score with the hyperlinks between pages, the more score of page, the more important of page, which goes against searching topic information, an improved PageRank is proposed calculating hyperlink similarity of page. Second, considering from a single Web page, then using url, title, text of every page, the similarity based page content is proposed. Finally, a BLCT topic crawling algorithm is proposed combining content similarity and improved PageRank algorithm, and carrying out a corresponding experiment.Finally, the text clustering technique was researched deeply, through clustering of the searching results can reduce the number of results what users need to look up, leading into the time required for querying reduced. The problem is that k-means is the most popular clustering algorithm with the convergence to one of numerous local minima, which resulting in the results of clustering is sensitive for initial clustering center, an improved centroid-based text clustering algorithm is proposed and carrying out a corresponding experiment with initial center selected by special strategy.

Related Dissertations

  1. Research and Implementation of Mining Implicit User Interest,TP311.13
  2. Study on Current Situation and Constructive Suggestions of Establishment of Our Service-Oriented Government,D630
  3. Research and Application on Field Framework Extention Methods Based on OSGi,TP311.5
  4. Dogs training management system based on WEB,TP311.52
  5. Incomplete information on the completeness of the system and its knowledge acquisition,TP311.13
  6. Evolutionary Clustering Algorithm and Its Application,TP311.13
  7. Node-based intelligent interaction IOT Data Processing,TP391.44
  8. The Research of Streaming Media Technology in the System of Tibetan/Chinese Remote Education,TN919.8
  9. The Research on Transformation from PIM to PSM for Seam,TP311.52
  10. The Design and Implementation of the Office Information System of Shangdong University,TP311.52
  11. A Novel Labels and Similarity Reconstruction Based on K-means Algorithm Application on Text Clustering,TP181
  12. The Design and Realization of Little International Settlement System,TP311.52
  13. Research on the Enterprise Internal Control in the ERP Implementation and Application Process,F270.7
  14. Study on Safety Education Management Information System Based on Struts2,TP311.52
  15. Research and Implementation of Vertical Search Engine Key Technology,TP311.52
  16. The Research and Design of Monitoring System for BBS,G206
  17. Mobile Internet environment Wireless Vertical Search Engine Research and Implementation,TP391.3
  18. A Design of a Prepaid Card with Production and Sales Information Management System,TP311.52
  19. Design and Implementation of Web System Security Module Based on Spring Security,TP393.08
  20. SAFFRON based automated testing framework for QTP research,TP311.52
  21. Foreign mainstream media reported that the Shanghai World Expo Comparative Study Framework,G206

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Retrieval machine
© 2012 www.DissertationTopic.Net  Mobile