Dissertation > Excellent graduate degree dissertation topics show

Acquisition focused crawling the web - based information technology research

Author: JiangBo
Tutor: SuZhiTongï¼›ChenYan
School: North China University of
Course: Computer technology
Keywords: Vertical search engine Focused Crawler Theme Relevance tunnel TPR
CLC: TP274.2
Type: Master's thesis
Year: 2011
Downloads: 95
Quote: 0
Read: Download Dissertation

Abstract


With the rapid development of the Internet and the WWW (World Wide Web) , the exponential growth in Web information presented to the user to find the information you need in this vast repository of information and more powerless . For such a problem, in the field of Web information retrieval appears focused crawling for a topic . Focused crawling is the foundation and core of the topic search , and with the gradual deepening of development and technology application , the gradual application of a variety of practical personalized information collection , the effectiveness of link analysis , website structure analysis , users browse Interest Mining and study. Based the theme focused crawling Web Crawler research with a wide range of practical significance . Study the basic principles of the system and network search engine crawlers , workflow , and focuses on the characteristics of the focused crawling , page thematic analysis , search strategy algorithm based on the link structure and content . Theme determination in the implementation of the key technologies of the pages have been collected to extract the characteristics of the theme topics related to the degree of the algorithm to calculate the page is determined by the relevance of the subject of the page based on the vector space model to improve the accuracy of the theme information collection ; treat crawl URL theme prediction , the theme page distribution characteristics and extended metadata URL of topics related degrees , consider a the theme pages tunnel characteristics , improve the the theme information collection recall rate ; introduction of the link structure analysis algorithm PageRank proposed integrated relevant and important degree the URL value method TPR ( Topical PageRank) . Finally, the experiment to test the technical indicators , the information collected to verify the effectiveness of the technology improvements .

Related Dissertations

  1. Research on Focused Crawler Based on SVM Classification Algorithm,TP391.3
  2. The Change of Electromyography Before and after Ulnar Nerve Release,R688
  3. Studies on the Techniques of Multi-season Cultivation for Nanling Mushroom,S646.11
  4. Method Research of the E-learning Resources Collecting and Automatic Classification Based on Focused Crawling Technique,TP301.6
  5. Study on the Reasonable Cover Thickness of Subsea Tunnel,U459.5
  6. The Structure Design and Toplogical Optimal Analysis for the Key Components of Tunnel Type Washer,TM925.33
  7. The Surrounding Rock Monitoring and Finite Element Simulation of Subway Tunnel,U455.43
  8. The Study of Stability and Deformation for Cao Mao Mountain Tunnel,U451.2
  9. Research on Risk Management of Tunnels in Karst Area,U455.1
  10. Prediction on Ground Settlements Due to Metro Tunnels Construction,U456.31
  11. Design and Implementation of the Software for Safety Monitoring and Controlling System Construction in Tunnel Based on Wireless Sensor Networks,TP212.9;TN929.5
  12. Design and Implementation of IPv6 Tunnel Based on ThreadX Operating System,TP393.04
  13. Reptiles theme for Education News Design and Implementation,TP391.3
  14. Internetwork accelerate technology research and implementation,TP393.2
  15. Subway tunnel construction of adjacent buildings security risks,U455.1
  16. Research on Trojan Horse Transmis Sion Technology Based on HTTPS and WEB SERVICE Shanghai Jiao Tong University,TP393.08
  17. The soft slate tunnel large deformation mechanical behavior and control technology,U451
  18. The the underwater tunnel curtain grouting with no studio bassoon shed construction technology research,U455.49
  19. Karst tunnel project , and karst Treatment Research,U455.49
  20. Lining the structure carrying capacity study tunnel fire,U451
  21. Bias characteristics of soft surrounding rock tunnel and Construction Control Technology,U455.4

CLC: > Industrial Technology > Automation technology,computer technology > Automation technology and equipment > Automation systems > Data processing, data processing system > Data collection and processing systems
© 2012 www.DissertationTopic.Net  Mobile