Dissertation > Excellent graduate degree dissertation topics show

Reptiles theme for Education News Design and Implementation

Author: LuZhen
Tutor: LiuWei
School: Huazhong University of Science and Technology
Course: Communication and Information System
Keywords: Reptile theme Information Extraction Theme relevance Hyperlinks extraction
CLC: TP391.3
Type: Master's thesis
Year: 2011
Downloads: 98
Quote: 0
Read: Download Dissertation

Abstract


With a worldwide network of rapid development of the Internet as the most promising and dynamic emerging media has been recognized following the newspapers, radio, television after the \In order to keep abreast of the network news hot , especially with the theme of education -related hot news and developments , the introduction of the field of education related organizations dedicated hot news analysis system. This design and implementation of network news hot topic crawler system is a data analysis system source responsible for the field of education news and information gathering . The traditional search engine Web crawler to services, but can not meet the application requirements specified topic , theme crawler is selectively crawling pages related to the topic . This article studies the characteristics of reptiles theme , workflow and architecture , we propose a system -oriented education news reptiles overall architecture design, and based on the design of the various modules of the system reptiles . With the help of reptiles related to the field of technology and tools , combined with the hot news analysis system needs, from principle or workflow crawler system are discussed in detail on the core module implementation. Thesis work includes: First, focus on the main site for the problem, we designed a model based on the weight crawling strategies . Secondly, in order to improve the efficiency of extraction hyperlinks , this article took XPath-based hyperlinks accurate extraction strategies . Finally, crawling reptiles repeat the question , this article is designed based on the Berkeley DB crawling strategies to avoid duplication . Based on the results of the analysis system is running reptiles that reptiles system can operate stably , hot news analysis system continues to provide data . Reptile system meets the design requirements , and achieved satisfactory results, the paper XPath-based hyperlinks extraction strategies and avoid duplication based on the Berkeley DB theme reptiles crawling strategies for the realization of a practical reference.

Related Dissertations

  1. Research on Domain Entity Attribute and Event Extraction Technology,TP391.1
  2. Research on Temporal Information Recognition and Normalization,TP391.1
  3. Study on Growth Monitoring Technique Based on Pixel Un-Mixing Method and HJ Remote Sensing Images in Paddy Rice,S511
  4. Land Desertification in Qinghai Lake Landscape Pattern Change,X171
  5. Active faults based radar image information extraction method applied research and demonstration,P542.3
  6. Based on high-resolution remote sensing data mining houses information extraction,TP751
  7. Web Page Attribute Extraction Method Research,TP391.1
  8. Research and Implement of the Theme Crawler for Automotive Industry,TP391.3
  9. The Research for Named Entity Recognition and Relation Extraction in Text,TP391.1
  10. The key component vertical search engine technology research,TP391.3
  11. Home Academic Information Extraction System,TP393.092
  12. Engineering News reported information extraction and applied research,G212
  13. Topic search engine key technology research,TP391.3
  14. Hull section robotic welding path planning and offline programming,TP242
  15. Based on semi- structured text transporter protein substrate information extraction system,Q811.4
  16. Dynamic learning framework based on structured automatic web data extraction method,TP393.092
  17. Web-oriented Chinese automatic summarization research generated,TP391.1
  18. Printers based on natural language HCI Research and implementation,TP11
  19. Multi-language support program comprehension understanding and information extraction technology research,TP311.52
  20. Based on multi-feature classification comparison Urban Remote Sensing Dynamic Monitoring,TP873
  21. Research on Data Acquisition and Topic Analysis of Online Public Opinion,TP393.09

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Retrieval machine
© 2012 www.DissertationTopic.Net  Mobile