Dissertation > Excellent graduate degree dissertation topics show

Web information collection and information extraction technology research

Author: JinYueFu
Tutor: FanJianYing
School: Harbin University of Science and Technology
Course: Signal and Information Processing
Keywords: Web information collection Information Extraction Search Engine Distributed Systems
CLC: TP391.1
Type: Master's thesis
Year: 2009
Downloads: 415
Quote: 5
Read: Download Dissertation

Abstract


The rapid growth of Web information , to the effective use of information presented a huge challenge , how to quickly and accurately retrieve the required information from the Web has become a serious problem . In order to more fully and effectively using the Web this huge source of information , the paper launched a Web information collection and information extraction technology. This paper introduces the basic principles of Web information gathering . On this basis , for Web information gathering system made ??a detailed analysis of key technologies , including crawl pages , URL extraction and normalization , the original web pages stored and how to avoid repeat visits . Then from the starting point of the design of distributed systems , distributed Web information collection on parallelism , load balancing, and scalability of the architecture of these four aspects analyzed in detail , and to design and implement a distributed Web -based LAN information collection system . Finally , two experiments to demonstrate the performance of the system . Experimental results show that distributed Web information gathering system to achieve load balancing, and has good scalability. Second, this paper on the Web information collection technologies based on research , expand the Web information extraction technology. Taking into account the actual application requirements, design and implementation of an XPath-based Web information extraction system, which uses XPath expressions to locate data entry and organized into a tree model of the expression of information extraction as a general rule , and in order to increase versatility of the system , when implemented extraction rules and extraction system will be decoupled . Proven data extracted by the system with a high accuracy, suitable for small-scale information extraction . In addition , the thesis of structured information extraction process encountered a phone number identification ( numeric identifier ) problems were analyzed , using C and Matlab programming mix the way to solve them. The actual application shows that the content of this thesis research contribute to a more full and effective use of information resources on the Web to meet SMEs Web information collection and extraction needs, has practical value .

Related Dissertations

  1. Research on Domain Entity Attribute and Event Extraction Technology,TP391.1
  2. Research on Temporal Information Recognition and Normalization,TP391.1
  3. Study on Growth Monitoring Technique Based on Pixel Un-Mixing Method and HJ Remote Sensing Images in Paddy Rice,S511
  4. Land Desertification in Qinghai Lake Landscape Pattern Change,X171
  5. Active faults based radar image information extraction method applied research and demonstration,P542.3
  6. Based on high-resolution remote sensing data mining houses information extraction,TP751
  7. Web Page Attribute Extraction Method Research,TP391.1
  8. Research and Implementation of Key Techniques of Building Distributed System,TP338.8
  9. The Research for Named Entity Recognition and Relation Extraction in Text,TP391.1
  10. GPRS-based wireless monitoring system of information collection and Design,TN929.5
  11. Based WebHarvest the Chinese financial news search engine design and implementation,TP311.52
  12. A distributed simulation system for operational command Design and Implementation,TP311.52
  13. The key component vertical search engine technology research,TP391.3
  14. Home Academic Information Extraction System,TP393.092
  15. Topic search engine key technology research,TP391.3
  16. Based on Web Service Online Examination Management System Research and Implementation,TP311.52
  17. Mining distributed dynamic traffic information and navigation,TP311.13
  18. Dynamic learning framework based on structured automatic web data extraction method,TP393.092
  19. Distributed Image Management System Design and Implementation,TP311.52
  20. Distributed Microphone Array Tracking Algorithm,TN912.3
  21. Distributed Systems Performance Testing and Analysis Methods,TP311.52

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile