Dissertation > Excellent graduate degree dissertation topics show

The Technology and Application on Web Information Extraction Based on Analyzing Webpage Content

Author: YangXiuLi
Tutor: GaoKai;BanLiXin
School: Hebei University of Science and Technology
Course: Computer technology
Keywords: Search Engine Web Spider Information extraction Information Analysis Multithreading
CLC: TP393.09
Type: Master's thesis
Year: 2010
Downloads: 171
Quote: 1
Read: Download Dissertation

Abstract


With the development of computer networks and the advent of the information society, search engines are playing an increasingly important role. The general search engine is well-known as easy to use, fast and containing vast information, but when it is used in retrieving specific information or to be faced in the application of specific area, the information obtained is often not very accurately and exclusively. Therefore, to develop a specific search engine has great practical value as well as practical significance. In the development of a specialized search engine, design and implementation of Web Spider for Web pages acquirement have considerable influence on the overall performance of the search engine.Since 1999, recruitment of students in our country has been expanding these years, which gives the student education and employment many pressures. Therefore, it is so important to apply scientific method to administrate education and employment information, more important, it can also give some assistant instructions for university recruitment and cultivation. Based on the above demands, this thesis designs and implements a web spider to a specialized search engine for some graduate employment information and education information. During the process of web capturing, it can finish the web content analysis based on a certain formula, pick up and analyze the relating information , filter the information which is not about the subject and store the information in the web pages’database,and then complete the data preparation of the search engine and build foundation for the following job. In detail, this thesis has discussed the process of the web spider implementation, and has provided a system structure. Furthermore, on the basis of using the algorithm, this paper has analyzed the related functions of this spider by comparing with other web spiders. This algorithm can extract information from related webpage more exactly. In the end, some drawbacks and the further works have also been present in the end.

Related Dissertations

  1. Research on Domain Entity Attribute and Event Extraction Technology,TP391.1
  2. Research on Temporal Information Recognition and Normalization,TP391.1
  3. Implementation and Research of Illegal Websites Detection System Based on Comparison Methods,TP393.08
  4. Study on Growth Monitoring Technique Based on Pixel Un-Mixing Method and HJ Remote Sensing Images in Paddy Rice,S511
  5. Web search engine related technology research,G354
  6. Land Desertification in Qinghai Lake Landscape Pattern Change,X171
  7. Active faults based radar image information extraction method applied research and demonstration,P542.3
  8. Based on high-resolution remote sensing data mining houses information extraction,TP751
  9. Research of Intelligent Search Engine Based on Semantic Web,TP391.3
  10. Search Engine Provider Copyright Infringement Liability Standard Discussion,D923.41
  11. The Study of Topic-Oriented IT News with Search Enging and Web Page Analysing,TP393.092
  12. Web Page Attribute Extraction Method Research,TP391.1
  13. The Research for Named Entity Recognition and Relation Extraction in Text,TP391.1
  14. The Design and Implementation of C/S-Based Vehicle Remote Monitoring System,TP277
  15. Dynamic analysis based on multi-core acceleration method,TP332
  16. Distributed search engine indexing and caching Security Strategy,TP333
  17. Based WebHarvest the Chinese financial news search engine design and implementation,TP311.52
  18. Image processor based on multi -threaded test systems research,TP391.41
  19. Cloud backup pair of fingerprint verification technology with multithreading transfer,TP309.3
  20. The key component vertical search engine technology research,TP391.3
  21. Reptiles theme for Education News Design and Implementation,TP391.3

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Computer network > General issues > The application of computer network
© 2012 www.DissertationTopic.Net  Mobile