Dissertation > Excellent graduate degree dissertation topics show

Design and Research of Network Spider

Author: ZhaoZuoLi
Tutor: ZhangYang; ShangZunYi
School: University of Electronic Science and Technology
Course: Software Engineering
Keywords: SPIDER Breadth First Search multi-threads Internet searchengine Network spider URL Captures
CLC: TP311.52
Type: Master's thesis
Year: 2013
Downloads: 40
Quote: 0
Read: Download Dissertation

Abstract


Network resources are very rich, but how to effectively search for information is adifficult thing. Create a search engine is the best way to solve this problem.Multi-threaded web crawler program is the first algorithm in accordance with thewidth from the specified Web page to parse, search, and to crawl each URL to search,save and new entrance on the Internet constantly crawling the URL is automaticallyRunthe daemon.Web crawler application socket socket, regular expression, the HTTP protocol,windows network programming and other related technology, the Web crawler is a runin the background to the configuration file as the initial URL, down to crawl to thebreadth-first algorithm, save target URL of the network program in C++language asthe implementation language, and in VC6.0debugging by ordinary users be able toperform web search task.This thesis first details the system architecture of the Internet-based search engines,and then provides details on how to design and implement search engine search engine-Web crawler. Of the subject completed the following work:1. Complete analysis of Web crawler SPIDER architecture;2. To complete the design of the main function module;3. My SQL database;4. URL parsing queue management;5. To achieve the design of the individual function module;6. Carried out the testing of the system of network reptiles.In addition, in the Design and Implementation of Web crawler chapters in addition tothe detailed elaboration of the technical core combined with the realization of themulti-threaded web crawler code to illustrate, and easy to understand.

Related Dissertations

  1. Tripartite Associations Among Bacteriophage WO, Wolbachia, and Host Affected in the Two-Spotted Spider Mite Tetranychus Urticae Koch,S433.7
  2. Effect of Ornithoctonus Huwena Venom on Proliferation of Human Colon Carcinoma Cell SW480 in Vitro,R735.35
  3. Research and Development of Spidroin/Poly-L-lactic Acid Composite Nanofiber,R318.08
  4. Design and Implementation of Web hang horse detection system,TP393.08
  5. Algorithm for the Optimal Path Based on Multi-modal Public Transport,U491.17
  6. Flower two -spotted spider mite pests of large fungal toxicity,S476
  7. Genetically engineered spider silk proteins bionic repeated module into the wire Properties,Q78
  8. The Design and Finite Element Analysis of Chassis of Wheeled Spider-type Aerial Work Platform,TU69
  9. Conjunction of Spider Silk Protein by Trans-Splicing of Split-Intein,Q51
  10. Hippocampal cell membrane proteomics and genomics dimensional chromatography on toxin research applications,Q51
  11. Electrical stimulation between tredecimguttatus proteomic analysis of venom,Q51
  12. Liuyangmycin toxicity and effectiveness of anti-mite,S482.52
  13. Study on the Structure of Small Diameter Vascular Stent by Using Composited Nanofiber with Recombinant Spider Silk and Polymers,R318.08
  14. Research and Implementation of Website Search Technology Based on Ajax/Lucene,TP393.092
  15. Research and Implementation on Key Technology of Web Text Collection and Analysis,TP391.1
  16. Design and Implementation of Search Engine Based on the Web Data Mining,TP391.3
  17. Study on Bio-ecology of the Two Dominant Spiders: Neoscona Scylla and Clubiona Corrugate,S476.2
  18. Resistance Selecting and Resistance Mechanism of Tetranychus Urticae Koch to Spirodicofen and Clofentezine,S482.52
  19. The Study of Using PCL/PVA/pNSR32 Electrospinning Nanomaterials as Tendon Tissue Engineering Scaffold,R318.08
  20. Government - oriented network information automatically grab the system design and implementation,TP393.09
  21. The Design and Implementation of Website Malice Assessing System,TP393.092

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Software Engineering > Software Development
© 2012 www.DissertationTopic.Net  Mobile