Dissertation > Excellent graduate degree dissertation topics show

The Implemention and Design of Web Crawler for Price Comparing Shopping Platform

Author: ZuoHu
Tutor: GuoZuo; LuoYouJun
School: East China University of Science and Technology
Course: Software Engineering
Keywords: Web Crawler Heritrix Price Comparing Shopping
CLC: TP391.3
Type: Master's thesis
Year: 2013
Downloads: 130
Quote: 0
Read: Download Dissertation

Abstract


With the popularization and development of information technology. Internet has gone into everywhere of people’s lives and work, and the search engine has been the most convenient tool for people to obtain information, online shopping has become a way of life. Porducts for online selling have thousands of varieties, big different price and services Consumers have to spend a lot of time in browsing merchandise and compare price, therefore many users want to have such a system to help them complete the purchasing of goods, the system should include the price and information of most og products selling in online shopping websites. You are able to know which sites selling goods cheapest and has best services through this system. Comparison shopping platform is a good solution. But how to obtain such huge product data and price information is the most importment issue. Based on the above background, the paper proposes a solution to their data sources-Design and Implementation of Web crawler.This paper focuses on how to design and implement the web crawler, how to expand some fuctions and develop new features by Heritrix web crawler. I will do some research from the below points:(1)To determine seed links: the entrance of web crawler crawler(2)Web crawling: save web pages to a local folder(3)To analyse and extract web content: extract product attributes into a text file(4)To structure and store data: extract and store product attributes into the database one by one(5)To display products detailed information and show the comparsion result.

Related Dissertations

  1. The Design and Implementation of Lucene-Based Network Literature Vertical Search Engine,TP391.3
  2. Research and Implementation of Vertical Search Engine Key Technology,TP311.52
  3. Simulation and Research on the Behavior of Bee Swarm Based on Artifical Life,TP391.3
  4. Opinion Mining Based Product Usability Modeling and Evaluation,F274
  5. Based WebHarvest the Chinese financial news search engine design and implementation,TP311.52
  6. Research and implementation of real-time information retrieval public forums,TP391.3
  7. Design and implementation of network public opinion information collection system,TP393.09
  8. Malicious Webpage intelligent detection system based on learning,TP393.08
  9. Topic-based Web Information Monitoring System Strategy and Implementation,TP393.09
  10. Web-based search engine system design and implementation,TP391.3
  11. Research on Data Acquisition and Topic Analysis of Online Public Opinion,TP393.09
  12. Vertical Search Engine Technology in Network Control in the Patrol Public Opinion Research and Application,TP391.3
  13. Research on the Early-warning Mechanism of Intellectual Property and Its Application in the Service Outsourcing Platform,TP311.52
  14. Research and Implementation on Topic Search Oriented to Enterprise Competitive Intelligence,TP391.3
  15. The Research on Key Techniques for Page Segmentation Based Forum Crawler,TP393.092
  16. Research on Web Crawler Technology in Search Engine,TP391.3
  17. The Study and Implementation of Topic Search and Web Mining,TP391.3
  18. Research and Implementation on Textual Orientation Classification of Web Review Text,TP311.52
  19. Research and Implementation of Vertical Search Engine Techniques,TP391.3
  20. Design and Implementation of Text Information Extracting Modules of Html Web Pages Based on DOM,TP393.092
  21. Research on Dynamic Detection Technology of XSS Attack Based on Network Spider,TP393.08

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Retrieval machine
© 2012 www.DissertationTopic.Net  Mobile