Dissertation > Excellent graduate degree dissertation topics show

The Design and Implementation of Vertical Search Engine Framework

Author: XuJian
Tutor: WangBaoBao
School: Xi'an University of Electronic Science and Technology
Course: Applied Computer Technology
Keywords: Vertical Search Engine Web Spider Web Structure Full-text Indexing
CLC: TP391.3
Type: Master's thesis
Year: 2011
Downloads: 21
Quote: 0
Read: Download Dissertation

Abstract


The World Wide Web is growing exponentially and the dynamic, unstructurednature of the web makes it difficult to locate useful resources. Web Search engines suchas Google and Baidu provide huge amount of information many of which might not berelevant to the users query. So general-purpose search engines can no longer satisfy theneeds of most users searching for specific information on a given topic.A vertical search engine searches a specific industry, topic, type of content (e.g.,travel, movies, images, blogs, and live events), piece of data, geographical location, andso on. Some of this content cannot be found, or is difficult to find, on general searchengines. For this reason, the topic of vertical search is closely related to that of the deepWeb.After discussing the history of development of search engine, analyzing thecharacteristics of vertical search engine and the function, principle and technologystrategy of various parts, this paper presents a new kind framework of vertical searchengine, which bases on the model of target data. Pre-select topic seed sites, specify therules of judging topic URL and extracting data from pages, this solves the problem ofthe relevance between the topic and pages. The same time, it can largely improve theefficiency of crawling and update pages from web because of removing of download ofnon-related pages. It is clear that we can not crawl all information about the topic bychoosing related web sites as our crawling target. So this framework designs a simpleand easy strategy of adding new web sites. This can improve coverage of targetresources. At last this paper implemented the framework into a vertical search enginesystem which related to science and technology projects and intellectual property.

Related Dissertations

  1. The Design and Implementation of Lucene-Based Network Literature Vertical Search Engine,TP391.3
  2. The Research on Focused Crawling Algorithm in Vertical Search Engine,TP391.3
  3. Research on Key Technologies of Personalized Vertical Search Engine,TP391.3
  4. Patentable subject -oriented search engine technology Research and Implementation,TP391.3
  5. Research and Implementation of the Used Car Trade Information Vertical Search Engine Based on Lucene,TP391.3
  6. Full-featured search engine design retrieval system,TP391.3
  7. WEB topic information gathering technology research,TP391.3
  8. Research and implementation of a vertical search engine based on Lucene technology,TP391.3
  9. Distributed Chinese text retrieval technology research and implementation,TP391.3
  10. Research and Implementation of Vertical Search Engine Key Technology,TP311.52
  11. Vertical search engine can be customized Research and Implementation,TP391.3
  12. The Research and Implementation of Vertical Search Engine Based on Nutch for University Information,TP391.3
  13. Research of Main Technologies of Vertical Search Engine,TP391.3
  14. Research on Web Structure Mining Algorithm Based on Cloud Computing,TP393.09
  15. The Research and Design of Vertical Search Engine,TP391.3
  16. Research on Vertical Search Engine System,TP391.3
  17. Web-based structure mining HITS algorithm,TP311.13
  18. Research and Implementation of Focus Crawling Spider Based on A. T. C and Optimzied Hyperlink Chosen Strategy,TP311.52
  19. Research on HITS Algorithm in Web Structure Mining,TP311.13
  20. The Research and Design on Vertical Search Engine,TP391.3
  21. Research and Implementation of Web Crawler on Vertical Search Engine,TP393.092

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Retrieval machine
© 2012 www.DissertationTopic.Net  Mobile