Dissertation > Excellent graduate degree dissertation topics show

The Design and Implementation of Lucene-Based Network Literature Vertical Search Engine

Author: HuangRongYou
Tutor: ZhaoXinJian
School: Zhejiang University of Technology
Course: Applied Computer Technology
Keywords: Network Literature Vertical search engine Web crawler Lucene DirectHit
CLC: TP391.3
Type: Master's thesis
Year: 2011
Downloads: 71
Quote: 0
Read: Download Dissertation

Abstract


With the explosive growth of Internet information, the general search engines have been increasingly difficult to meet the growing individual requirements. However, as for professional search request, general search engines will be insufficient. The emergence of vertical search engine with the features of industry, accurate and fine is specifically for solving this problem.First, this paper introduces the working principle of vertical search engine and deeply describes the constructure of web crawler called Heritrix. Base on the above description, this paper puts forward to realize the crawl to gather specific links with prediction algorithm of the link marked and to achieve crawl with multi threads to gather web page more efficiency. According to the dynamic mode features of network literature page, this paper achieves automatic extraction of web information and the data was deposited into a relational database for search.Second, depending on the status of the network literature, this paper determines system’s basic functions and performance requirements. And then the function of each module and flow chart were described in detail. To help users better understand the system, this paper especially draws interactive mapping system function diagrams and use case diagram. Then retrieve and index module are designed base on understanding the architecture of Lucune and indexing technology. This paper introduces directHit algorithm, content-based page relevant algorithm and the importance of works to improve Lucene’s original sorting algorithm to improve the system precision. In addition, the introduction of the system cache was brought about to speed up the retrieval speed.At last, the recall, precision and retrieval time were tested. The experimental results show that the system is feasible and has practical value.

Related Dissertations

  1. The Research and Design of Monitoring System for BBS,G206
  2. Based on WebGIS and MMS mobile search service system development,TP311.52
  3. Fire domain search engine system design and implementation,TP391.3
  4. Applied Research LUCENE Chinese word in the text of a document retrieval system research,TP311.52
  5. Web Service Platform Research and Implementation Based on MVC Design Pattern,TP311.52
  6. The Design and Realization of Knowledge Based on Lucene,TP311.52
  7. Design and Achieve a Movie Ticket Vertical Search System and Basic on Lucene,TP391.3
  8. Research and Application of Full-Text Retrieval Based on Lucene.Net,TP391.3
  9. Research and implementation of real-time information retrieval public forums,TP391.3
  10. The Design and Implementation of Content-Based Information Retrieval System,TP311.52
  11. Web-based search engine system design and implementation,TP391.3
  12. Research on Information Retrieval Technology Based on Semantic Web,TP391.3
  13. Research and Implementation of Website Search Technology Based on Ajax/Lucene,TP393.092
  14. Vertical Search Engine Technology in Network Control in the Patrol Public Opinion Research and Application,TP391.3
  15. A Study on Compression Algorithm Performance Based Inverted Index,TP391.3
  16. Study on an Improved Chinese Segmentation Algorithm and Its Application in Lucene,TP391.1
  17. Distributed Image Search Engine Design and Implementation,TP391.41
  18. Research and Implementation of full - text retrieval system based on lucene Chinese,G354
  19. Java-based Zhejiang Textile \u0026 Fashion College campus network search engine,TP393.18
  20. Website Crawler and Retrieval System Based on Lucene,TP393.092
  21. A Multi-semantic Search Engine for Traditional Chinese Medicine,TP391.3

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Retrieval machine
© 2012 www.DissertationTopic.Net  Mobile