Dissertation > Excellent graduate degree dissertation topics show

Fast Snippet Generation Approach Based on CPU-GPU Hybrid System

Author: LiuZuo
Tutor: LiRuiXuan
School: Huazhong University of Science and Technology
Course: Applied Computer Technology
Keywords: Search Engine Snippet Generation Pipeline Graphic processing unit
CLC: TP391.3
Type: Master's thesis
Year: 2012
Downloads: 15
Quote: 0
Read: Download Dissertation

Abstract


As an important part of searching result presentation, query-biased document snippetgeneration has become a popular method of search engines that makes the result list moreinformative to users. Generating a single snippet is a lightweight task. However, it will bea heavy workload to generate multiple snippets of multiple documents as the searchengines need to process large amount of queries per second, and each result list usuallycontains several snippets. In order to improve the performance and economic efficiency oflarge-scale snippet generation under heavy workload, we propose a new high-performancesnippet generation approach based on CPU-GPU hybrid system.Firstly, I purposed a new snippet generation algorithm that suitable for GPU. Thisalgorithm adopts a sliding window style document segmentation, this method can avoidthe defect that may cut off the high relevance fragments caused by traditional approach.And this algorithm uses a new relevance calculation to score a fragment against query.Secondly, based on the analysis of the characteristics of CPU-GPU hybrid system, Iparallelized the serial algorithm in tasks and cross tasks. In order to achieve the optimizedefficiency of system, I designed a3-level process pipeline. I implemented it usingJobFlow architecture which supports service based programming. This architecture cansupport system design with high modularization and parallelization.Finally, I carried out a set of experiments to optimize the performance of the pipelinesystem, and verify the performance and economic efficiency of this system againstbaseline. The experimental results show that our approach gains a speedup of nearly6times in average process time compared with the baseline approach-Highlighter.

Related Dissertations

  1. Web search engine related technology research,G354
  2. The Design and Implementation of Lucene-Based Network Literature Vertical Search Engine,TP391.3
  3. Study on Web-based Translation Technology for Out-of-Vocabulary,TP391.2
  4. The Research of Link Structure in Tibetan Web Base on Social Network Analysis,TP393.09
  5. Research of Intelligent Search Engine Based on Semantic Web,TP391.3
  6. Meta Search Engine Based on BP Network,TP391.3
  7. Search Engine Provider Copyright Infringement Liability Standard Discussion,D923.41
  8. Motivations of Young Spectators of Human-powered Search Engine,G206
  9. The Method Research of the Network Dynamic Vocabulary System Construction,G354
  10. The Research on Deep Web Interfaces Integration and Query Results Ranking,TP274
  11. Study on Safety Education Management Information System Based on Struts2,TP311.52
  12. Study on the Search Engine Marketing of Enterprises,TP391.3
  13. The Study of Topic-Oriented IT News with Search Enging and Web Page Analysing,TP393.092
  14. Geographic information systems design and development of urban underground pipeline,TP311.52
  15. Search engines trademark infringement and Responsibility,D923.43
  16. Research and Implementation of Vertical Search Engine Key Technology,TP311.52
  17. Based on analysis of public opinion judged the emergency warning platform for the design and implementation of,TP311.52
  18. The Research on Key Technologies for Web Information Personalization Collection and Management,TP393.09
  19. The Research and Design of Monitoring System for BBS,G206
  20. The Long Tail Theory Applied in Baidu’s Online Advertising,F49
  21. Mobile Internet environment Wireless Vertical Search Engine Research and Implementation,TP391.3

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Retrieval machine
© 2012 www.DissertationTopic.Net  Mobile