Dissertation > Excellent graduate degree dissertation topics show

Research of Text Extraction Algorithm Based on Visual Semantic Block

Author: HuBo
Tutor: ZhouBo
School: Zhejiang University
Course: Applied Computer Technology
Keywords: Extraction of webpage DOM-Tree VIPS algorithmEffective semantic block Structure similarity
CLC: TP391.1
Type: Master's thesis
Year: 2013
Downloads: 7
Quote: 0
Read: Download Dissertation

Abstract


With the advanced development of Internet technology and information, the quantity of webpage increases rapidly. It is more and more accustomed for people to use search engine to get the information what they want from the vast Internet. However, a webpage normally not only contains the content text information, but also disturbs greatly the efficiency and accuracy of search engine through various ways such as navigation bar, advertising links and recommended links.The current study proposed a text extraction algorithm based on visual semantic block pages which dispensed the reliance of current text extraction algorithm on webpage text and separated it into semantic blocks based on its semantic characteristics. Then the biggest semantic block is found and further ones with similar structure will be searched. At last the webpage text information will be extracted through constantly searching. On one hand, since this algorithm does not depend on the distribution density of webpage text, sound effects can be reached in some webpage with considerable text of noise information. In addition, pictures and videos included in the body text could also be extracted and the robustness of this algorithm is improved. On the other hand, during processing DOM-Tree, this algorithm doesn’t need to search for the whole DOM-Tree for getting information. Nevertheless, only the leaf nodes of DOM-Tree should be processed which save much time and increase efficacy of searching.This research conducts experimental analysis for300webpage of15portals which include some thematic websites such as news, blog, forum and BBS. The result shows that the accuracy and recall rate could reach above94%by utilizing the text extraction algorithm based on visual semantic block pages. Apart from this, because of starting from different angle, this algorithm could combine with other traditional algorithms that based on webpage text to obtain better effects.

Related Dissertations

  1. Design and Implementation of News Web Data Extraction,TP393.092
  2. Study of Double-layer Rock Beams Structure,TD311
  3. Information Extraction Based on Table Area Locating for E-Commerce Websites,TP393.092
  4. Research and Implementation of DOM-Tree Based Entity Extraction for Deep Web,TP393.09
  5. Research and Implementation of Search Engine Prototype Based on Deep Web Crawler,TP391.3
  6. A Web Structure Clustering Algorithm for Mobile Page Adaptive Platform,TP393.092
  7. Research on Topical Spider,TP391.3
  8. Research on Technology of User-Driven Data Sharing,TP311.52
  9. Web-based information is automatically extracted English exam generation algorithm,TP393.09
  10. Research on Mining Structure of WEB Page for Information Extraction,TP393.092
  11. Chinese Web Text Filtering Technology Research,TP391.1
  12. Key Techniques of Text Mining’s Research and Application on Electronic Employment,TP391.1
  13. Research and Application of Web Data Extraction Mode Based on Tree Structure,TP393.092
  14. Algorithms Based on Visual Similarity of the Research in Information Extraction and Implementation,TP311.13
  15. Research & Application of Web Similiarity Based on DOM Tree,TP393.092
  16. Research and Implementation of Automatic Information Extraction from Web Pages,TP393.09
  17. The Design and Implementation of Video-info Extraction System in Video Search Engine,TP393.092
  18. Research for Information Extraction Based on Wrapper Model Algorithm,TP311.52
  19. Research and Implementation of Page Object Extraction Model for Vectical Search Engine,TP391.3
  20. The Strategy of Topic-specific Web Crawler Based on Semantics Similarity,TP393.09
  21. Research on Web Data Mining Technology Based on XML,TP311.13

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile