Dissertation > Excellent graduate degree dissertation topics show

Research and Implementation of Topic Web Crawler Oriented to Web Mining

Author: ZhangXiaoLei
Tutor: LiuZhiJing
School: Xi'an University of Electronic Science and Technology
Course: Applied Computer Technology
Keywords: Web Mining Topic Web Crawler Correlation Calculate SearchAlgorithm Text Classification Algorithm
CLC: TP391.3
Type: Master's thesis
Year: 2012
Downloads: 442
Quote: 1
Read: Download Dissertation

Abstract


With the rapid development of Internet, more and more information is presented infront of people, and Search engine becomes the mainstream way for people to accessinginformation. However, due to the explosive growth of Web resources, and due to thecharacters of them, such as discrete, heterogeneous, half-structure and real-time, how tocarry out mining analysis on them and extracting information about a particular, customtopic required have already become an important research subject.The research content of this paper is Web-based Topic Search oriented EnterpriseCompetitive Information. After the introduction of research background and currentsituation, the key technology of Web mining and search engine is emphaticallydiscussed. The main research work can be described as follows:Topic Web Crawler: With a comprehensive analysis of existing search algorithm ofsearch engine in Web mining, system improves the relevant search strategy andproposes a non-greedy genetic search algorithm.Web Document Analysis: In this paper the crawler converts a Web document to itscorresponding tree structure by using HTML Tidy tool, and extracts relevantinformation with different traversing algorithm according to the needs of users; afterextraction and segmentation of the web page content, the feature vector of the text isestablished by using an improved calculating method of the weight of feature items.Topic Correlation Evaluation: With the basis of the topic correlation evaluation ofthe web page content in the use of vector space model, the topic web crawler calculatesthe topic correlation of web hyperlinks combined with their anchor texts, URL strings aswell as the pages relevant to the topic.On the basis of above research work, The Topic Web Crawler system is designedand implemented oriented Enterprise Competitive Information.

Related Dissertations

  1. The Design and Implementation of Lucene-Based Network Literature Vertical Search Engine,TP391.3
  2. Research and Implementation of Vertical Search Engine Key Technology,TP311.52
  3. Simulation and Research on the Behavior of Bee Swarm Based on Artifical Life,TP391.3
  4. Opinion Mining Based Product Usability Modeling and Evaluation,F274
  5. Based WebHarvest the Chinese financial news search engine design and implementation,TP311.52
  6. Research and implementation of real-time information retrieval public forums,TP391.3
  7. Design and implementation of network public opinion information collection system,TP393.09
  8. Malicious Webpage intelligent detection system based on learning,TP393.08
  9. Topic-based Web Information Monitoring System Strategy and Implementation,TP393.09
  10. Research on Data Acquisition and Topic Analysis of Online Public Opinion,TP393.09
  11. Vertical Search Engine Technology in Network Control in the Patrol Public Opinion Research and Application,TP391.3
  12. Research on the Early-warning Mechanism of Intellectual Property and Its Application in the Service Outsourcing Platform,TP311.52
  13. Research and Implementation on Topic Search Oriented to Enterprise Competitive Intelligence,TP391.3
  14. The Research on Key Techniques for Page Segmentation Based Forum Crawler,TP393.092
  15. Research on Web Crawler Technology in Search Engine,TP391.3
  16. The Study and Implementation of Topic Search and Web Mining,TP391.3
  17. Research and Implementation on Textual Orientation Classification of Web Review Text,TP311.52
  18. Design and Implementation of Text Information Extracting Modules of Html Web Pages Based on DOM,TP393.092
  19. Research on Dynamic Detection Technology of XSS Attack Based on Network Spider,TP393.08
  20. Research and Implementation of the theme search engine,TP391.3
  21. Ajax Data Search Engine Clawer Research and Design,TP391.3

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Retrieval machine
© 2012 www.DissertationTopic.Net  Mobile