Dissertation > Excellent graduate degree dissertation topics show

Research on Focused Crawler Based on SVM Classification Algorithm

Author: LiZhengWen
Tutor: ZhangGuoYin
School: Harbin Engineering University
Course: Computer System Architecture
Keywords: vector space model HITS SVM focused crawler
CLC: TP391.3
Type: Master's thesis
Year: 2011
Downloads: 25
Quote: 0
Read: Download Dissertation

Abstract


With the rapid development of Internet, the information on the Internet is diversely growing. So how to locate the information the users need quickly, accurately and efficiently becomes a main goal of the search engine. The general search engine has the advantage of obtaining the information from a wide range. But as it involves in the broad fields, the information provided by general search engine lacks in expertise and depth in the specific area. Thus, the focused search engine came into being. It can provide professional, accurate and intensively search service. This paper focuses on the focused crawler and researches on the crawling tragedy on how to effectively crawling the topical web pages.This paper has reviews on the focused crawler and analyzes the advantages and disadvantages of the current crawling strategies from the main framework of the general crawler and focused crawler, the text-based heuristic crawling strategy and the evaluation method based on web link structure.The web page is presented by Vector Space Model. This paper studies on the principles of support vector method and kernel method, proposes the topical degree of correlation prediction algorithm based on the context and link structure that predict the topical degree of correlation of the page that has not been crawled.For the crawled web pages, first, the SVM classification filters the pages that are not relevant to the topic. Then, the topical subgraph is constructed by HITS algorithm and the authority page or central pages are selected as seeds for the next crawling.The crawling tragedy is studied on the TSE. This paper has built a focused crawler based on SVM classifier that is combination of topic degree of correlation prediction algorithm based on the context and link structure, SVM classification algorithm and HITS algorithm. The experiments show that, the proposed focused crawler based on SVM classifier can crawl the topic correlation page better.

Related Dissertations

  1. Soft Sensor of Naphtha Dry Point on Support Vector Machines Regression,TE622.1
  2. The Research of the Fault Diagnoses Algorithm for the Liquid Rocket Engine Testing Bed Based on PCA-SVM,V433.9
  3. ISAR Imaging Simulation of Space Targets and Target Recognition Based on ISAR Images,TN957.52
  4. Research on Autamatic Music Structrue Analysis,TN912.3
  5. Research on Feature Extraction and Classification of Pulse Waveform for Cholecystitis and Nephrotic Syndrome Diagnosis,TP391.41
  6. Research on Classification Method of Tongue Substance Color and Tongue Coating Color Based on SVM,TP391.41
  7. The Research on Paper Currency Classification Method Based on Harr-Like Feature and Minimal Ball Including Samples,TP391.41
  8. Research on Predicting Intrinsic Disorder Protein Structure Based on Supervision Manifold Learning Algorithm,Q51
  9. Study on the Road Condition Monitoring Based on Vehicular 3D Acceleration Sensor,TP274
  10. Research of Orange Quality Classification Technology Based on Computer Vision,TP391.41
  11. Method Research of the E-learning Resources Collecting and Automatic Classification Based on Focused Crawling Technique,TP301.6
  12. Analysis on Synoptic Climatology Characteristics and Forecast Methods of Fog in Hainan,P457
  13. Research of License Plate Recognition Based on Rough Sets and Fuzzy SVM,TP391.41
  14. Study on Visual Target Detection Based on SVM,TP391.41
  15. Design and Implementation of the Character Classification System Used in Search Engine,TP391.3
  16. Research and Implement of the Theme Crawler for Automotive Industry,TP391.3
  17. Research and Application on Short Message Text Clustering,TP391.1
  18. The Research on Electrode 3D Model Classification and Retrieval Based on SVM and Shape Features,TP391.41
  19. Research for Event Extraction Method in Specific Domain Based on Tree Conditional Random Field,TP391.1
  20. Multi-step-ahead Stock Price Index Forecasting Based on Hybrid Models,F224

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Retrieval machine
© 2012 www.DissertationTopic.Net  Mobile