Dissertation > Excellent graduate degree dissertation topics show

Design and Implementation of News Web Data Extraction

Author: WangXing
Tutor: GuJunHua
School: Hebei University of Technology
Course: Applied Computer Technology
Keywords: news page dom tree clustering similarity chinese word device
CLC: TP393.092
Type: Master's thesis
Year: 2011
Downloads: 82
Quote: 0
Read: Download Dissertation

Abstract


The rapid development of internet accelerates the speed of the news release, and the internet becomes a place to gather the most comprehensive news.The sharp increase in the daily news makes it important to how to quickly find the interested news in the Internet.In order to meet people’s need,the major search engines have launched a special news section, but only rely on these traditional browser, it is difficult to meet the user’s information needs in a particular area. The paper proposes for the cultural field news information extraction system and meets the university’s needs.Base on the analysis of a large number of news pages’structure,the paper uses a combination method of the rules and statistics to extract the informantion in the news pages.The paper take serval cultural field web sites as the object to collect web pages,and then extract the information from the pages.The method is divided into three steps: web clustering, rule structure and data integration.Firstly,the paper mainly achieve the similar structure page to have the same sign.Secondly,the paper make the extraction rule on one page of same sign pages and mainly introduces the news text extraction rule and the title extraction rule.On the basis of the other’s work of the full stop density in the text to find the news text section, paper uses a method to more accurately determine the scope of the news text and then, the paper uses the chinese word extraction device on the title page to determine the title extraction rule. Finially, the information is extracted into the DB base with the rule. Paper also provides custom content extraction rules. Users can choose their own content of interest and the system automatically generates the extraction rules of the content. Paper makes use of regular expressions to construct the user rules.The paper designs news information extraction system based on the above methods and gets a good result by testing the servel culture field news website.

Related Dissertations

  1. Syntactic Features Based Pronoun Resolution,TP391.1
  2. Research and Implementation of Mining Implicit User Interest,TP311.13
  3. Establishment and Update of Similar Users’ Cluster in Personalized Information Retrieval,TP391.3
  4. Research on Removal Algorithm of Shadows in Image Segmentation,TP391.41
  5. Gao Zhong-ying academic thought and experience and use of Bufei Decoction treatment of common diseases of the respiratory system drug law,R249.2
  6. Research on Peer-to-Peer Traffic Identification Algorithm Based on Cluster Analysis,TP393.02
  7. Research of Scheduling Algorithm Based on Hybrid Adaptive Genetic Algorithm in Computing Grid,TP393.09
  8. Evaluation of Photosynthetic Efficiancy of Seedlings of the Hybrid Progenies （F1） in Peach,S662.1
  9. The Load Research and Comprehensive Evaluation on the Agricultural Non-Point Source Pollution in Nantong,X592
  10. Research on Clustering Algorithm Based on Mutation Particle Swarm Optimization,TP18
  11. Research on K-means Optimization Clustering Algorithm,TP311.13
  12. Research on Fuzzy C-Mean Clustering Algorithm Based on Particle Swarm Optimization and Shuffled Frog Leaping Algorithm,TP18
  13. Research on Clustering Algorithm Based on Genetic Algorithm and Rough Set Theory,TP18
  14. Study on Photosynthetic Characteristics of Peach Based on Heterosis of Assimilation Capacity,S662.1
  15. The Research on Routing Protocol of Agricultural Environmental Monitoring System Based on Wir Eless Sensor Networks,TN915.04
  16. Multilayer structure based WSN routing protocol for heterogeneous clusters,TP212.9
  17. Evolutionary Clustering Algorithm and Its Application,TP311.13
  18. Ontology -based Semantic Web service matching and composition method,TP393.09
  19. WordNet and the \,G254
  20. Research on Application of Data Mining Technology in Degree of Satisfaction Analysis of Television Customers,TP311.13
  21. Segmentation of cDNA Microarray Image Using Fuzzy C-means Algorithm Optimized by Particle Swarm,TP391.41

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Computer network > General issues > The application of computer network > Web browser
© 2012 www.DissertationTopic.Net  Mobile