Dissertation > Excellent graduate degree dissertation topics show

Topic-based Web Information Monitoring System Strategy and Implementation

Author: LiuXinYu
Tutor: TangXueWen
School: Chongqing University
Course: Computer System Architecture
Keywords: Information monitoring Web crawler Theme policy Heuristic crawling algorithm
CLC: TP393.09
Type: Master's thesis
Year: 2011
Downloads: 16
Quote: 0
Read: Download Dissertation

Abstract


In recent years, with the rapid development of Internet technology, expanding the scope of its popularity, the Internet has gradually penetrated into people's daily lives, and become people learn and work an important part of life. However, due to the Internet using the free, open to the organizational structure, as people increasingly frequent activity on the network, the network information is also increasingly complicated, some violent, pornographic and other illegal information or even reactionary began circulating on the Internet. These adverse information, especially those related to national security and social stability sensitive information dissemination great harm to society, therefore, how the information from a large number of network monitoring and identification of such information has become an important field of Internet security research. Currently a lot of research in this field has focused on the gateway, port, and user client information to filter and shield, wherein the client information based on the user to filter and shielding of Web information to monitor the effect is not ideal, but based on the gateway and port information monitoring tools often need to use port mirroring or splitter, and its huge amount of data interception, monitoring system hardware and software requirements for higher system overhead than the larger scale and thus a need for a lightweight, efficient information monitoring system. Therefore, this study and propose a topic-based Strategies for Web information detection system, this paper work and the results are as follows: ① through Web pages and Web crawling techniques to study, propose a topic-based Strategies for Web information monitoring system model. The model is based crawling technology, combined with the actual work on the specific use of Web information monitoring system needs to research and analysis, strategic Web information given topic detection system infrastructure. ② According to the research needs of the system, through the Thematic Network crawling algorithm study and analysis, propose a heuristic crawling algorithm, this algorithm as the basis of this monitoring system and core. The algorithm is based on the characteristics common theme crawling strategy, through the pages to introduce the topic of radiation space link-based policy analysis and content-based analysis methods are combined and embedded heuristic algorithm, which is proposed based on heuristic crawling algorithms. Experimental results show that the algorithm is better than the commonly used algorithms are crawling crawling efficiency. ③ The research results will be combined with practical application, this paper topic-based strategies to achieve a Web information monitoring system prototype and deploy applications through the campus network practical research and experimental verification, the results demonstrate that the system can effectively find the deployed network environment contains a specific topic pages, and can be a long and stable operation. Finally, this paper summarizes the work done and future work are discussed.

Related Dissertations

  1. Design and Implementation of Hydrological Information Automatic Monitoring System,P335
  2. Design and Implementation of Information Monitoring for Smartphone,TN929.53
  3. Application of Wireless Sensor Network in Agriculture Greenhouse,TN929.5;TP212.9
  4. Research on Data Acquisition and Topic Analysis of Online Public Opinion,TP393.09
  5. Vertical Search Engine Technology in Network Control in the Patrol Public Opinion Research and Application,TP391.3
  6. The Research on IWOM Monitoring System Based on Web Text Mining,TP391.1
  7. Research and Implementation on Topic Search Oriented to Enterprise Competitive Intelligence,TP391.3
  8. China’s Hazardous Waste System of Mandatory Disclosure,X705
  9. Design and Implementation of Agriculture Environment Monitoring System Based on Wireless Sensor Network with Mobile Sink Node,TP274
  10. The Research on Key Techniques for Page Segmentation Based Forum Crawler,TP393.092
  11. Analyzing and Predicting the Run-time Behavior of Software in Electronic Trading,TP311.52
  12. Research on Web Crawler Technology in Search Engine,TP391.3
  13. The Study and Implementation of Topic Search and Web Mining,TP391.3
  14. Research and Implementation on Textual Orientation Classification of Web Review Text,TP311.52
  15. Design and Implementation of Text Information Extracting Modules of Html Web Pages Based on DOM,TP393.092
  16. Research on Dynamic Detection Technology of XSS Attack Based on Network Spider,TP393.08
  17. Research and Implementation of the theme search engine,TP391.3
  18. Ajax Data Search Engine Clawer Research and Design,TP391.3
  19. Design and Implement of Information Document Search Engine System Based on JavaEE Platform and Lucene,TP391.3
  20. China 's food security early warning mechanism,F203

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Computer network > General issues > The application of computer network
© 2012 www.DissertationTopic.Net  Mobile