Dissertation > Excellent graduate degree dissertation topics show

Research, Implementation and Application of Data Preprocessing Algorithms in Web Log Mining

Author: LuXianNing
Tutor: GaoZeHua
School: Beijing University of Posts and Telecommunications
Course: Communication and Information System
Keywords: Web data mining data preprocess session identification N-gram request prediction
CLC: TP311.13
Type: Master's thesis
Year: 2013
Downloads: 35
Quote: 0
Read: Download Dissertation

Abstract


With the rapid spread and spring up of Internet technology, WWW is becoming the largest public data in the world. The quantity of Web site and content is increasing at an exponential rate, and it is hard for users to choose what they intend to find from the vast information. For the Web site designers, it is vitally significant to decide how to provide personalized service, mining site commercial value r, improve the site structure design according to the user’s browsing behavior.The records of user access to the Web site, the Web server and the proxy server will be recorded in a certain format. Web log mining is that area of Web mining which deals with the extraction of interesting knowledge from logging information provided by Web servers. The process of data preprocessing is the most fundamental, complex and important step in Web log mining process.This paper mainly works on the algorithms and system applications of the data preprocessing in Web log mining. The main works are as follows:Firstly, this paper systematically introduces the concept and classification of data mining, Web data mining, and then the concept and process of Web log mining, with elaborating Web log mining technology and its processes, mainly focusing on the related method and system applications in the process of data preprocessing.Secondly, this paper realizes the common algorithms in the Web log mining preprocessing stage including data cleaning, user identification, session identification, path supplement and so on. Due to the insufficiency for statistical language model used in the session identification, I propose to use the ERR, SER and F-measure as an evaluation method for the basic parameter selection and evaluation of the system, providing the session identification solution. The experimental simulation proves it a higher application value.Thirdly, with the session recognition results of the preprocessing stage as a data source, this paper focuses on the request prediction and cache strategy based on the N-gram model. According to the request preload algorithm based on N-gram model proposed by Zhong Su et al, this paper raises an optimization method which loads multiple prediction request in advance based on the current user navigation paths, and optimization experiments show a better hit rate than the original program. Finally, with the combination of existing cache strategy, propose the site request prediction and caching scheme based on the N-gram model. However, this scheme requires online parameters adaptation with a combination of specific application environment.

Related Dissertations

  1. Detection of Class Ⅰ Integron in Gram-negative Bacteria,R446.5
  2. Study on the Therapeutic Effect and Mechanism of the Extractive of Hypericum Perforatu L against Autoimmune Myocarditis,R285.5
  3. Antimicrobial Mechanisms of Several Natural Preservatives,TS201.3
  4. The Web Data Mining Application Research for Electronic Commerce,TP311.13
  5. Research on Cluster-based Person Name Disambiguation,TP391.1
  6. The Application Study of Web Data Mining in On-line Bookstore Personalized Recommends System,TP391.3
  7. Method Based on AHP-GRAM "M Real Estate" Investment Risk Evaluation,F224
  8. Research on Intelligent Electrical Appliances Shopping Guide System,TP311.52
  9. Research on Approximate String Matching and Its Application on URL Detection,TP393.08
  10. Web-based application designed to optimize data mining research pages,TP393.092
  11. Research on Network Anomaly Detection Based on Projection Pursuit Regression,TP393.08
  12. The Application of Web Data Mining Technology on Network Education BBS,G434
  13. Based on Data Mining Technology Jobs System Design and Implementation,TP311.13
  14. Web-based data mining for personalized Search Engine,TP391.3
  15. Analysis of Drug Resistance of Pathogens of Nosocomial Infections in Critically Ill Patients and Risk Factors,R446.5
  16. Link Analysis Based Page Ranking Improvement and Related Link Spam Algorithm,TP393.092
  17. Design and Implementation of Data Management System of the Harmful Internet Video Information,TP393.06
  18. Research and analysis for users interested in model - based personalized search engine,TP391.3
  19. Study on Chinese Text Categorization,TP391.1
  20. Based on Web data mining applications in personalized distance learning system,TP311.13
  21. A Design and Implementation of Travel E-commerce Platform Information Distribution System Based on RSS,TP311.52

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Programming > Database theory and systems
© 2012 www.DissertationTopic.Net  Mobile