Dissertation > Excellent graduate degree dissertation topics show

Research and Realization of Data Preprocessing and Association Rule Algorithm in Web Log Mining Technique

Author: WenChuanLi
Tutor: CuiXiaoYan
School: Beijing University of Posts and Telecommunications
Course: Logistics Engineering
Keywords: Web log mining rewrite URL heuristics degree ofinterest Apriori algorithm
CLC: TP311.13
Type: Master's thesis
Year: 2013
Downloads: 36
Quote: 0
Read: Download Dissertation

Abstract


With the rapid development of Internet technology, the server generates large quantities of unstructured disorganized log files every day, and thus the Internet can be seen as a huge database. It has been found that the database log files bury unlimited valuable information. With the maturing of data mining technology, it has become an important research direction of data mining to apply mining techniques to the log files of Web server. The potential use rules and patterns of Web users can be dug out by analyzing the log files. Thereby, applying these research achievements in various fields has important theoretical value and practical significance in the discovery of potential value as well as improving the service quality and efficiency of Web.The paper mainly aims at the analysis and research of the existing data preprocessing methods and association rule algorithms in the Web log mining technique. And the lack of existing algorithms is improved so as to provide methods which have better performance and are more suitable for Web log mining. The paper mainly includes the following two parts:Firstly, the processes and methods of data preprocessing which are used in Web log mining are introduced. The user identification process technology is mainly researched and based on this basis, the rewrite URL session tracking technology and the IASR user identification algorithm with the combination of heuristics are put forward. The algorithm is used to accurately identify users in the server logs by using the session mechanism, IP address and access time to. Experimental results show that the improved algorithm has better performance than the original user recognition algorithm.Secondly, under the premise of the classic Apriori algorithm based on association rule, the degree of interest threshold is introduced to improvement the algorithm and a new association rule algorithm based on the idea of combining the degree of interest, the confidence and support is proposed. The algorithm finds frequent item sets through a hash table and is realized based on association rule which is generated to meet the requirements of minimum support, minimum confidence and minimum degree of interest.The experimental data show that the improved algorithm has better performance in space and time and it improves the execution efficiency of algorithm.

Related Dissertations

  1. Based on data mining research tax audit case selection,F812.42
  2. A Hyper-heuristic Using GRASP with Path-Relinking,TP301.6
  3. The Application of Association Rules Algorithm in Higher Vocational Colleges’ Endorsement of Impoverished Students,G717
  4. Web Usage Mining and the Research of Personalized Recommendation,TP311.13
  5. Mining User Traversal Sequential Patterns Based on User Traversal Interest from Web Log,TP311.13
  6. Data Mining of Application in the School Management and Training Students,TP311.13
  7. Association Rule Mining Algorithm and It’s on Vocational School Teaching Evaluation System Applied Research,TP311.13
  8. Solve the Problem with Precedence Constraints by Combining Multiple Heuristic,TP18
  9. Method and Application on Compensation of Ore-dressing Process Integrated Production Indices Decomposition,TP311.13
  10. Structural Browsing Technology Based on Association Rules and It’s Application,TP391.41
  11. Researeh on Data Mining Technology for Teahing Assessment in Technique College,TP311.13
  12. Suining City personalized portal system design and implementation,TP311.52
  13. Based on data mining technology, Intelligent Tutoring Systems Research and Development,TP311.52
  14. Based on Data Mining Research and implementation of tourism e-commerce system,TP311.52
  15. Public Research and implementation of information-gathering,TP311.13
  16. Nurse Scheduling with Multi-levels and Individual Preferences,R47
  17. Colleges and universities based on data mining technology design and development of information collection and analysis system,TP311.13
  18. Research Offingerprint of Communication Behavior,TP311.13
  19. An Apriori Improved Algorithm of Data Mining Based on Graph and Implementation of a Data Mining System,TP311.13
  20. Combinatorial Packing Problem: Models and Algorithms,F224
  21. Research of Assocation Rules and Its Application to the Analysis of Academic Achievements,TP311.13

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Programming > Database theory and systems
© 2012 www.DissertationTopic.Net  Mobile