Dissertation > Excellent graduate degree dissertation topics show

Research on Frequent Patterns Mining Algorithm Based Sliding Window in Data Streams

Author: WangLiBo
Tutor: HuangGuoYan
School: Yanshan University
Course: Applied Computer Technology
Keywords: Data stream sliding window closed frequent itemsets maximal frequent itemsets location matrix
CLC: TP311.131
Type: Master's thesis
Year: 2010
Downloads: 83
Quote: 0
Read: Download Dissertation

Abstract


Frequent itemsets mining is an important research area in data stream mining. There are still many problems for mining frequent itemsets in the previous algorithm. For example, patterns generation delays more serious; Mined frequent itemsets are very large; Simple algorithms of frequent itemsets mining without adopting the constraint methods is not application-oriented, it does not meet the needs of users. In response to these problems, the paper has mainly focused on how to mine frequent itemsets based on FP-Tree data structure from data streams. The solving of these problems has important meaning for e-commerce, Network Communication, Business Intelligence and so on.Firstly, a new algorithm MFCI-SW for mining frequent closed itemsets in data streams is proposed, the data items in frequent closed itemsets are collected up, and the supporting degree F and the window sequence number K of them are stored in the FCIL. Then, when a new basic window arrives, the pruning of MFCI-SW-Tree is completed by deleting the data item whose K is the least in FCIL and merging the new data items into FCIL. The proposed algorithm is efficient in enhancing mining the frequent closed itemsets.Secondly, a new algorithm MFI-TD is proposed for mining maximum frequent itemsets. A new data structure, called PW-tree (Point based Window-tree) is introduced to store each transaction for the current window, and the final node of the path which denotes a maximum frequent itemset is pointed by the DP ( domain pointer). Then according to the data structure, the MFI-TD gradually deletes the obsolete and infrequent itemset branches in PW-tree by using of time decay model and the user may obtain the maximum frequent itemsets. The proposed algorithm is better than DSM-MFI in time efficiency.Lastly, a novel sequential pattern mining algorithm oriented feature discovery of software fault based on location matrix named SPM-LM is proposed. A location matrix for each event is constructed to record the frequent sequence information, which produces the frequent 1-sequence. Then, the frequent k-sequence for the prefix to frequent 1-sequence is generated through the operation for the location matrix. The software fault sequences are matched in the tree structure,the efficiency of the fault feature improved.All our experiments are performed on the real life datasets. MFCI-SW, MFI-TD and SPM-LM are performed by the experiment.

Related Dissertations

  1. Based embedded software fault-tolerant data flow anomaly detection,TP368.1
  2. Real-time Query Processing and Optimization for Basic Events from RFID Data Streams,TP311.13
  3. Research on Data Stream of Closed Pattern Mining Based on Variable Slide Window,TP311.13
  4. Research on Dynamic Unbalance Signal Processsing and Calibration Algorithm,TN911.7
  5. Research of the Antireversing Engineering Techniques,TP311.52
  6. Research on Network Behavior Analysis Based on Sampling Stream Data Mining,TP393.08
  7. Study on Intrusion Detection System Based on Clustering,TP393.08
  8. Study on Fault Location and Reconfiguration of Distribution Network,TM711
  9. Design and Implementation of FPGA Turbo Encoder/Decoder for LTE System,TN791
  10. Research of High-Dimension Data Stream Clustering Algorithm Based on Damped Window and Pruning List Tree,TP311.13
  11. Data Stream Processing in Financial Database,TP311.13
  12. Data flow anomaly detection technology research and application,TP393.08
  13. Intrusion detection system based the Squeezer algorithm with Java technology WSN,TN918.82
  14. Research on Urology Clinical Decision Support System Based on Data Mining,TP311.13
  15. The Research on Feature Selection for Data Stream,TP311.13
  16. Study on Compensation Transformer Current Differential Protection,TM407
  17. Research on Grid and Density Based Data Stream Clustering Algorithm,TP311.13
  18. Research on Data Flow Anomaly Detection Algorithm Cluster-based,TP311.13
  19. The Research on the Algorithm of Mining Frequent Patterns Over Data Streams,TP311.13
  20. Design and Implementation of Database Parallel Query Optimization,TP311.13
  21. Research of Auto-adapted Load Shedding Algorithm on Data Stream Inquires Continuously,TP311.13

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Programming > Database theory and systems > Database theory
© 2012 www.DissertationTopic.Net  Mobile