Dissertation > Excellent graduate degree dissertation topics show

Between the different types of data clustering algorithm

Author: LiuSiWei
Tutor: QianSongRong；LingLi；NiWeiMing
School: Fudan University
Course: Communication and Information System
Keywords: clustering web page cleaning block template web page duplicate elimination Bloom Filter K-means Association Analysis
CLC: TP311.13
Type: Master's thesis
Year: 2010
Downloads: 46
Quote: 0
Read: Download Dissertation

Abstract


With the fast development of Information Technology, we can get lots of data. These data always have different types. The subject of this paper is to establish relationships between these data, and cluster them. We propose two steps to cluster data of different types. The first step is data preprocessing, and we highlight on preprocessing of web data. We also propose a web page cleaning algorithm based on block template, and a duplicate web page elimination algorithm based on Bloom Filter. Our web page cleaning algorithm extracts templates with smaller granularity, and results in a higher precision. On the other hand, the use of Bloom Filter greatly reduces time complexity and space complexity of web page elimination algorithm. The second step is clustering. We propose to use different clustering algorithm to cluster different types of data (K-means algorithm for web data, and Association Analysis for form based data). In this way, we can take full advantage of characteristics of different types of data. After clustering these data respectively, we integrate the results of clustering, and figure out the relationships between these data. In our experiments, we use these algorithms to provide advertisements for credit card customers. The results of our experiments shows that our algorithms can accomplish the web page data preprocessing work, establish relationships between web page data and form based data, and provide better personalized advertisement service.

Related Dissertations

  1. Research and Implementation of Mining Implicit User Interest,TP311.13
  2. Establishment and Update of Similar Users’ Cluster in Personalized Information Retrieval,TP391.3
  3. Research on Removal Algorithm of Shadows in Image Segmentation,TP391.41
  4. The Research of the Text Extraction Method Based on Spectral Cut,TP391.41
  5. Gao Zhong-ying academic thought and experience and use of Bufei Decoction treatment of common diseases of the respiratory system drug law,R249.2
  6. Research and Improvement on K-Means Clustering Algorithm,TP311.13
  7. Research on Peer-to-Peer Traffic Identification Algorithm Based on Cluster Analysis,TP393.02
  8. Research of Scheduling Algorithm Based on Hybrid Adaptive Genetic Algorithm in Computing Grid,TP393.09
  9. Evaluation of Photosynthetic Efficiancy of Seedlings of the Hybrid Progenies （F1） in Peach,S662.1
  10. The Research of "Ant Group" Phenomenon in the Harmonious Society,D669.5
  11. The Load Research and Comprehensive Evaluation on the Agricultural Non-Point Source Pollution in Nantong,X592
  12. New Methodology for Mapping Resistance Trait Loci in Crop Cultivar Population,S336
  13. Characterization of Population Structure and Linkage Disequilibrium of Chinese Soybean Landerace Population and QTL Association Analysis of Traits Related to Breeding for Soybeans,S565.1
  14. Characterization of Population Structure and Linkage Disequilibrium of Chinese Wild Soybean Population and QTL Association Analysis of Traits Related to Breeding for Soybeans,S565.1
  15. Screening Stamen Development Heat-Tolerance Germplasm and Association Analysis of Agronomic Traits with SSR Makers in Upland Cotton,S562
  16. BF-FCM Clustering Algorithm and Its Application in the Image Segmentation,TP391.41
  17. The Application of Ant Colony Algorithm in Meteorological Satellite Cloud Pictures Segmentation,TP391.41
  18. Research on Clustering Algorithm Based on Mutation Particle Swarm Optimization,TP18
  19. Research on K-means Optimization Clustering Algorithm,TP311.13
  20. Research on Fuzzy C-Mean Clustering Algorithm Based on Particle Swarm Optimization and Shuffled Frog Leaping Algorithm,TP18
  21. Research on Clustering Algorithm Based on Genetic Algorithm and Rough Set Theory,TP18

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Programming > Database theory and systems
© 2012 www.DissertationTopic.Net  Mobile