Dissertation > Excellent graduate degree dissertation topics show

An Improved Method for Detecting Incremental Approximately Duplicate Records Based on Clustering Tree

Author: DaiYing
Tutor: LiXingGuo
School: Hefei University of Technology
Course: Engineering and project management
Keywords: Data cleansing Duplicated records Clustering tree Level Law
CLC: TP311.13
Type: Master's thesis
Year: 2010
Downloads: 39
Quote: 1
Read: Download Dissertation

Abstract


Lead to increased approximately duplicate records multiple channels of data warehouse data sources , and seriously affect the efficiency of data use and the quality of decision-making . Similar detection and elimination of duplicate records become a hot research field of data warehousing , knowledge discovery problem . Since most of the decision-making applications are based on a dynamic database , so the incremental similarity duplicate record detection research by the organization and the attention of scholars . Detection algorithm based on clustering tree is a good incremental similarity duplicate record detection methods . But the algorithm is not efficient, and the problem of low accuracy . In view of this, the article uses the rank method attributes reduction and creation of a threshold for the clustering tree building process , proposed an improved detection algorithm based on clustering tree . This article first data quality , data cleaning and approximately duplicate records related theories and methods of detection . Second , analysis of the improvement ideas and methods to address these issues based on the problems in the clustering tree detection algorithm , ie using the level of the right to re- law about less attribute to attribute sort in order to improve the accuracy of the algorithm , additional recording threshold improve the efficiency of the algorithm . and shows the process of the improved algorithm . Finally, DBMS, SQL Sever Management Studio the MyEclipse7.0 for program development tools , development of ICT-Syst (Improved Clustering Tree System) applications , and application database generator according to given rules generated experimental database , algorithm effectively validation experiments , the experimental results show that the improved algorithm has a higher recall and precision and also significantly improve the efficiency of data processing .

Related Dissertations

  1. Study on Topology Control and Routing Optimization of Wireless Sensor Networks,TP212.9
  2. Research and application of data cleaning algorithm,TP311.11
  3. Data Cleaning and Its Application in the Planning Value System of Baosteel Group Corporation,TP399
  4. Car sales system data warehouse solutions,TP399
  5. Research on Civil Aeroengine Condition Based Maintenance Management,V263.6
  6. Three - tier architecture of the data warehouse project,TP311.13
  7. Research and Development of the Steel Storage & Transportation Logistics Management Information System,TF086
  8. Real-time road vehicle identification method based on the Haar-like features,TP391.41
  9. Research and Implementation of Data Migration Based on Oracle,TP311.138
  10. Research on Maintenance Engineering Capability Evaluation of Civil Aviation and Development of Decision-making Support System,F426.5
  11. Research on Data Cleansing and Tool Designing,TP311.13
  12. Feature-based cleaning method of the preferred data,TP311.13
  13. Analysis of Protein Sequence Similarity,O29
  14. Study and Implementation of a Data Cleansing System Based on Multi-Agent Technology,TP311.52
  15. Research and Implementation of Data Cleansing Framework Based on Component,TP311.13
  16. Duplicates Cleansing Based on Semantic Association,TP311.13
  17. Domestic crude root group Allium plant molecular systematics,Q949.7
  18. Research and Implementation of Network Topology Identification Based on Network Tomography Technology,TP274.2
  19. Ideological interpretation of the original sin of the law,D914
  20. Content-based Image Video Network Database System Research and Implementation,TP311.13

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Programming > Database theory and systems
© 2012 www.DissertationTopic.Net  Mobile