Dissertation > Excellent graduate degree dissertation topics show

Research and Implementation on Mass Data Cleaning in E-Government System

Author: ZhuQianLei
Tutor: GaoJianQiang；LeJiaJin
School: Donghua University
Course: Computer Software and Theory
Keywords: Data cleansing Domain ontology Properties cleaning Duplicate records cleaning Knowledge base
CLC: TP311.13
Type: Master's thesis
Year: 2010
Downloads: 146
Quote: 2
Read: Download Dissertation

Abstract


With the rapid development of information technology , managers conducting policy analysis and formulation can not simply rely on past experience , must be carried out with the necessary data to the scientific management . This leads to management decision-making analysis more strongly dependent on the data . In order to make the analysis as accurate as possible , it is proposed the requirements to establish a data warehouse . But in the process of building a data warehouse , will be the inevitable existence of a variety of data quality problems , which will inevitably affect the front end of the data warehouse decision support system to produce wrong results . To filter out these quality issues , data cleansing must be to improve the quality of the data . Data cleansing data warehouse has become an important topic in the field of data mining and network data processing . This article first comprehensive and detailed description of data cleaning knowledge , data cleaning concept , significance and domestic and foreign research and application status . The principles of data cleaning techniques , methods , evaluation criteria and process analysis and summary. Analyze and summarize the properties cleaned and used to repeat the record cleaning technologies and various algorithms . The article also describes the domain ontology and ontology representation language - OWL knowledge , and focus on how to combine the knowledge of domain ontology for data cleaning . The limitations of traditional knowledge base represented by the decomposition and reorganization of domain knowledge , build the knowledge base of the network structure , leaf node corresponds to an instance of the specific knowledge , called atoms knowledge , the non- leaf node corresponds to the concept of knowledge . The proposed data cleaning algorithm , according to the user's choice, the automatic extraction of atomic knowledge to analyze , eliminate duplication , established in accordance with the rights to dispose of heavy atomic knowledge sequence data , and then one by one cleaning . The experiments show that the algorithm can effectively optimize the user's request to reduce the number of traversal of the vast amounts of data , and significantly improve the cleaning efficiency of the massive data .

Related Dissertations

  1. Study on the Key Technologies of Domain Database-Oriented Question and Answering System,TP311.13
  2. Study on Discovering the Relationships among Data Resources in DataSpace,TP311.13
  3. The software design and implementation of the the clothing quality prediction system,TP311.52
  4. Sichuan Vocational and Technical College Archival Information Management System Design and Implementation,TP311.52
  5. SLA-based cloud service provides a framework for adaptive research and implementation,TP311.52
  6. Research on Tobacco Pest Control Network Information System,S435.72
  7. Development Study of Electronic Disease Nursing Knowledge Base,R47
  8. Research on Application Life-cycle Management Based on Knowledge,TP311.52
  9. Limited natural language analysis and understanding of building plans,TU204
  10. The Research and Development of Decision Support System for Forest Timber Assets Evaluation,S712
  11. Key Technologies of WEB Media Resources Intelligent Discovery,TP393.092
  12. Deep Web Interface Discovery Based on Domain Knowledge,TP393.09
  13. The Research and Development of Reservoir Decision Support System,TP311.52
  14. Web Based Instance Knowledge Item Auto Construction Method,TP391.3
  15. Mine Ventilation Information Decision-Making and Processing System Research Based on the B/S Mode,TD724
  16. Development of Expert System for Jack-up Rig Design,U674.381
  17. Design and Implementation of Rolling Bearing Knowledge Base System,TH133.33
  18. Study on E-maintenance System Architecture and Key Technique of Manufacturing Equipment,F424
  19. Generative exploration wells Decision Expert System Design and Implementation,TP182
  20. Semi-supervised BLOG Information Extraction Techniques Based on Document Structure,TP393.092
  21. Research and Implementation of Data Cleansing Framework Based on Component,TP311.13

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Programming > Database theory and systems
© 2012 www.DissertationTopic.Net  Mobile