Dissertation > Excellent graduate degree dissertation topics show

Design and Implementation of ETL System on ODS in the Insurance Industry

Author: HeChenGang
Tutor: BaiYingCai；QuBo
School: Shanghai Jiaotong University
Course: Computer technology
Keywords: ETL Meta model data quality erroneous data detection duplicate data conforming
CLC: TP311.52
Type: Master's thesis
Year: 2008
Downloads: 111
Quote: 0
Read: Download Dissertation

Abstract


This paper has analysed ETL-related research and techniques, based on a practical project of a certain insurance company, and has done a lot of research on design and implementation of ETL. The ETL system had been put into production environment.On modeling design architecture, firstly according to the project this paper puts forward design model architecture based on the common data warehouse model. Then on the basis of it this paper has set up job schedule Meta model by means of analyzing logic.On extracting data, this paper brings forward an extraction-transfer-staging-merge approach to solve the issue of extracting and merging data in the distributed heterogeneous environment.On the ETL system performance, this paper has implemented boosting the performance by using pipelining and partitioning thought.On the conforming duplicate customer data, firstly this paper puts forward the sorting and equal matching algorithm. Then, in the situation when the matching keys exist, this paper proves the performance is effective. This paper makes use of business rules to bring forward the algorithm of processing the duplicate data, which hasn’t been demonstrated on this point before.On detecting error data, this paper puts forward an approach that business rule objects are used for detecting error data expression. This paper proves that the approach is effective and efficient.On data quality, by fully using a set of quantity system this paper conforms to the data quality dimension and its importance weight, and by which the approach to weighted average data quality is used to evaluate data quality of system as a whole. This paper makes data quality one part of ETL design, which enhances feature of ETL design model and higher usability.

Related Dissertations

  1. Yanzhou Mining typical object spectrum database construction and application of,P208
  2. Research and Application of Home-School Education Platform Interactive Based on Warehouse,TP311.13
  3. Design and Implementation for Decision Support System of Drug Administration Based on Data Warehouse,TP311.13
  4. PG steelworks MES system design and development of data mining,TP311.13
  5. Xinjiang Telecom EAI systems design and implementation,TP311.52
  6. Bank Operational Risk Measurement Approach System Realization,TP311.52
  7. Research on the Applications of BI’s ETL Optimization and Quality Control on Aviation Warning,F562
  8. WEB-based metadata extraction ETL resource integration model and implementation,G250.73
  9. Research and Design of Data Warehouse System in Secutities Company,TP311.13
  10. An ETL Framework Based on Metadata Management,TP311.13
  11. E-government Data Exchange System Design and Implementation,TP311.52
  12. DSS Based on Data Warehouse and Its Application in Shaanxi Telecom,TP311.13
  13. The Application and Research of Data Warehouse in Telecommunications Enterprises,TP311.13
  14. Study and Implement on Key Technology of Data Warehouse in Community Service,TP311.13
  15. Design and implementation of corporate financial data acquisition system based on ETL technology,TP311.52
  16. Applied research based on the quality of the steel industry of the SAS system data mart,TP311.13
  17. Applied Research of Data Warehouse, OLAP and Data Mining in Business Intelligence,TP311.13
  18. The Design and Implementation of Business Intelligence in Elevator Industry,TP311.52
  19. Research and Implement of Data Provenance Tracing System Based on SSIS,TP311.52
  20. Analysis and Design of Personal Information Platform in Telecom Operation,TN929.5
  21. Research and Implementation of Guangdong Telecom ODS System,TN915.09

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Software Engineering > Software Development
© 2012 www.DissertationTopic.Net  Mobile