Dissertation > Excellent graduate degree dissertation topics show

Research of Data De-duplication Techniques in Intelligent Network Storage System

Author: LiTianXiang
Tutor: ZhaoYueLong
School: South China University of Technology
Course: Computer System Architecture
Keywords: Intelligent Network Storage System Data De-duplication Metadata Locality Performance
CLC: TP311.13
Type: Master's thesis
Year: 2012
Downloads: 128
Quote: 1
Read: Download Dissertation

Abstract


In the21st century, the continuous development of data-centric information servicestechnology such as digital libraries, e-commerce, scientific computing,electronic documentand multimedia information storage have brought enormous technical requirements to storagecapacity and reliability in data storage system. From the present viewpoint, using data backsystem to backup critical data is an effective technology to improve data reliability. However,along with the rapid growth of data, data back up system contains more and more redundantdata as time goes by, and faces huge storage pressure in data backup. Therefore, the study ofdata reduction techniques to remove redundant data in storage system has important practicalsignificance in reducing the waste of resources caused by problems that relate to storage space,management and energy consumption, etc.The existing data backup technologies, including incremental backup, and differentialbackup, can hardly solve the problem of rapid expansion of backup data, As a new datareduction technology, data de-duplication technology reduces the cost in storage system byremoving redundant data to reduce storage capacity used by storage system. Base on thisreason, on the basis of in-depth analysis and study of the data de-duplication technology, datade-duplication technology is introduced into Intelligent Network Storage System (INSS) thatproposed by our research group. The problem of low storage performance caused by massivemetadata management and frequent disk I/Os, resulting in the induction of data de-duplicationtechnology, would be analyzed, and optimization schemes are proposed in removingredundant data and reducing storage cost to improve storage performance of INSS.The main task of this thesis is focused on researching and designing data de-duplicationmodule in INSS, and improving the performance of data de-duplication technology. The mainresearch work and achievements are as follows:(1) Designed and implemented an object-based memory allocation mechanism to reducememory fragmentation and improve the efficiency of memory allocation.(2) Proposed a paralleled and hierarchical scheme to handle service logic processing indata de-duplication module with thread pool and finite state machine technology.(3) Designed an index structure which is base on hash table with eliminative mechanism, to insert, retrieve and delete metadata efficiently in memory.(4) Improved storage container allocation algorithm based on stream-informed segmentlayout (SISL) technology. This algorithm can reduce the cost of storage container metadata,improve the utilization of storage container, and maintain locality of accessing blockmetadata.

Related Dissertations

  1. Empirical Study on the Top Management Turnover and Performance of Listed Companies in China,F224
  2. Powered Activited Carbon-UF for Treating Micro-polluted Surface Water,X703
  3. The Brake Performance of Hydraulic Retarder and Simualtion Research on Its Application for Aircraft Arrestment,TH137.331
  4. Numerical Study of the Effect with Straight and Bowed Stator in Different Axial Gaps,TH45
  5. Effectiveness Evaluation on the Jointed Combat of the Multiple Missiles and Research on Combinatorial Optimization Algorithm,TJ760.1
  6. The Research of Steel’s Representation in Architecture,TU-0
  7. Partical Combination of Fine Powder Effect on Performance of Cement and Concrete,TU528.041
  8. Experimental Research on the Influence of Hollow Cathode to a Hall Thruster,V439.2
  9. Preparation and Properties of Silicon Carbon Anode for Lithium Ion Battery,TM912.9
  10. Hardware Implementation of LEO Satellite Channel Characteristic Emulation,TN927.23
  11. Development of Pxibus High Performance Digital I/O Module,TP274
  12. The Research on the Performance Results Application of Zhaoqing Power Supply Bureau,F272.92
  13. The Preparation and Properties of Reed Woodceramic,TQ174.1
  14. Improve the Junior High School Students Interested in Learning Chemistry Research,G633.8
  15. Synthesis and Resolution Property of N-(9-Fluorenylmethoxycarbonyl)-D-Tryptophan and D-Phenylalanine Imprinted Polymer,O631.3
  16. Experimental study of roadway flexible material the wind resistance of the air curtain group,TD724
  17. The Study on Rhinoceros Horn and Its Imitation,TS932.2
  18. The Research about the Processing and Performance of Waterproof Breathable Laminated Fabrics,TS195.6
  19. Application of Semi-Structure in Leisure Dress,TS941.2
  20. A Correlational Study of Anxiety in English Classroom Writing and Writing Performance of Middle School Students in Guangzhou,G633.41
  21. Research on the Subject of Vocational Teacher’s Demonstration in Oral Class,G633.41

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Programming > Database theory and systems
© 2012 www.DissertationTopic.Net  Mobile