Dissertation > Excellent graduate degree dissertation topics show

Design and Implementation of Data Deduplication on the Cloud Gateway

Author: ZhouXuan
Tutor: ZengLingFang
School: Huazhong University of Science and Technology
Course: Computer System Architecture
Keywords: cloud storage cloud gateway high redundancy data separation datadeduplication
CLC: TP333
Type: Master's thesis
Year: 2013
Downloads: 4
Quote: 0
Read: Download Dissertation

Abstract


With developing of the information age, big data storage transfer has becoming animportant problem that must be solved. Cloud storage provides a good solution for bigdata storage, however, due to the lack of cloud storage application programming interfacestandardization, which limits the application of cloud storage seriously.The lack of cloud storage application programming interfaces standardization makescloud storage gateway becoming an essential important component for the cloud datastorage, it is largely because of the cloud gateway acting as a translation betweenapplications and cloud provider APIs protocol. However, the cloud gateway can’t supportfor enterprise’s many other services, so most of the current cloud gateways are used forarchive and backup. The problem of the cloud gateway is that it increases the cloudstorage complexity and limits the performance at the same time, so for insurance ofperformance and simple point of view, it is not an ideal way for the main application.The purpose of designing and implementing a function for data deduplication oncloud gateway is for solving the high redundancy problom on backup and archive files. Byusing data deduplication on cloud gateway, network bandwidth between the cloud gatewayand cloud platform can be reduced, as well as the data capacity on the cloud platform.Data deduplication on cloud gateway are consist of several step: dividing a file into blocks,calculating every block’s fingerprint, seeking this fingerprint in the hashtable, if thefingerprint is existence, discarding this block, updating the file information and nonexisting blocks in the Swift cloud platform independently.Through performance compare between normal cloud gateway and cloud gatewaywith data deduplication function shows that: data deduplication on cloud gateway canreduce storage capacity about76%~91%in the Swift cloud platform for high redundancydata, and saving the70%~86%network bandwidth at the same time. The datadeduplication function improves the performance of cloud gateway with little effect on theresults of response costs.

Related Dissertations

  1. The Operation and Maintenance of ITIL Based on Cloud Computing,TP311.52
  2. Web application system design based on Google's cloud computing platform and,TP393.09
  3. Paradise: A Secure, High-reliable Cloud Storage Backup Model for Disasters,TP309.3
  4. Cloud Storage Encryption small scale document storage management research and implementation,TP333
  5. Cloud-based mobile data storage backup system,TP309.3
  6. A non- master control architecture of cloud storage,TP333
  7. Research and Implementation of Storage Architecture Based on Load Balancing,TP333
  8. Agent-based network storage and retrieval of business information,TP391.3
  9. The Design and Implement of HDFS Based Cloud Dta Backup System,TP309.3
  10. Structural Analysis and Design of Expressway Toll Collection System,TP311.52
  11. Security Technology Research in Object-based Storage System,TP393.08
  12. The Research of Separation/Enrichment Chlorophenols Endocrine Disrupitng Chemicals in the Environment by Ionic Liquid Aqueous Two-Phase Extraction/Solvent Sublatlon,X830.2
  13. The Research on Dynamic Attribute-based Encryption Algorithm for Cloud Storage,TP333
  14. The Key Technology Research and Preliminary Design of IOT Cloud Gateway,TN929.5
  15. Research on the Model and Algorithm for the Load Capacity of Video-on-Demand,TN948.64
  16. The VOD System Based on HDFS,TN948.64
  17. Large-scale High-definition Video Monitoring System Based on Cloud Computing,TP277
  18. NoSQL database of massive astronomical images based on distributed memory research,TP391.41
  19. User Data Security in Cloud Storage Service,TP309.2
  20. The Design and Implementation of Cloud Storage System Based on Homomorphic Encryption,TP333
  21. Research and Design for Cloud Storage Systems Oriented to Terminal Applications,TP333

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Electronic digital computer (not a continuous role in computer ) > Memory
© 2012 www.DissertationTopic.Net  Mobile