Dissertation > Excellent graduate degree dissertation topics show

Replication Consistency Research in Parallel File System

Author: GuiQuanLi
Tutor: TanZhiPeng
School: Huazhong University of Science and Technology
Course: Computer System Architecture
Keywords: Distributed file system Replication consistency Dynamic consistency
CLC: TP316.4
Type: Master's thesis
Year: 2012
Downloads: 17
Quote: 0
Read: Download Dissertation

Abstract


With the development of information technology, people request high capacity andhigh performance on information storage, so cloud storage arises at the historic moment.In the cloud storage service, people focus on the performance and reliability of the cloudstorage. Cloud storage usually reflect as the distributed file system, there will need toimprove the performance and reliability of the distributed file system. Like the RAIDtechnology into the distributed file system, the introduction of replication can be a verygood manner to improve the performance and reliability of the system. How to establish aproper replication management mechanism to reduce the losses of the performance whatmaintaining replication consistency brings to, has becomes a hot topic in the research ofthe distributed file system.Google’s GFS, Amazon’s Dynamo and so on have proposed several solutions forreplication consistency, but they only focus on one part of these issues. With thedevelopment of the replication and load balance in the distributed file system, this papermake full use of load information and the heat of the file access information in storagenodes, put forward the replication consistency maintenance algorithm based on the heatinformation and the size of data. The algorithm gains the heat queue from the storagenodes terminally, and compares it with the update queue, if both have no intersection, thenthe updating can become slow, conversely, select the renewal which is heater and smallerto update first, then update the renewal which is not heat and larger. Usually maintainingthe replication consistency would increase the load of the metadata server. When theupdate affects the function of normal service, the maintenance of the replicationconsistency would switch to client which can reduce the load of the metadata server.The experiments show that, the strategy of the maintenance of replication consistencybased on the heat and size and dynamic consistency switching, realize the effectivemaintenance of the replication consistency and greatly reduce the costs in the maintenanceof the replication consistency. In the case which the renewal takes up more than20%of allrequest and several replication numbers, dynamic consistency have some improvementcompared with the traditional replication consistency maintenance strategy on thesystem’s response time.

Related Dissertations

  1. Design and Implimention of Metadata Server High Availability in Distributed File System,TP368.5
  2. Weak consistency of distributed data maintenance strategy study,TP311.13
  3. In a distributed environment, Encrypting File System Design and Implementation,TP309.7
  4. Hadoop Distributed File System (HDFS) Study Reliability and Optimization,TP316.4
  5. Distributed File System centralized security management server design and implementation,TP316.4
  6. Research and Implementation of Ceipfs: A Distributed File System,TP309
  7. The Challenges and Solutions of Parallel Storage Systems for I/O-intensive Applications,TP333
  8. Research on Data Redundancy Technologies of Distributed File System Based on HDFS,TP316.4
  9. Design and Realization of Parallel File IO Based on Hadoop Distributed File System,TP338.6
  10. Research on Key Recovery System Based on Distributed Computing,TN918.1
  11. Design and Implementation of Distributed File System for Massive Data,TP316.4
  12. Study on Metadata Management Strategy in Distributed File System,TP316.4
  13. The Design and Implementation of a Distributed Storage and Retrieval System,TP333
  14. Research on the Application of Distributed File System Data Scheduling in G/S Model,P208
  15. The Research and Implementation of Server Cluster Construction Based on DFS,TP333
  16. Design and Implementation of Fault-Tolarance Test Platform for Distributed File System,TP302.8
  17. Design and Implementation of Network Coding Based Distributed File System,TP316.4
  18. Distributed File System Metadata Management Research and Implementation,TP338.8
  19. A Similar Image Search Engine Based on Millions of Images and Distributed Computing,TP391.41
  20. For multi- tasking, multi- channel parallel crawler technology research,TP391.3
  21. Research of Distributed File System Dedicated to Massive E-Mails’Storage,TP393.098

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Operating system > Distributed operating systems, parallel -type operating system
© 2012 www.DissertationTopic.Net  Mobile