Dissertation > Excellent graduate degree dissertation topics show

The Implementation of Data Migration Mechanism for Hierarchical Storage

Author: XuQiongYao
Tutor: CaoQiang
School: Huazhong University of Science and Technology
Course: Computer System Architecture
Keywords: Data migration Hierarchical storage Access frequency Migration strategy Data consistency
CLC: TP333
Type: Master's thesis
Year: 2013
Downloads: 13
Quote: 0
Read: Download Dissertation

Abstract


Hierarchical storage is designed to realize that, the data with different heat valueshould be on the storage devices with different performance, maximize storage utilization.When the heat value of the data is changed, it will trigger data migrate to the storagedevices which are better meet their current heat value. Therefor, for hierarchical storagesystem, design a data migration mechanism which is transparent and efficient toforeground application has important research value.It divided into three modules to design data migration process: heat statistics module,strategy matching module and data migration module. The heat statistic module isdesigned in the generic block layer to count access frequency, and design a heat evaluationmethod base on access frequency and time weighting value. The strategy matchingmodule build client-specific policy rules and common to all clients policy rules, anddesign a threshold dynamic adjustment algorithm based on Physical Volume (PV)occupancy and an algorithm based on the load balancing of storage nodes to apply PV.The data migration module design three kinds of data migration algorithms, which canachieve re-migrate at breakpoint:(1) the simple data migration algorithm (SCP), just readthe data out from source volume then write to destination volume;(2) the algorithm baseon the kernel copy thread (kcopy) in Device-mapper, which implement data consistency;(3) the algorithm base on SCP, in which read process and write process can executeparallel. In order to protect the data consistency in data migration, we design and analysistwo kind of consistency methods: a method based on record-write strategy, an othermethod based on piecewise processing.Finally, concrete realization of a prototype of the data migration mechanisms, and dosome test to data migration, focus on the speed of data migration, and the impact to usersin data migration progress. Experiment indicate that, in the case of high load, the diskthroughput decreased by10%to25%in data migration; Under normal circumstances,data migration has little affect to users when they access the system.

Related Dissertations

  1. Based on the. NET Framework website database migration,TP311.13
  2. The design and application of the tax data warehouse system,TP311.13
  3. Billing System Architecture Design and Data Migration,TP274
  4. Telecom BOSS system software testing,TP311.53
  5. Study on Relationship between University Students’ Frequency of Computer Access and Their Level of Computer Literacy and on Gender Differences in the Two Aspects in CALL Environment,H09
  6. The Planning of Digital Business Disaster Recovery Program Based on Hierarchical Storage Management Theory,TP309.2
  7. Validation Methods and Assistant Tools Based on Coherence of Data,N945.13
  8. Research on Data Reliability in Peer-to-Peer Networks Storage System,TP393.02
  9. The Research and Application of Smart Client,TP311.52
  10. Study and Implementation on Some Key Techniques in Network Gas Stations Management System,TP311.52
  11. Converged storage system research and design data replication,TP333
  12. Researches on Security and Frequency Offset Estimation for Wireless Access,TN919.3
  13. The Study of Multi-component VSP/RVSP Seismic Forward Modeling,P631.4
  14. Study and Simulation the Frequency Offset Estimation Algorithm in WCDMA,TN929.533
  15. Digital organism database system batch synchronization Design and Implementation,TP311.13
  16. SAN and NAS storage application of technology based in Sichuan Mobile,TP333
  17. The Fixed Network Intelligence Certain Key Question Research,TN915
  18. Distant Disaster-tolerant and Backup System Based on IP-SAN,TP309.3
  19. Research on Data Replication Strategy in Peer-to-Peer Information Resource Center Networks,TP393.02
  20. Research and Implementation of the High-Availability Remote Disaster Recovery System,TP309.3
  21. Realization of Link Access and Decoding/De-multiplexing in WCDMA UE,TN929.533

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Electronic digital computer (not a continuous role in computer ) > Memory
© 2012 www.DissertationTopic.Net  Mobile