Dissertation > Excellent graduate degree dissertation topics show

Research on Adaptive Load Scheduling in Distributed File System

Author: YeWeiMin
Tutor: FengDan
School: Huazhong University of Science and Technology
Course: Computer System Architecture
Keywords: Distributed File System Load Scheduling Replica Placement LoadRebalancing
CLC: TP316.4
Type: Master's thesis
Year: 2013
Downloads: 13
Quote: 0
Read: Download Dissertation

Abstract


In the long-running process of the distributed file system, old nodes failureeliminated and new nodes are added dynamically as well as the dynamic creation anddeletion of stored data. There is a certain gap between the old and new storage nodes inthe storage capacity and performance. It will result in the load unbalancing problem. Thedistributed file system can’t maximize the performance, and even affect the availability. Itis necessary to maintain the system load equilibrium by load scheduling mechanism.The load scheduling mechanism for distributed file system is divided into two stages:replica placement scheduling and load rebalancing scheduling. For replica placementscheduling stage, existing programs are generally using the static algorithm or dynamicalgorithm with combination of various load information collected by storage nodes. Forload rebalancing stage, existing programs are generally using adjustment means such asincreasing replicas and replicas migration to correct the unbalanced state, but the processitself will bring some overhead, affecting the system services.For the distributed file system features, this paper presents an adaptive loadscheduling mechanism called SALS (Simple Adaptive Load Scheduling), including areplica placement scheduling method and a load rebalancing scheduling method. Thereplica placement method use reading and writing request queue length in storage node asjudging basis, computing heterogeneous node’s currently the longest response time tocharacterize the load state. Then it divided storage nodes into three states: light load,middle load and over load. The load rebalancing scheduling method use replicaadjustment as basis, while ensuring the Client according to the load state of the storagenode adaptively adjust its request transmission rate, reduce the too frequent retransmissiontimeout, to ensure that the storage node overload less impact on system performance.By testing the two scheduling stages of SALS and comparing analysis with otherrelated algorithms, it proved SALS load scheduling mechanism for the system’sperformance, read and write throughput substantially increased by20%, the averageresponse time increased by10%. It explains the effectiveness of the use of SALSmechanism in the distributed file system.

Related Dissertations

  1. Research on Key Recovery System Based on Distributed Computing,TN918.1
  2. Design and Implementation of Distributed File System for Massive Data,TP316.4
  3. Design and Implementation of Fault-Tolarance Test Platform for Distributed File System,TP302.8
  4. For multi- tasking, multi- channel parallel crawler technology research,TP391.3
  5. Research of Distributed File System Dedicated to Massive E-Mails’Storage,TP393.098
  6. The Design and Implementation of Xunlei Offline-download Distributed File System,TP311.52
  7. A Distributed Storage Manager client software prototype system design and implementation,TP311.52
  8. The Research and Implementation of Load Scheduling Algorithm and Resource Management Model Based on CG Tree,TP338.8
  9. Research on Replica Management Strategies in Education Resource Grid,TP399-C1
  10. Improvement on Aging Algorithm and Research on Its Application in LBCIS,TP301.6
  11. The Research on Autonomic Database Middleware,TP311.52
  12. Research on High Performance Parallel Processing for the Satellite Collision Prediction System,V474
  13. Research on Data Transfer in Real-time Supervision Information Systems,TP393.09
  14. The Design and Implementation of Intelligent supervision services in the AFS distributed file system,TP311.52
  15. The Design and Implementation of Parallel Computing Platform Based on MapReduce,TP338.6
  16. Distributed Scheduling for a Class of Service Grid Systems,TP393.09
  17. Research and Practice of Medical Imaging Cloud Services Platform,R197.39
  18. Research on Performance Modeling and Application of Distributed File System,TP181
  19. Research on Data Replication in Data Grid,TP393.01
  20. Study on Load Scheduling Problem in Parallel Systems,TP301.6
  21. Research and Implementation of Multimedia Data Synchronization on Mobile Devices,TN929.5

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Operating system > Distributed operating systems, parallel -type operating system
© 2012 www.DissertationTopic.Net  Mobile