Dissertation > Excellent graduate degree dissertation topics show

Research and Implementation of MPI Parallel Fault Tolerant Technology

Author: NiuHaiBo
Tutor: LuYuTong
School: National University of Defense Science and Technology
Course: Computer Science and Technology
Keywords: MPI fault tolerance VFTS performance model communicator dynamically reconstruction partnership agreement global consistency protocol
CLC: TP302.8
Type: Master's thesis
Year: 2011
Downloads: 52
Quote: 0
Read: Download Dissertation

Abstract


With the rapid development of HPC systems, their reliability causes more and more concern. As an important method to improve the system reliability, fault tolerant technology deserves more in-depth and valuable investigation. MPI is widely used as the parallel programming environment, achieving fault tolerance in MPI systems becomes an important research direction.In this paper, we analyzed and compared the existing fault tolerant mechanisms, and chose the checkpointing technology to implement the fault tolerant MPI system. Specifically, we designed and implemented a portable and scalable MPI fault tolerant system - Variable-based Fault Tolerant MPI System (VFTS), which is also independent of current MPI standard implementations. All of our work with VFTS is as follows:This paper established a checkpointing performance model to guide users to add fault tolerance to applications and gave the requirements for the fault tolerant programs in VFTS to achieve the minimum time overhead based on this model. In addition, according to the characteristics of this system, we summarized the performance optimization methods for the fault tolerant applications, and proposed required time, space and communication constrain principles to obtain better system performance.Then a method of communicator dynamically reconstruction was proposed. The current static process model in MPI standard limits the fault tolerant ability of MPI system. However, the proposed communicator reconstruction method can isolate and exclude the failure processes. Then new processes were added to reconstruct the invalid communicator in the MPI programs dynamically, which makes the program dynamically recover its communicator and communication space after failure occurs.This paper designed the partnership agreement used to store and recover program user data in VFTS. By two or more processes save and restore user data for each other, the partnership agreement can recover the user data of failure processes. This agreement is simple-designed and user-friendly, and users can easily adjust program fault tolerant capacity by adjusting this partnership agreement.This paper also designed a global consistency protocol to ensure the correctness of program states. This simple and less cost protocol, supported by the data from the partnership agreement and the checkpointing mechanism, is applied to ensure the storage and recovery consistency of the program system data and user data when failure occurs.Finally the VFTS was designed and implemented, and we adopted NPB to test and analyze its performance in detail, including time overhead, space overhead, communication load, fault tolerant ability and system I/O for the system.

Related Dissertations

  1. Polarized-Light/Geomagnetism/GPS/SINS Integrated Navigation Algorithm,V249.328
  2. The Research of Fault-Tolerant Techniques for Parallel/Distributed Network Simulator PDNS,TP302.8
  3. Research on Checkpointing in Mobile Computing Environment and Modeling with Petri Nets,TP301.1
  4. Study on Haze Removal Method and Parallel Implementation for HJ-1 Satellite CCD Image,P228
  5. The Research on the Relationship of Pay for Performance Model and Work Performance,F272.92
  6. Research and Implement of PIX Based on IHE,TP399-C8
  7. The Research and Optimization of Small High-Performance Linux-Based Cluster,TP316.81
  8. Design and Realization of Multitemporal Remote Sensing Image Change Detection System,TP751
  9. Overload virtual machine performance improvement under MPI communication method,TP302
  10. Design and Implementation of Exception Handling Mechanism for Concurrency Bugs,TP332
  11. Research on Parallel Algorithms of the Fast Algorithm for Spherical Harmonic Expansions,TP301.6
  12. Application of Parallel FDTD and MPSTD Algorithm in EM Scattering,O441.4
  13. Tension Control System and Application of a Copper Slitting Line,TG333.21
  14. Study on Clinical Applications of Gated Myocardial Perfusion Imaging (G-MPI) Before and After Coronary Artery Bypass Grafting,R654.2
  15. Study on Automatic Registration Algorithm and Parallel Implementation for HJ-satellite Optical Imagery,TP391.41
  16. Design and Implementation of Fault-Tolerant Parallel Algorithm for On-board Computer,TP302.8
  17. The Research of Three-dimensional FDTD Parallel Algorithm Based on MPI and OpenMP,TN011
  18. Research and Improvement on Genetic Algorithm for Solving TSP,TP18
  19. Data Similarity Analysis and Optimization Technology for MPI Programs,TP311.11
  20. The Applied Research of Cluster Based on Linux,TP338
  21. The Model and Correctness Verification of Parallal Programs in Embedded Multi-Core Environment,TP368.1

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > General issues > Design and Performance Analysis > Fault-tolerant technology
© 2012 www.DissertationTopic.Net  Mobile