Dissertation > Excellent graduate degree dissertation topics show

Research on the Key Technologies of Peer-to-Peer Based High Performance Computing for Applications with Data-dependency

Author: LuoFei
Tutor: JinHai
School: Huazhong University of Science and Technology
Course: Computer System Architecture
Keywords: High performance computing Peer-to-peer computing Resource management Task scheduling Programming model Data-dependency
CLC: TP302
Type: PhD thesis
Year: 2008
Downloads: 266
Quote: 1
Read: Download Dissertation


In order to resolve the compute-intensive applications whose parallism is in the task level, Peer-to-peer (P2P) based high performance computing (HPC) systems have the potential capability to construct a powerful virtual supercomputer far beyond any current computing center by assembling idle internet cycles. Therefore, more and more such systems are coming into being. However, most typical systems currently are limited because they can not support applications with data-dependable relationship. Therefore, in order to promote P2P based HPC systems, it is necessary to investigate the key technologies of such systems, whick drive them to support more general applications with data-dependency.Therefore, a new P2P based HPC platform, P2HP-2, is designed in this paper. The key technologies of P2HP-2 are studied, such as the resource management strategy, the task scheduling policy, as well as the application programming model. Furthermore, combined with an application instance, the overall performance of P2HP-2 is evaluated.To fill the requirement of the resource allocation for the dependent tasks, the computing resources of P2HP-2 are self-organized in GTapestry, which is a structured overlay based on unstructured workgroups. The construction of GTapestry considers the overall proximity matching, including the matching between the object’s distribution and the domain’s construction, and the location matching between the virtual and physical networks. Moreover, dynamic maintaining metrics for nodes and groups and an object pointer backup policy are exploited to boost the routing efficiency. The structural design of GTapestry provides such characteristic as self-adaptation and self-organization, and the efficient communication mechanism between workgroups helps P2HP-2 to support applications with task-dependent relationship.In order to schedule the execution of the applications with data-dependency, a negotiated coscheduling policy is proposed. According to the dependable relationship reflected in the project description file and the local neighbor tables of the nodes, it dispatches and coschedules dependable tasks with local negotiation. First, the dependable task will be endowed with a task priority, and it will be dispatched to one of the neighbors of the current node with the negotiation among the neighbor nodes. Then the task will be coscheduled with the non-preemptive single-task scheduling, which follows the complete configuration of the necessary programs, parameters and dependent data for the task. At the mean time, according to their current load, the nodes will dynamically adjust the distribution of tasks with local negotiation among them. The programming model attacks the problem at the level of the model that acts as an interface between applications and computing systems, and a one-sided message passing programming model (OMP) is implemented to drive the development of P2HP-2. Based on the communication mode between tasks and the runtime, OMP consists of a communication library (ComLib) and a software development kit (SDK). In the ComLib, a one-sided communication mechanism is provided with the help of the runtime. Then the SDK is implemented based on the ComLib, where the application programming interfaces (API) can be exploited to parallelize applications through module division. Therefore, the tasks can meet their dependent data by initiating a data request with the APIs in OMP, where the request is resolved by the combination of the communication mechanism in GTapestry and the negotiated coscheduling policy of P2HP-2.In order to verify P2HP-2’s capability to support the tasks with interactive tasks, a parallel benchmark is presented, where the 1-level-core parallel threading algorithm is proposed and is implemented as the parallel threading program with OMP. In the parallel 1-level-core threading program, the threading process between one protein template and one target sequence is divided as tasks, which are parallel executed and have the static tree-like task-dependent relationship among them.Compared with the structured P2P network as Tapestry, GTapestry is more statble, routes more efficiently, and costs less for dynamic maintenance. It is shown that the structural design of GTapestry can meet the high efficient communication requirements for the dependent tasks. Moreover, according to the theoretical and experimental analysis, it is presented that the negotiated coscheduling policy can schedule the execution of the applications with data-dependency, which can be suitable to the dynamic environment. Finally, in terms of the performance tests of the parallel threading algorithm in P2HP-2, it is shown that such key technologies as the resource management strategy of GTapestry, the negotiated coscheduling policy, and the one-sided message passing programming model can make the P2P based HPC systems to support applications with data-dependency.

Related Dissertations

  1. The Research of Land-Use Optimization Approach Based on Non-Point Source Pollution Controlled,X24
  2. Health products industry performance management research,F426.82
  3. Chemical Construction Company Human Resource Management,F426.7
  4. Study on Staff Incentive Mechanism for Labor Service Company of Qinghai Oil Field,F426.22
  5. Researches and Simulation of Load Control Strategies in TD-SCDMA Trunking System,TN929.533
  6. GPU-Based Parallel Optimization of Adaptive Gaussian Mixture Background Modeling Algorithms,TP391.41
  7. Research of Finite Element Method on GPU,O241.82
  8. Load Control Algorithm for TD-SCDMA-based Trunking Communication System,TN929.533
  9. Resource Management Mechanism for QoS in Cognitive Networks,TN915.09
  10. Congestion Pricing Based on Trip Decision and Uncertain Demand Forecasting,O242.1
  11. Flight Control and Task Scheduling of Small-scale Unmanned Helicopter,V249.1
  12. Jiangxi Provincial Government Performance Evaluation Study recruitment office,E265
  13. Optimization of Allocation Strategy and Scheduling Algorithm for Enterprise Grid,TP393.18
  14. Research and simulation of grid job scheduling algorithm based on the expectation trust benefit function,TP393.01
  15. JH independent research institute external teacher incentive,G647.2
  16. The Present Conditions, Problems and Strategies of the Management of the University Personnel in China,G647.2
  17. Reflections on the "Humanistic Thought" in Pre-Qin for the Personnel Management in Colleges,G647.2
  18. The Reserchment of the Emergency Volunteer Management in China,G812.13
  19. The Effectiveness of Local Government Administration Research,D630
  20. The Problems of Civil Servants Incentive in Cangzhou Local Tax Bureau and the Countermeasurs Analysis,D630.3
  21. Research on Strategic Human Resource Management Applied in Institutions,F272.92

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > General issues > Design and Performance Analysis
© 2012 www.DissertationTopic.Net  Mobile