Dissertation > Excellent graduate degree dissertation topics show

Task Scheduling and Synchronization Controlling in a BSP-based Large Scale Graph Processing System

Author: YuanFang
Tutor: YuGe
School: Northeastern University
Course: Applied Computer Technology
Keywords: Task scheduling synchronization controlling BSP graph processing
CLC: TP301.6
Type: Master's thesis
Year: 2012
Downloads: 3
Quote: 0
Read: Download Dissertation

Abstract


With the rapid growth of emerging applications like social network analysis, semantic Web analysis, and bioinformatics network analysis, it is urgent to require the processing capability on large scale graphs with billions of vertices, which is the hot topic of the research and development in the current high performance computing field.In this thesis, we make a study of BSP model, Hadoop, Pregel, HAMA and large scale graph processing applications. The thesis designs and realizes the task scheduling and synchronization controlling in order to serve the prototype system based on BSP model for processing large scale graph. The thesis considers the task scheduling approach of Map-Reduce and the characteristics of the BSP model, proposes the pattern that it ensures all tasks of the same job can start in the same time. This thesis proposes a new concept—load balancing factor, using split-piece technology, data-localization technology and balance-load technology to optimize the performance of the BSP model system. Based on Zookeeper, this thesis considers completes the synchronization controlling process between adjacent supersteps using three synchronization barriers. To make full use of the convergence property of graph processing, this thesis designs an intelligent control mechanism to control supersteps in process, which can automatically determine whether to start the next superstep or not. That a work node may execute many tasks in the same time, this thesis puts forward the design of the synchronization controlling which can reduce the load of the cluster system.Finally, the whole system was deployed to real cluster environment and run the program. The results show how data-localization and balance-load influence the performance of the closer system, points the shortcomings in order to provide the basis for further optimization of this system.

Related Dissertations

  1. Reseach of Mobile IP Routing in Satellite Networks,TN929.5
  2. Transplant of Windows CE Operation System Based on ARM9,TP316.7
  3. Research on Task Scheduling Strategy of Cloud Computing Based on MPSO Algorithm,TP3
  4. Gsi Superstructure Shop Floor Management System Planning and Designing,U673.2
  5. The Design and Implementation of a 3D Collision Detection Parallel Algorithm,TP391.9
  6. Flight Control and Task Scheduling of Small-scale Unmanned Helicopter,V249.1
  7. Information Control System Based on VxWorks development research,TP311.52
  8. Cloud computing task -dependent mechanism of dynamic parallel scheduling,TP3
  9. Design and implementation of embedded platform based monitoring system PSOS,TP368.1
  10. Research and simulation of grid job scheduling algorithm based on the expectation trust benefit function,TP393.01
  11. Research on the Improved Grid Schedule Algorithm Based on Min-Min and Max-Min,TP393.01
  12. Research and Implementation of 3D Graphics Technology Based on ARM Embedded System,TP391.41
  13. Windows CE Transplanting and Device Drivers Development of Portable Equipment Based on OMAP3530,TP368.11
  14. Design and Implementation of Main Processing Module Based on ARM9 in the Avionics Integrated Control Unit,V243
  15. Research of Grid Task Scheduling Based on Genetic Simulated Annealing Algorithm,TP393.01
  16. Santai County Bank Loan Project Management Information System Design and Implementation,TP311.52
  17. On the Progressive Mesh Simplification Algorithms in Virtual Environment Based on LOD Technology,TP391.9
  18. MPC852 and Vxworks-based Embedded System Design,TP368.12
  19. Study and Implementation of Scheduling Algorithm for Real-Time Tasks on Reconfigurable Systems,TN791
  20. Design and Implementation of embedded electronic ballast test system,TM923.61
  21. Design and Implementation of Automatic Detection System for Modern Communication Equipment,TP311.52

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > General issues > Theories, methods > Algorithm Theory
© 2012 www.DissertationTopic.Net  Mobile