Dissertation > Excellent graduate degree dissertation topics show

Researches of MapReduce Parallel Programming Model and Scheduling Algorithm for Heterogeneous Multi-core Systems

Author: LiZuo
Tutor: LiRenFa; XiaXianZhong
School: Hunan University
Course: Software Engineering
Keywords: Heterogeneous multi-core system Parallel Programming Model MapReduce Speculative execution Scheduling algorithm
CLC: TP338.6
Type: Master's thesis
Year: 2012
Downloads: 92
Quote: 0
Read: Download Dissertation

Abstract


With the increase of the difficulty of parallel programming in heterogeneousmulti-core environment, the parallel programming model can handle and generatevery large scale data sets is needed urgently. Such model can reduce the difficulty ofparallel programming, so that the development rate of heterogeneous multi-coresystems can be increased.MapReduceis a parallel programming model which is emerging in recent years.The model is mainly used to achieve the computing tasks of the sub-division of tasks,computing resource scheduling, computational structural reduction. MapReduce is asimple, elegant solution for heterogeneous parallel system of data processing.However, those scheduling algorithms of the traditional MapReduce have somelimitation such as its response time is too long and system’s throughput drops sharplywhich affects the performance of the whole system. Based on the deep study of theMapReduce parallel programming model, the paper proposed a novel heterogeneousmulti-coreMapReduce scheduling algorithm which is suitable for the Hadoop platform.following are the main work:(1)Based on the scheduling problem of the MapRedcue model, the papersummarized and analysed the three factors: locality, synchronization and fairnessconstraints, which make the main effect for the algorithmic efficiency. Furthermore,to study the execution of handling the synchronization cost in MapRedcue, the paperdiscussed two methods which are asynchronous processing and speculative execution.Then, locality improvement, delay scheduling in Hadoop and quincy scheduler inDryad are discussed.(2)The paper proposed an novel improved heterogeneous multi-coreMapReducescheduling algorithm,based on the characteristics of heterogeneous multi-coreenvironment, considering the weakness of the typical MapRedcue schedulingalgorithm—LATE algorithm. The novel method adds the ability to obtain theregulatory learning of Machine Learning and randomly gathers some task as test taskto get the information on the processing nodes. Then it gets the time percent of eachstage and adjust the the way applications run, then lunches the backup task to reducethe response time.In order to prove the effectiveness of the proposed algorithm, Based on theHadoop platform, experiments about the algorithm are performed. The result shows that the algorithm is better than LATE algorithm and the original algorithm of theHadoop platform. All in all, the proposed algorithm is good for increasing theperformance of the whole system, and it also has some promoting significance forheterogeneous multi-core parallel computation.

Related Dissertations

  1. Design and Implementation of Automotive Can-Can Gateway,TP273
  2. Research of Packet Scheduling Algorithm of the Click Modular Software,TP393.05
  3. 3D Mannequins Generating Engine Based on eMTM with MapReduce,TP391.41
  4. GPU-Based Parallel Optimization of Adaptive Gaussian Mixture Background Modeling Algorithms,TP391.41
  5. An Intrusion Detection System for High-Speed Networks,TP393.08
  6. The Research of Text Classification Based on Hadoop,TP391.1
  7. Research and Implementation on a Distributed Service Registry Based on HADOOP Platform,TP393.09
  8. Resarch of Task-level Data Processing Based on Multicore CPU and Test of Its Performance on Cluster Platform,TP274
  9. Temperature limits based on multi-core systems saving scheduling algorithm,TP332
  10. Hadoop data center deployment and tracking systems research,TP308
  11. Fault Tolerance for MapReduce in the Cloud Environment,TP302.8
  12. A scalable prototype design and implementation of MapReduce,TP311.52
  13. The Research of Distributed Text-based Data Filtering Technology and System Implementation Based on MapReduce,TP391.1
  14. Large-scale approximation paragraph fingerprint - based page detection algorithm research,TP393.092
  15. The Optimization of High Performance MapReduce FairScheduler and the Implementation on Simulator of Huge Scale Cluster,TP311.13
  16. The Design and Implementation of a Email System for On-line Reviewer,TP393.098
  17. An Optimized Scheduling Strategy in Xen Based on Task Type,TP302
  18. Analysis and Optimization of Massive Data Processing on High Performance Computing Architecture,TP338
  19. Information Flow Control Model in Distributed Systems,TP316.4
  20. Job Scheduling Technologies in Data Intensive Supercomputing Systems,TP311.13
  21. The Improvement and Research of Real-time Embedded Operating System Based on Linux,TP316.2

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Electronic digital computer (not a continuous role in computer ) > A variety of electronic digital computer > Parallel computer
© 2012 www.DissertationTopic.Net  Mobile