Dissertation > Excellent graduate degree dissertation topics show

Distributed virtualized computing platform highly reliable task split System Design and Implementation

Author: KongZhou
Tutor: LuXianLiang
School: University of Electronic Science and Technology
Course: Computer System Architecture
Keywords: Distributed Computing Task split MapReduce Hot Standby
CLC: TP338.8
Type: Master's thesis
Year: 2011
Downloads: 75
Quote: 0
Read: Download Dissertation

Abstract


With the rapid development of Internet technology and the rise of the mobile communications business, was the explosive growth of the amount of user data, especially in the telecommunications industry. Innovative value-added telecom business launch telecom customer base is growing and so a direct result of the rapid growth of the telecommunications business. In addition, due to the high demands of users of telecommunications business services in real-time, security, and stability, so this problem of how to deal with massive data sets has become a hotspot of current research. International \In this more mature application Google's cloud computing application platform, the Amazon elastic compute cloud computing platform, IBM's Blue Cloud, but these technologies are not yet used in the telecommunications industry. This paper studies the distributed computing applications in telecommunications projects. First with the current status quo and development trend of domestic and foreign research, analysis of existing cloud computing architecture, re-designed according to the specific needs of the project itself, a highly reliable distributed virtual computing platform (Distributed Virtual Computing Platform, DVCP) task demolition subsystems. The main work of this paper are the following: first, from the overall introduce DVCP project. The project is the real-time collection, statistics and analysis of massive data sets. So that the system can continue to provide the traditional business services to meet emerging business services. Second, the task split module design and implementation. The design of the module based Epoll Services Framework thread pool. Epoll asynchronous event-driven mechanism to deal with network IO request thread pool model processing asynchronous disk IO operations, improve IO efficiency. Task is split using the MapReduce parallel computing architecture that can solve large data sets distributed computing problems using this method can greatly enhance the ability of the statistical analysis of telecommunications data processing. Third, the system fault-tolerant module design and implementation. In order to ensure the high availability of the system, the system uses hot standby fault tolerance mechanism for its implementation mode to not pure software shared storage devices, data (including intermediate results) of the state value and business data in real time from the master device backup to from the device and stored in the device's memory. When the primary device fails, you can quickly switch. The system by the load pressure generator test results show that the function of the system to normal operation, and to ensure that the premise of real-time demand to meet the large-scale users to simultaneously access.

Related Dissertations

  1. An Intrusion Detection System for High-Speed Networks,TP393.08
  2. Research and Implementation on a Distributed Service Registry Based on HADOOP Platform,TP393.09
  3. Hadoop data center deployment and tracking systems research,TP308
  4. Fault Tolerance for MapReduce in the Cloud Environment,TP302.8
  5. A scalable prototype design and implementation of MapReduce,TP311.52
  6. The Research of Distributed Text-based Data Filtering Technology and System Implementation Based on MapReduce,TP391.1
  7. Large-scale approximation paragraph fingerprint - based page detection algorithm research,TP393.092
  8. IaaS cloud computing - based Web application technology research,TP393.09
  9. Performance Optimization and Applications of MapReduce in Cloud Computing,TP3
  10. Research on Parallelization of Clustering Algorithm Based on MapReduce,TP311.13
  11. Research and Implement of Job Scheduling Method for Multi_User MapReduce Clusters,TP311.13
  12. A Study on Word Document Decryption Using Time-memory Trade-Off Algorithm,TP391.12
  13. The Principle and Design of Distributed Computing Platform Based on MapReduce,TP311.52
  14. Design and Implementation of CE Data Receiving Station Monitoring and Task Management Software,TN927.2
  15. Research of Adaptive Local Hyperplane K-nearest Neighbor Classification Algorithm Based on Hadoop Platform,TP301.6
  16. Based the hadoop platform for job scheduling algorithm research,TP301.6
  17. Research on the Cloud-based Parallel Clusteringalgorithm,TP311.13
  18. Study and Parallel Implementation of Decision Tree Classification Based on MapReduce,TP311.13
  19. Reseach of Hadoop Cluster Based on Eucalyptus Cloud Platform,TP338.8
  20. Extracting Parallel Sentence from Large Scale Web Data,TP393.09
  21. MapReduce-based distributed programming framework for the design and implementation,TP311.52

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Electronic digital computer (not a continuous role in computer ) > A variety of electronic digital computer > Distributed computer
© 2012 www.DissertationTopic.Net  Mobile