Dissertation > Excellent graduate degree dissertation topics show

Cloudqueue: An Internet-Scale Messaging Infrastructure Based on Hadoop

Author: ShiDongDong
Tutor: ShiXiaPing
School: Donghua University
Course: Computer Software and Theory
Keywords: Cloud Computing MOM Message Queue Hadoop HBase Zookeeper
CLC: TP311.52
Type: Master's thesis
Year: 2012
Downloads: 323
Quote: 0
Read: Download Dissertation

Abstract


With the development of Internet technology and the Internet of Things technology, data showing explosive growth. In order to handle these vast amounts of data, we need to build a much larger, more complex, more flexible distributed systems, communication and collaboration between the system becomesis essential. Message-oriented middleware uses efficient and reliable messaging platform-independent data exchange, shielding the hardware and software differences between different systems, to communicate and exchange data between different systems transparently. However, the traditional message-oriented middleware is obviously has been unable to meet the requirements of the current large-scale, cross-data center communication between distributed systems. Hadoop is an open source distributed file system infrastructure, it is also a framework of distributed applications running on large clusters by the general-purpose computing devices, which can provide a stable and reliable interface for the application to build a high reliability and good scalability of distributed systems.Based on demand of the current distributed system messaging, combined with the Hadoop cloud computing platform, we design a Internet-scale, high performance and reliable message queue service platform, Cloudqueue. Via the message service provided by the Cloudqueues platform, which has store and forward, reliable transmission across the Internet and other characteristics, the Cloudqueue can provide high performance, reliable, high-capacity Internet-oriented messaging services in the era of cloud computing.Based on the analysis of the basic knowledge of messaging middleware and Hadoop key technology of the design objectives, the paper shows the overall architecture of the Cloudqueue system, and then, through the analysis of the key technologies related to the proposed technical, we design the architecture and objects model of the Cloudqueue. And then, we detail the description of the Cloudqueue implementation and any associated interface definition.Finally, through experiments and analysis we show that the proposed Cloudqueue system has higher performance, reliability and scalability than the traditional messaging middleware cluster system.

Related Dissertations

  1. Research and Application of Map/Reduce Based Distributed Log Analyzer,TP311.52
  2. Design and Implementation of Online Shopping Prototype System Based on Hadoop,TP311.52
  3. Design of the Mobile Learning System Based on Hadoop,G434
  4. HADOOP architecture based on the social security project web log analysis system,TP311.52
  5. 3D Mannequins Generating Engine Based on eMTM with MapReduce,TP391.41
  6. The Research of Software Service Platform Based on Cloud Computing,TP311.52
  7. Research on Fast Queryalgorithm of Massive Data,TP311.13
  8. Virus Detection Technology Based on Artificial Immune,TP393.08
  9. An Intrusion Detection System for High-Speed Networks,TP393.08
  10. Incremental Learning Method Based on Cloud Computing,TP311.13
  11. The Research of Text Classification Based on Hadoop,TP391.1
  12. Research and Implementation on a Distributed Service Registry Based on HADOOP Platform,TP393.09
  13. Resarch of Task-level Data Processing Based on Multicore CPU and Test of Its Performance on Cluster Platform,TP274
  14. Hadoop-based video transcoding system design and implementation,TN919.81
  15. Fault Tolerance for MapReduce in the Cloud Environment,TP302.8
  16. Cloud-based mobile data storage backup system,TP309.3
  17. Design and Implementation of Massive Web Log Analysis System Based on Hadoop/Hive,TP393.09
  18. Cloud storage system for mass data,TP333
  19. Massive Video Conversion Platform Design and Implementation Based on Cloud Computing,TP311.52
  20. The Optimization of High Performance MapReduce FairScheduler and the Implementation on Simulator of Huge Scale Cluster,TP311.13
  21. Job Scheduling Technologies in Data Intensive Supercomputing Systems,TP311.13

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Software Engineering > Software Development
© 2012 www.DissertationTopic.Net  Mobile