Dissertation > Excellent graduate degree dissertation topics show

Design and Implementation of Distributed File System for Massive Data

Author: ChengMing
Tutor: LiuXiaoFeng
School: Huazhong University of Science and Technology
Course: Software Engineering
Keywords: Distributed file system Massive data Meta data
CLC: TP316.4
Type: Master's thesis
Year: 2010
Downloads: 296
Quote: 0
Read: Download Dissertation

Abstract


With the rapid development of Information Times, the total volume of data explosively grows. On the one hand, we have the big information source from the massive data. On the other hand, it is difficult for us to store and analyze the massive data. To solve that problem, the Google Company shows their solution: The Google File System and Map/Reduce programming model. The Google File System is used to store massive data. The Map/Reduce programming model is used to analyze massive data. In this paper, we focus on the store and management of massive data.By analyzing the design of many distributed file systems, we design and implement the KiddenFS which is a distribute file system for storing and managing massive data.In the first part of the paper, we describe the design and analysis of KiddenFS. First, we analyze the functional and non-functional requirements. The second, we show the key design in KiddenFS, including the logic structure of the KiddenFS, the mode of data store and the strategy of load balance and so on. The last, we design the architecture of KiddenFS and show the data flow of key operation. The KiddenFS is composed of meta data server, data server and client. Meta data server manages meta data, data server manages data and client provides the interface of KiddenFS.In the second part of the paper, we describe the key algorithms and data structure of KiddenFS, including data management, meta data management, the communication between data server and meta data server, the communication between data server and client and the communication between client and meta data server and the interface of file system.The last part of the paper, we test the KiddenFS and give a example to show how to use the KiddenFS in your application.

Related Dissertations

  1. Research on Compression, Operation and Query Processing Methods of Massive Datasets,TP311.13
  2. Implementation of Data Compression, Operation and Query Processing System Based on BAP,TP311.13
  3. On the Standardized Meta-data Conversion for Chinese Ancient Books: Research and Applications,TP391.1
  4. The Object-Oriented Data Management of Common Information Model,TP311.13
  5. Weak consistency of distributed data maintenance strategy study,TP311.13
  6. In a distributed environment, Encrypting File System Design and Implementation,TP309.7
  7. Hadoop Distributed File System (HDFS) Study Reliability and Optimization,TP316.4
  8. Distributed File System centralized security management server design and implementation,TP316.4
  9. Fault Tolerance for MapReduce in the Cloud Environment,TP302.8
  10. Magnetic confinement fusion experiments analysis of massive data retrieval,TP391.3
  11. Unbalanced data set classification method and its application in the telecommunications industry,TP311.13
  12. "Digital Shandong" Space Information-Sharing Platform for the Initial Structures,P208
  13. The Desgin and Implementation of Institutional Repository Based on Dspace,TP311.52
  14. Mass data storage Digital Library Research and Implementation Organization,TP333
  15. Massive Data Acquisition System,TP274.2
  16. Research and Realization on Replica Management in Distributed File System in Large-scale Network Storage,TP316
  17. Query Processing on Massive Data in Hierarchical Storage System,TP311.13
  18. Research on Approaches To Large-scale Data Analysis,TP311.13
  19. Broadband network user information mining,TP311.13
  20. A Distributed Storage Manager client software prototype system design and implementation,TP311.52

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Operating system > Distributed operating systems, parallel -type operating system
© 2012 www.DissertationTopic.Net  Mobile