Dissertation > Excellent graduate degree dissertation topics show

The Challenges and Solutions of Parallel Storage Systems for I/O-intensive Applications

Author: DongWenZuo
Tutor: LiuGuangMing
School: National University of Defense Science and Technology
Course: Computer Science and Technology
Keywords: I/O system data processing of oil seismic exploration distributed file system
CLC: TP333
Type: Master's thesis
Year: 2011
Downloads: 49
Quote: 0
Read: Download Dissertation

Abstract


Along with the rapid development of high-performance computing technology, the system performance of high-performance computer is upgrading. Currently, the high-performance computing has entered PetaFLOPS era, and is embarking on its entry into Exascale era, accompanied by the magnitude of data storage exceeding Petabyte. However, the upgrading of storage system which is one of the most important parts of the high-performance computer system has far fallen behind. And the gap between the performance of storage system and that of computing has been severely limiting the utilization of the advanced system performance of high-performance computer.This paper aimes at the I/O bottleneck problem of the HPC system, studies parallel filesystem and storage system architecture under the background of the important application of Oil seismic exploration data processing. At last, we proposal some schemes to alleviate the I/O bottleneck problem we faced now and under the future Exascale computing condition.Distributed File System is the direct manager of the storage subsystem of high-performance computer, and its way of management directly influences the utilization of the storage system. Therefore, this paper intensively analyzes the Lustre File System, including its architecture, the process of data writing and reading, the process of file locking and unlocking and its cache strategy. And then find out the shortage being existed in the Lustre File System.A typical CPU-bound and I/O intensive application is the data processing of Oil seismic exploration. Hence, this paper carefully studies its I/O process and analyzes its I/O pattern as well as its I/O characteristic, in order to further explore the problem of storage system in computing application.To the problems of storage server, such as insufficient disk bandwidth output and insufficient system polymerization bandwidth, this paper proposes the method of VDISK. It uses the memory resources of computing node to store the data of the server and agents the storage server to provide the data to other computing node, leading to the stress reduction at the server side and the rise of the system polymerization bandwidth.System architecture is important to determine the performance of the storage system. Therefore, basing on the storage problems reflected in the data processing of Oil seismic exploration and from the perspective of system structure, this paper proposes the Tiered Storage System which increases Local storage resources of the computing nodes and provides data needed together with the Global storage to the computing nodes, in order to improve the storage performance and provide high performance service. In addition, three management solutions of the Tiered Storage System are designed. Finally, the protomodel of the Tiered Storage system is implemented.

Related Dissertations

  1. Powered Activited Carbon-UF for Treating Micro-polluted Surface Water,X703
  2. Heat Transfer Performance of the Metallic Honeycomb and Regenerative Cooling Channel,V215.4
  3. Harbin City Space Environment Visual Guidance System,TU998.9
  4. Transient Thermal Analysis of Multi-Body System with Complicated Boundary Conditions,TK124
  5. Research on HID Lamp Rectifying Effect,TM923.32
  6. Study on Protective Effects of Apple Polyphenol on Immune System Injury Caused by γ-Ray,S661.1
  7. Construction and improvement of basic education reform process evaluation platform,G521
  8. Performance Analysis of Anti-Multipath Capability in DSSS System and Study on the Compensation Methods,TN914.42
  9. Research of Fault Injection for a Distributed System,TP338.8
  10. Design and Simulation of Flight Management Computer System CDU Unit in Flight Simulation,TP391.9
  11. The Research of Moving Object Tracking System Based on Embeded Image Process Unit,TP391.41
  12. Gui Design and Application Oriented to Embedded Ultrasonic Detecting System,TP274.53
  13. Development of Inductance Sensor Data Acquisition System Based on FPGA,TP274.2
  14. Research on the Control and Remedy of Nanopositioning Stage Drived by Piezo Material Lead Zirconate Titanate,TP273
  15. Robust Model Predictive Control of Networked Systems,TP273
  16. Construction and Performance Analysis for In-Vehicle FlexRay Backbone Network,TP273
  17. Research of PROFIBUS-DP Typical Application System,TP273
  18. Research on Index System and Evaluation of University Office Greening,G647
  19. On Civilian-run Colleges and Universities Issue and Its Internal Management System to Improve,G647
  20. A Study on University Science and Technology Innovation Environment Evaluation,G644
  21. Study on the Results of Heilongjiang University’s Social Science Research Evaluation System,G644

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Electronic digital computer (not a continuous role in computer ) > Memory
© 2012 www.DissertationTopic.Net  Mobile