Dissertation > Excellent graduate degree dissertation topics show

Research on Obtaining Predictive State Representations with State Space Partitioning

Author: ChenZhenZhen
Tutor: LiuYunLong
School: Xiamen University
Course: Systems Engineering
Keywords: Dynamic System Modeling State Space Partitioning Predictive StateRepresentation Transformed Predictive State Representation
CLC: N945.12
Type: Master's thesis
Year: 2014
Downloads: 3
Quote: 0
Read: Download Dissertation

Abstract


Predictive State Representation (PSR) is an efficient way for modeling dynamical systems. Compared to other modeling methods, PSR, which represents state using only observable data, has greater expressive power and learning PSR models of dynamical systems should be easier. However, current research methods in PSR mostly focus on learning a model based on the entire state space. Commonly, it is difficult to obtain the PSR model by using traditional technique. The existing algorithms for building PSR models of dynamical systems are usually only applied to small scale systems.In this thesis, the entire state space of a dynamical system is partitioned into sub-state spaces by the mechanism of state space partitioning, which reduces the difficulty to learn the PSR model of a dynamical system. And then, an algorithm for learning the PSR model of a system based on state space partitioning and an algorithm for learning the Transformed Predictive State Representation (TPSR) model of a system based on state space partitioning are proposed. Therefore, our algorithms in this paper put forward a possible solution to obtain the complete PSR model of a relatively large scale dynamical system.The main research and achievements of this thesis are summarized as follows:(1) A mechanism for partitioning state space is proposed. In general terms, with the increasing scale of a dynamical system, the states of the system accordingly increase. The entire state space is partitioned into sub-state spaces by using the identified landmarks as the critical points. Then, the number of states in each sub-state space is generally smaller than the number of states in the entire state space. We only need to learn every sub-state space’s PSR model separately, which is easier than learning the model on the entire state space. Consequently, the mechanism for partitioning state space reduces the difficulty of obtaining the complete PSR model of a dynamical system.(2) An algorithm for learning the PSR model of a system based on state space partitioning is proposed. The entire state space of a dynamical system is partitioned into sub-state spaces by the mechanism of state space partitioning. And then traditional technique is used to learn every sub-state space’s PSR model. According to these local PSR models, we can produce the complete PSR model of the system, which can be used to predict any events. The simulation experiment results show that the proposed algorithm is effective.(3) An algorithm for learning the TPSR model of a system based on state space partitioning is proposed. Due to the expansion of a dynamical system, the time complexity and computation of discovering core tests also usually escalate accordingly. In order to reduce the complexity to obtain one PSR model further, this paper introduces Principal Component Analysis (PCA) and then presents an algorithm for learning the TPSR model of a system based on state space partitioning. In the algorithm, without the process of discovering core tests, we use PCA to reduce the dimensions of histories-tests matrixes and then learn every sub-state space’s TPSR model, which makes learning predictive state representation simplified further. The empirical results prove the effectiveness of the proposed algorithm.

Related Dissertations

  1. Rough set theory and rough hybrid intelligent methods in the ship power system,U665.1
  2. Study of Spatial and Temporal Dimensions Dynamical System Modeling Based on Multi-polymerization Process Neural Networks,TP391.9
  3. Design and Development of Three Dimensional Modeling and Simulation System for Digital City,N945.12
  4. Research of Event-Based Auto Control Stratage Modelling,N945.12
  5. The Analysis and Predict Model for Traffic Flow Magnitude Basised on SVM,N945.12
  6. Kernel-based Modeling Research for Nonlinear Distributed Parameter Systems,N945.12
  7. System Modeling and Performance Analysis of Power Saving Class of Type II in IEEE 802.16e,N945.12
  8. Arena ambulance system - based modeling and simulation,N945.12
  9. Analysis and Synthesis of Markov Jump Systems Subject to Actuator Saturation,N945.12
  10. Research on the Demand Force Disposition of Airplane Battle Damage Repairing Based on the Queuing Theory,N945.12
  11. Management information system modeling and consistency of tree based on atomistic model,N945.12
  12. Theory of N-ary Relations and Its Application in Modeling Knowledge System,N945.12
  13. The Customer Credit Evaluation Model and Its Implementation Research of Large Customer Management of Power Supply Enterprise,N945.12
  14. Knowledge Unit Acquisition and Knowledge Unit Network Model of Unconventional Emergency,N945.12
  15. Modeling and Simulation of the behavior of swarm intelligence based on pseudo Physics Group,N945.12
  16. Study on Lake Water Quality Simulation System Based on WebGIS,N945.12
  17. The Study on Modeling Multi-state System and Model Solution,N945.12
  18. A Multimode-Based Dynamics Modeling Method for Urban Road Traffic Networks,N945.12
  19. Research on the Modeling and Evaluation Method of Weapon System of Systems for Striking Time-Sensitive-Target,N945.12
  20. Research on Modeling and Control of Audit Evaluation System Based on Risk Management,N945.12

CLC: > SCIENCE AND > Journal of Systems Science > Systems Engineering > Systems Analysis > System model,system modeling
© 2012 www.DissertationTopic.Net  Mobile