Dissertation > Excellent graduate degree dissertation topics show

Designing and Reinforcement Learning Controlling of a Quasi-passive Dynamic Walking Robot

Author: MaoYong
Tutor: WangJia
School: Tsinghua University
Course: Computer Science and Technology
Keywords: biped robot passive dynamic walking compliant actuator reinforcement learning fuzzy advantage learning
CLC: TP242
Type: PhD thesis
Year: 2007
Downloads: 535
Quote: 9
Read: Download Dissertation


Passive dynamic walking is an important research topic in the field of bipedrobot. The goal of passive dynamic walking research is to discover the essentialcharacteristics of biped walking. The research methodology includes gait synthesisand gait analysis. In gait synthesis, the characteristics of walking are learnedthrough developing of passive walking robots and controlling them to walk. Inthis thesis, a 2D quasi-passive dynamic walking robot is built and controlled toachieve robust and energy e?cient walking by the actuating of compliant actuatorswhich is similar to human muscle-skeleton actuators. The main contributions ofthis thesis include:1. A numerical algorithm is presented to optimize the mechanical parametersof the robot. The algorithm is based on the stability analysis method ofnonlinear dynamical systems. Since the model is similar to the structure ofthe real robot, the conclusions can be applied in the designing of the robot.2. Based on the research of the compliant actuating methods, a type of com-pliant actuator is selected for the quasi-passive dynamic walking robot.3. A 2D quasi-passive dynamic walking robot is designed and built. Therobot is actuated by MACCEPA compliant actuators to imitate the muscle-skeleton actuators in human walking. With the aid of compliant actuators,the joint sti?ness and joint torque of the robot are controlled independentlyduring walking. Compared with most quasi-passive dynamic walking robots,this robot can achieve more human-like gait. However, the dynamic walkingcontrol of the robot is more complicated.4. A reinforcement learning based method is proposed to control the robotto walk. The task is divided into two sub-tasks: the learning of referencegait and the controlling of walking in unideal environment. A walking gaitmodel based Q-learning method is presented to solve the first sub-task. The dimension of the state-action space is descended by incorporating of theprior knowledge with the model. A fuzzy advantage learning based methodis presented to solve the second sub-task. The generalization ability of thefuzzy inference system is used to control the robot to walk in environmentwith disturbance or model uncertainty. The advantage parameter sets ofthe learning controller are well initialized by a numerical algorithm. In thisway, the e?ciency of the learning controller is improved.

Related Dissertations

  1. Research on Cooperative Orbit Determination in Satellite Network Based on Multi-Agent System Theory,V474
  2. The Study of Dynamic Simulation of the Passive Dynamic Quasi-Quarupedal Walker,TP242.6
  3. Path Planning of Robot Systems,TP242
  4. Adaptive Software Architecture Model and intelligent research,TP311.52
  5. Research on Robocup Simulation System and Program Design Based on Reinforcement Learning,TP242
  6. The Application of Reinforcement Learning and Relevance Feedback in Orthodontics Image Retrieval,TP391.41
  7. With distribution static synchronous compensator control strategy and,TM761
  8. Small unmanned helicopter hovering control algorithm,V275.1
  9. On Coordinated Control of Multiple Bio-mimetic Robotic Fish,TP242
  10. Navigation Control for Autonomous Mobile Robots Based on Reinforcement Learning,TP242
  11. Research and Design of Elevator Group Control System Based on Multi-agent,TU857
  12. A Walking Control Research of a Quasi Passive Walker,TP242
  13. The Research on Self-Adaptation Technology Based on Reinforcement Learning,TP311.52
  14. Research on Self-organization for Wireless Sensor Networks Based on Reinforcement Learning,TP212.9
  15. A Study of Opportunistic Spectrum Access Technology Based Cognitive Radio,TN925
  16. Research on the Robot’s Behavior Decision-Making Based on Artificial Emotion,TP242.6
  17. Research on Navigation of Service Robot Based on Reinforcement Learning,TP242.6
  18. Biped robot force sensor simulation and balanced detection research,TP242.6
  19. Research on the Model of Muli-agnet Cooperation and Its Learning Method,TP18
  20. Attitude Control System of the Two-wheel Self-balanced Robot Based on Learning,TP242
  21. Application for Decision of Soccer Based on Reinforcement Learning,TP242

CLC: > Industrial Technology > Automation technology,computer technology > Automation technology and equipment > Robotics > Robot
© 2012 www.DissertationTopic.Net  Mobile