DDPG Reinforcement Learning Experiment for Improving the Stability of Bipedal Walking of Humanoid Robots
- Authors
- Chun, Yeonghun; Choi, Junghun; Min, Injoon; Ahn, Minsung; Han, Jeakweon
- Issue Date
- Feb-2023
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- Bipedal Walking; Humanoid and Bipedal Locomotion; Reinforcement Learning
- Citation
- 2023 IEEE/SICE International Symposium on System Integration, SII 2023, pp 1 - 7
- Pages
- 7
- Indexed
- OTHER
- Journal Title
- 2023 IEEE/SICE International Symposium on System Integration, SII 2023
- Start Page
- 1
- End Page
- 7
- URI
- https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/112517
- DOI
- 10.1109/SII55687.2023.10039306
- ISSN
- 0000-0000
- Abstract
- To improve the stability of bipedal walking of humanoid robots, we developed a method of setting trajectory parameters using reinforcement learning on a treadmill like testbed in a real-world environment. A deep deterministic policy gradient (DDPG) was used as the reinforcement learning algorithm. By improving the reward using a zero moment point (ZMP), the optimum value of walking stability and walking speed was determined. The robot was designed to measure the ZMP and mount weights on the upper body. In addition, a treadmill was manufactured to operate at the same speed as the walking speed of the robot. Reinforcement learning was divided into unweighted cases and cases with a weight of 1kg. At approximately 100 min, 300 episodes were performed, and reward improvements of 16.71% and 26.25% reward improvements were made. The ZMP measurements indicated that bipedal walking was performed in a safe area. Therefore, we demonstrated that the biped walking performance of a humanoid robot can be improved by the reinforcement learning of walking speed and ZMP similarity. © 2023 IEEE.
- Files in This Item
-
Go to Link
- Appears in
Collections - COLLEGE OF ENGINEERING SCIENCES > DEPARTMENT OF ROBOT ENGINEERING > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.