Abstract
We herein propose learning locomotion with uneven terrain stability and energy efficiency using deep reinforcement learning for a sprawling-type quadruped robot with 16 degree-of-freedom (DOF) leg mechanisms. Our aim is to improve both locomotion stability and energy efficiency by dynamically adjusting the body height based on the locomotion speed. The learning strategy in this study comprises three steps: 1) The workspace of the proposed 4-DOF leg, unlike the 3-DOF leg structure of the existing robot, is compared and analyzed. 2) A body-height reward based on the robot's locomotion speed is designed using the Froude Number. 3) In Fractal Noise Terrain, rapid learning and generalizability for increasing adaptability to various environments are achieved via transfer learning. Finally, the policy learned by Isaac Gym is verified by comparing and analyzing locomotion stability and energy efficiency in various terrains and conditions via the Gazebo Sim-to-Sim process.
Translated title of the contribution | Learning Locomotion of 16 DOF Sprawling-Type Quadruped Robots for Both Enhanced Stability and Energy Efficiency on Uneven Terrains |
---|---|
Original language | Korean |
Pages (from-to) | 499-508 |
Number of pages | 10 |
Journal | Transactions of the Korean Society of Mechanical Engineers, A |
Volume | 48 |
Issue number | 8 |
DOIs | |
State | Published - 2024 |
Keywords
- Deep Reinforcement Learning
- Locomotion
- Sprawling Type Quadruped Robot