Loading [a11y]/accessibility-menu.js
Subgoal-Driven Navigation in Dynamic Environments Using Attention-Based Deep Reinforcement Learning | IEEE Conference Publication | IEEE Xplore

Subgoal-Driven Navigation in Dynamic Environments Using Attention-Based Deep Reinforcement Learning


Abstract:

Collision-free, goal-directed navigation in environments containing unknown static and dynamic obstacles is still a great challenge, especially when manual tuning of navi...Show More

Abstract:

Collision-free, goal-directed navigation in environments containing unknown static and dynamic obstacles is still a great challenge, especially when manual tuning of navigation policies or costly motion prediction needs to be avoided. In this paper, we therefore propose a subgoal-driven sensor-based navigation architecture that is trained with deep reinforcement learning and decouples obstacle avoidance and motor control. In particular, we separate the navigation task into the prediction of the next subgoal position for avoiding collisions while moving toward the final target position, and the prediction of the robot's velocity controls. By relying on 2D lidar, our method learns to avoid obstacles while still achieving goal-directed behavior as well as to generate low-level velocity control commands to reach the subgoals. In our architecture, we apply the attention mechanism on the robot's 2D lidar readings and compute the importance of lidar scan segments for avoiding collisions. As we show in simulated and real-world experiments with a Turtlebot robot, our proposed method leads to smooth and safe trajectories among humans and significantly outperforms a state-of-the-art approach in terms of success rate. A supplemental video describing our approach is available online11Full video: https://youtu.be/5TLjNnucpjw.
Date of Conference: 05-08 December 2023
Date Added to IEEE Xplore: 01 February 2024
ISBN Information:

ISSN Information:

Conference Location: Abu Dhabi, United Arab Emirates

Funding Agency:


References

References is not available for this document.