Research on Safe Reinforcement Controller Using Deep Reinforcement Learning with Control Barrier Function

  • Yoon Ha Ryu
  • , Doukhi Oualid
  • , Deok Jin Lee*
  • *Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

Abstract

In the autonomous driving system, a model-based control approach has issues on the performance degradation and safety due to uncertainties or modeling errors in the used model. Recently, reinforcement learning has received lots of attention as an alternative and attractive technology in autonomous driving, but it also has challenges of how to guarantee safety. Both stability and safety are the most significant components that an autonomous driving system needs for protecting drivers and pedestrians from unexpected accidents. To resolve the above issues, we propose an attractive and efficient control technique by combining a model-free deep reinforcement learning-based controller with a model-based control barrier function to enhance the safety of an autonomous driving system. The proposed control approach builds a safe deep reinforcement learning-based controller by integrating a dynamic model-based control barrier function which guarantees a safe boundary of the vehicle motion. Various simulations are carried out to verify the performance of the proposed RL based control barrier control method, and it is shown that the proposed RL-based controller improved safety by guiding the safe boundary between ego and lead vehicles using barrier function in autonomous driving situations.

Original languageEnglish
Pages (from-to)1013-1021
Number of pages9
JournalJournal of Institute of Control, Robotics and Systems
Volume28
Issue number11
DOIs
StatePublished - 2022

Keywords

  • Adaptive cruise control
  • Control barrier fucntion
  • Control system
  • Deep reinforcement learning
  • Machine learning
  • Non linear environment
  • Safe-critical
  • TD3

Quacquarelli Symonds(QS) Subject Topics

  • Computer Science & Information Systems
  • Mathematics

Fingerprint

Dive into the research topics of 'Research on Safe Reinforcement Controller Using Deep Reinforcement Learning with Control Barrier Function'. Together they form a unique fingerprint.

Cite this