C2RL: Convolutional-Contrastive Learning for Reinforcement Learning Based on Self-Pretraining for Strong Augmentationopen access
- Authors
- Park, Sanghoon; Kim, Jihun; Jeong, Han-You; Kim, Tae-Kyoung; Yoo, Jinwoo
- Issue Date
- May-2023
- Publisher
- MDPI
- Keywords
- deep reinforcement learning; self-supervised learning; contrastive learning; generalization; data augmentation; network randomization
- Citation
- SENSORS, v.23, no.10
- Journal Title
- SENSORS
- Volume
- 23
- Number
- 10
- URI
- https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/88324
- DOI
- 10.3390/s23104946
- ISSN
- 1424-8220
- Abstract
- Reinforcement learning agents that have not been seen during training must be robust in test environments. However, the generalization problem is challenging to solve in reinforcement learning using high-dimensional images as the input. The addition of a self-supervised learning framework with data augmentation in the reinforcement learning architecture can promote generalization to a certain extent. However, excessively large changes in the input images may disturb reinforcement learning. Therefore, we propose a contrastive learning method that can help manage the trade-off relationship between the performance of reinforcement learning and auxiliary tasks against the data augmentation strength. In this framework, strong augmentation does not disturb reinforcement learning and instead maximizes the auxiliary effect for generalization. Results of experiments on the DeepMind Control suite demonstrate that the proposed method effectively uses strong data augmentation and achieves a higher generalization than the existing methods.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - ETC > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/88324)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.