Maximum Norm Minimization: A Single-Policy Multi-Objective Reinforcement Learning to Expansion of the Pareto Front
- Authors
- Lee, Seonjae; Lee, Myoung Hoon; Moon, Jun
- Issue Date
- Oct-2022
- Publisher
- ACM
- Keywords
- maximum norm minimization; multi-objective reinforcement learning; pareto optimality; weight vector selection
- Citation
- ACM Conference on Information and Knowledge Management, pp.1064 - 1073
- Indexed
- SCOPUS
- Journal Title
- ACM Conference on Information and Knowledge Management
- Start Page
- 1064
- End Page
- 1073
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/188825
- DOI
- 10.1145/3511808.3557389
- Abstract
- In this paper, we propose Maximum Norm Minimization (MNM), a single-policy Multi-Objective Reinforcement Learning (MORL) algorithm to solve the multi-objective RL problem. The main objective of our MNM is to provide the Pareto optimal points constituting the Pareto front in the multi-objective space. First, MNM measures distances among the Pareto optimal points in the current Pareto front and then normalizes the distances based on maximum and minimum reward values for each objective in the multi-objective space. Second, MNM identifies the maximum norm, i.e., the maximum value of the normalized Pareto optimal distances. Then MNM seeks to find a new Pareto optimal point, which corresponds to the middle of the two Pareto optimal points constituting the maximum norm. By iterating these two processes, MNM is able to expand and densify the Pareto front with increasing summation of the Pareto front volumes and decreasing mean-squared distance of the Pareto optimal points. To validate the performance of MNM, we provide the experimental results of five complex robotic multi-objective environments. In particular, we compare the performance of MNM with those of other state-of-the-art methods in terms of the summation of volumes and the mean-squared distance of the Pareto optimal points.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 전기공학전공 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/188825)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.