Development of an AI framework using neural process continuous reinforcement learning to optimize highly volatile financial portfolios
- Authors
- Kang, Martin; Templeton, Gary F.; Kwak, Dong-Heon; Um, Sungyong
- Issue Date
- Sep-2024
- Publisher
- Elsevier B.V.
- Keywords
- Machine learning; Model-free reinforcement learning; Neural network; Portfolio optimization
- Citation
- Knowledge-Based Systems, v.300, pp 1 - 13
- Pages
- 13
- Indexed
- SCIE
SCOPUS
- Journal Title
- Knowledge-Based Systems
- Volume
- 300
- Start Page
- 1
- End Page
- 13
- URI
- https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/119849
- DOI
- 10.1016/j.knosys.2024.112017
- ISSN
- 0950-7051
1872-7409
- Abstract
- High volatility presents considerable challenges in the optimization of financial portfolio assets. This study develops and explores model-based reinforcement learning (MBRL) in this context. Existing literature suggests that while model-free approach offers certain computational advantages, it frequently fails to encapsulate the nature of highly dynamic capital markets. This limitation is due to an insufficient consideration of the interactions between agents and environmental states within the reinforcement learning framework. Conversely, MBRL encounters inaccuracies representing stochastically evolving states typical of volatile capital markets. To address these limitations, we introduce an innovative AI framework in the MBRL domain by integrating attentive neural processes with continuous-time MBRL. This novel approach, termed Neural Process Continuous Reinforcement Learning (NPCRL), is posited to enhance the ability of MBRL to adapt to volatile fluctuations in capital markets. The effectiveness of NPCRL is empirically evaluated through a series of experiments using three important performance indicators of financial portfolios: returns, risk, and drawdown recovery. The results demonstrate that NPCRL surpasses other methods in achieving a balanced trade-off between long-term returns and risk management. This study advances our understanding of machine learning development by suggesting methods that are more proficient at capturing and adapting in volatile training environments. © 2024
- Files in This Item
-
Go to Link
- Appears in
Collections - COLLEGE OF BUSINESS AND ECONOMICS > DIVISION OF BUSINESS ADMINISTRATION > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/119849)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.