gShare: A centralized GPU memory management framework to enable GPU memory sharing for containers
- Authors
- Lee, M.; Ahn, H.; Hong, C.-H.; Nikolopoulos, D.S.
- Issue Date
- May-2022
- Publisher
- Elsevier B.V.
- Keywords
- Containers; GPU memory; Virtualization
- Citation
- Future Generation Computer Systems, v.130, pp 181 - 192
- Pages
- 12
- Journal Title
- Future Generation Computer Systems
- Volume
- 130
- Start Page
- 181
- End Page
- 192
- URI
- https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/54682
- DOI
- 10.1016/j.future.2021.12.016
- ISSN
- 0167-739X
1872-7115
- Abstract
- Owing to low overhead and rapid deployment, containers are increasingly becoming an attractive system software platform for deep learning and high performance computing (HPC) applications that leverage GPUs. Unfortunately, existing container software does not concern how each container allocates GPU memory. Therefore, if a certain container consumes the majority of GPU memory, other containers may not run their workloads because of insufficient memory. This paper presents gShare, a centralized GPU memory management framework to enable GPU memory sharing for containers. As with a modern operating system, gShare allocates the entire GPU memory inside the framework and manages the memory with sophisticated memory allocators. gShare is then able to enforce the GPU memory limit of each container by mediating the memory allocation calls. To achieve its objective, gShare introduces the API remoting components, the mediator, and the three-level memory allocator, which enable lightweight and efficient GPU memory management. Our prototype implementation achieves near-native performance with secure isolation and little memory waste in popular deep learning and HPC workloads. © 2021 Elsevier B.V.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of ICT Engineering > School of Electrical and Electronics Engineering > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/54682)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.