gShare: A centralized GPU memory management framework to enable GPU memory sharing for containers
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Lee, M. | - |
dc.contributor.author | Ahn, H. | - |
dc.contributor.author | Hong, C.-H. | - |
dc.contributor.author | Nikolopoulos, D.S. | - |
dc.date.accessioned | 2022-01-28T06:41:10Z | - |
dc.date.available | 2022-01-28T06:41:10Z | - |
dc.date.issued | 2022-05 | - |
dc.identifier.issn | 0167-739X | - |
dc.identifier.issn | 1872-7115 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/54682 | - |
dc.description.abstract | Owing to low overhead and rapid deployment, containers are increasingly becoming an attractive system software platform for deep learning and high performance computing (HPC) applications that leverage GPUs. Unfortunately, existing container software does not concern how each container allocates GPU memory. Therefore, if a certain container consumes the majority of GPU memory, other containers may not run their workloads because of insufficient memory. This paper presents gShare, a centralized GPU memory management framework to enable GPU memory sharing for containers. As with a modern operating system, gShare allocates the entire GPU memory inside the framework and manages the memory with sophisticated memory allocators. gShare is then able to enforce the GPU memory limit of each container by mediating the memory allocation calls. To achieve its objective, gShare introduces the API remoting components, the mediator, and the three-level memory allocator, which enable lightweight and efficient GPU memory management. Our prototype implementation achieves near-native performance with secure isolation and little memory waste in popular deep learning and HPC workloads. © 2021 Elsevier B.V. | - |
dc.format.extent | 12 | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Elsevier B.V. | - |
dc.title | gShare: A centralized GPU memory management framework to enable GPU memory sharing for containers | - |
dc.type | Article | - |
dc.identifier.doi | 10.1016/j.future.2021.12.016 | - |
dc.identifier.bibliographicCitation | Future Generation Computer Systems, v.130, pp 181 - 192 | - |
dc.description.isOpenAccess | N | - |
dc.identifier.wosid | 000819692500014 | - |
dc.identifier.scopusid | 2-s2.0-85122627336 | - |
dc.citation.endPage | 192 | - |
dc.citation.startPage | 181 | - |
dc.citation.title | Future Generation Computer Systems | - |
dc.citation.volume | 130 | - |
dc.type.docType | Article | - |
dc.publisher.location | 네델란드 | - |
dc.subject.keywordAuthor | Containers | - |
dc.subject.keywordAuthor | GPU memory | - |
dc.subject.keywordAuthor | Virtualization | - |
dc.subject.keywordPlus | NEURAL-NETWORKS | - |
dc.subject.keywordPlus | VIRTUALIZATION | - |
dc.subject.keywordPlus | FAIR | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Theory & Methods | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.