Dynamic resource management for efficient utilization of multitasking GPUs
- Authors
- Park; J.J.K.; Park, Yongjun; Y.; Mahlke; S.
- Issue Date
- Jun-2017
- Publisher
- ASSOC COMPUTING MACHINERY
- Keywords
- Graphics Processing Unit; Multitasking; Resource Management
- Citation
- International Conference on Architectural Support for Programming Languages and Operating Systems - ASPLOS, v.Part F127193, no.2, pp.527 - 540
- Journal Title
- International Conference on Architectural Support for Programming Languages and Operating Systems - ASPLOS
- Volume
- Part F127193
- Number
- 2
- Start Page
- 527
- End Page
- 540
- URI
- https://scholarworks.bwise.kr/hongik/handle/2020.sw.hongik/13269
- DOI
- 10.1145/3037697.3037707
- ISSN
- 0163-5980
- Abstract
- As graphics processing units (GPUs) are broadly adopted, running multiple applications on a GPU at the same time is beginning to attract wide attention. Recent proposals on multitasking GPUs have focused on either spatial multitasking, which partitions GPU resource at a streaming multiprocessor (SM) granularity, or simultaneous multikernel (SMK), which runs multiple kernels on the same SM. However, multitasking performance varies heavily depending on the resource partitions within each scheme, and the application mixes. In this paper, we propose GPUMaestro that performs dynamic resource management for efficient utilization of multitasking GPUs. GPU Maestro can discover the best performing GPU resource partition exploiting both spatial multitasking and SMK. Furthermore, dynamism within a kernel and interference between the kernels are automatically considered because GPU Maestro finds the best performing partition through direct measurements. Evaluations show that GPU Maestro can improve average system throughput by 20.2% and 13.9% over the baseline spatial multitasking and SMK, respectively.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Electronic & Electrical Engineering > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hongik/handle/2020.sw.hongik/13269)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.