Improving sparse data movement performance using multiple paths on the Blue Gene/Q supercomputer
DC Field | Value | Language |
---|---|---|
dc.contributor.author | 정은성 | - |
dc.date.available | 2020-07-10T07:28:01Z | - |
dc.date.created | 2020-07-08 | - |
dc.date.issued | 2015-01-15 | - |
dc.identifier.issn | 0167-8191 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hongik/handle/2020.sw.hongik/10443 | - |
dc.description.abstract | In situ analysis has been proposed as a promising solution to glean faster insights and reduce the amount of data to storage. A critical challenge here is that the reduced dataset is typically located on a subset of the nodes and needs to be written out to storage. Data coupling in multiphysics codes also exhibits a sparse data movement pattern wherein data movement occurs among a subset of nodes. We evaluate the performance of data movement for sparse data patterns on the IBM Blue Gene/Q supercomputing system "Mira" and identify performance bottlenecks. We propose a multipath data movement algorithm for sparse data patterns based on an adaptation of a maximum flow algorithm together with breadth-first search that fully exploits all the underlying data paths and I/O nodes to improve data movement. We demonstrate the efficacy of our solutions through a set of microbenchmarks and application benchmarks on Mira scaling up to 131,072 compute cores. The results show that our approach achieves up to 5 x improvement in achievable throughput compared with the default mechanisms. (C) 2015 Elsevier B.V. All rights reserved. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.language.iso | en | - |
dc.publisher | ELSEVIER SCIENCE BV | - |
dc.title | Improving sparse data movement performance using multiple paths on the Blue Gene/Q supercomputer | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | 정은성 | - |
dc.identifier.bibliographicCitation | PARALLEL COMPUTING, v.51, no.1, pp.3 - 16 | - |
dc.relation.isPartOf | PARALLEL COMPUTING | - |
dc.citation.title | PARALLEL COMPUTING | - |
dc.citation.volume | 51 | - |
dc.citation.number | 1 | - |
dc.citation.startPage | 3 | - |
dc.citation.endPage | 16 | - |
dc.type.rims | ART | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
94, Wausan-ro, Mapo-gu, Seoul, 04066, Korea02-320-1314
COPYRIGHT 2020 HONGIK UNIVERSITY. ALL RIGHTS RESERVED.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.