Resource Management for Processing Wide Area Data Streams on Supercomputers
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Chung | - |
dc.contributor.author | J. | - |
dc.contributor.author | Adhikari | - |
dc.contributor.author | M. | - |
dc.contributor.author | Srirama | - |
dc.contributor.author | S.N. | - |
dc.contributor.author | Jung, Eun Sung | - |
dc.contributor.author | E.-S. | - |
dc.contributor.author | Kettimuthu | - |
dc.contributor.author | R. | - |
dc.date.available | 2021-03-17T07:47:59Z | - |
dc.date.created | 2021-02-26 | - |
dc.date.issued | 2020 | - |
dc.identifier.issn | 1095-2055 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hongik/handle/2020.sw.hongik/12514 | - |
dc.description.abstract | Modern scientific instruments generate enormous amount of data. Typically, the data collected from the instruments are stored in one or more files that are then moved to a distant supercomputer for processing. The final results are sent back to the user. In order to make effective use of the time on expensive instruments, experimenters want to process the data as they are generated. They want to stream the data from instruments' memory directly to a supercomputer's memory for analysis. Since the compute nodes in a supercomputer are not connected directly to the wide area network, the data streams need to be passed through intermediate gateway nodes. As opposed to the best effort file transfers, data streaming applications require resources at a specific time for a specific period. In this paper, we present a system model for enabling data streaming through gateway nodes and an algorithm to efficiently allocate gateway node resources along with compute nodes. We evaluate the algorithm using real-world traces on the Chameleon Cloud. The results show that our system can schedule compute and gateway resources efficiently for streaming analysis. © 2020 IEEE. | - |
dc.publisher | Institute of Electrical and Electronics Engineers Inc. | - |
dc.title | Resource Management for Processing Wide Area Data Streams on Supercomputers | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Jung, Eun Sung | - |
dc.identifier.doi | 10.1109/ICCCN49398.2020.9209669 | - |
dc.identifier.scopusid | 2-s2.0-85093871779 | - |
dc.identifier.bibliographicCitation | Proceedings - International Conference on Computer Communications and Networks, ICCCN, v.2020-August | - |
dc.relation.isPartOf | Proceedings - International Conference on Computer Communications and Networks, ICCCN | - |
dc.citation.title | Proceedings - International Conference on Computer Communications and Networks, ICCCN | - |
dc.citation.volume | 2020-August | - |
dc.type.rims | ART | - |
dc.type.docType | Conference Paper | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scopus | - |
dc.subject.keywordAuthor | data streaming | - |
dc.subject.keywordAuthor | online resource provisioning | - |
dc.subject.keywordAuthor | wide area networks | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
94, Wausan-ro, Mapo-gu, Seoul, 04066, Korea02-320-1314
COPYRIGHT 2020 HONGIK UNIVERSITY. ALL RIGHTS RESERVED.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.