Performance impact of JobTracker failure in Hadoop
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Young-Pil | - |
dc.contributor.author | Hong, Cheol-Ho | - |
dc.contributor.author | Yoo, Chuck | - |
dc.date.accessioned | 2023-10-05T01:40:44Z | - |
dc.date.available | 2023-10-05T01:40:44Z | - |
dc.date.issued | 2015-05 | - |
dc.identifier.issn | 1074-5351 | - |
dc.identifier.issn | 1099-1131 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/68004 | - |
dc.description.abstract | In this paper, we analyze the performance impact of JobTracker failure in Hadoop. A JobTracker failure is a serious problem that affects the overall job processing performance. We describe the cause of failure and the system behaviors because of failed job processing in the Hadoop. On the basis of the analysis, we build a job completion time model that reflects failure effects. Our model is based on a stochastic process with a node crash probability. With our model, we run simulation of performance impact with very credible failure data available from USENIX called computer failure data repository that have been collected for past 9years. The results show that the performance impact is very severe in that the job completion time increases about four times typically, and in a worst case, it increases up to 68 times. Copyright (c) 2014 John Wiley & Sons, Ltd. | - |
dc.format.extent | 17 | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | WILEY | - |
dc.title | Performance impact of JobTracker failure in Hadoop | - |
dc.type | Article | - |
dc.identifier.doi | 10.1002/dac.2759 | - |
dc.identifier.bibliographicCitation | INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, v.28, no.7, pp 1265 - 1281 | - |
dc.description.isOpenAccess | Y | - |
dc.identifier.wosid | 000351605500004 | - |
dc.identifier.scopusid | 2-s2.0-84925345925 | - |
dc.citation.endPage | 1281 | - |
dc.citation.number | 7 | - |
dc.citation.startPage | 1265 | - |
dc.citation.title | INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS | - |
dc.citation.volume | 28 | - |
dc.type.docType | Article | - |
dc.publisher.location | 미국 | - |
dc.subject.keywordAuthor | Hadoop | - |
dc.subject.keywordAuthor | large-scale data processing | - |
dc.subject.keywordAuthor | failure analysis | - |
dc.subject.keywordAuthor | JobTracker | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.