Hybrid Transactional/Analytical Processing Amplifies IO in LSM-trees
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Jongbin | - |
dc.contributor.author | Ahn, Jaechan | - |
dc.contributor.author | Lee, Kitaek | - |
dc.contributor.author | Ryu, Minsoo | - |
dc.contributor.author | Jung, Hyungsoo | - |
dc.date.accessioned | 2023-05-03T11:17:09Z | - |
dc.date.available | 2023-05-03T11:17:09Z | - |
dc.date.created | 2022-12-07 | - |
dc.date.issued | 2022-11 | - |
dc.identifier.issn | 2169-3536 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/185201 | - |
dc.description.abstract | The log-structured merge tree (LSM-tree) has become an essential component in many key-value systems and expanded its scope to full-fledged database engines (e.g., MyRocks). In the database landscape, vendors face growing customer demands for real-time analytic solutions to handle hybrid transactional/analytical processing (HTAP) workloads that pose significant challenges. Among the challenges is IO amplification that drives system designers to rethink write-optimized engines to survive HTAP loads. This paper follows the same philosophy, reexamines LSM-trees used for database systems, and rethinks IO amplification under HTAP loads to shed some light on practical remedies for upcoming challenges. We propose two practical techniques to alleviate IO amplification: 1) <italic>aligned compaction</italic> for reducing write amplification, 2) <italic>snapshot filters</italic> for reducing read amplification. The two techniques are lightweight (i.e., near-zero resource consumption) and are compatible with state-of-the-art methods. We integrated our techniques into RocksDB and demonstrated that the modified RocksDB exhibits reduced IO amplification under HTAP workloads with negligible resource consumption. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | Institute of Electrical and Electronics Engineers Inc. | - |
dc.title | Hybrid Transactional/Analytical Processing Amplifies IO in LSM-trees | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Ryu, Minsoo | - |
dc.contributor.affiliatedAuthor | Jung, Hyungsoo | - |
dc.identifier.doi | 10.1109/ACCESS.2022.3219859 | - |
dc.identifier.scopusid | 2-s2.0-85141620804 | - |
dc.identifier.wosid | 000888965600001 | - |
dc.identifier.bibliographicCitation | IEEE Access, v.10, pp.117626 - 117637 | - |
dc.relation.isPartOf | IEEE Access | - |
dc.citation.title | IEEE Access | - |
dc.citation.volume | 10 | - |
dc.citation.startPage | 117626 | - |
dc.citation.endPage | 117637 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | Y | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.subject.keywordPlus | STORAGE ENGINE | - |
dc.subject.keywordAuthor | Compaction | - |
dc.subject.keywordAuthor | Databases | - |
dc.subject.keywordAuthor | Engines | - |
dc.subject.keywordAuthor | Optimization | - |
dc.subject.keywordAuthor | Real-time systems | - |
dc.subject.keywordAuthor | Navigation | - |
dc.subject.keywordAuthor | Layout | - |
dc.subject.keywordAuthor | Amplifiers | - |
dc.subject.keywordAuthor | LSM-tree | - |
dc.subject.keywordAuthor | key-value store | - |
dc.subject.keywordAuthor | MVCC | - |
dc.subject.keywordAuthor | HTAP | - |
dc.subject.keywordAuthor | I | - |
dc.subject.keywordAuthor | O amplification | - |
dc.identifier.url | https://ieeexplore.ieee.org/document/9940292 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.