Hybrid Transactional/Analytical Processing Amplifies IO in LSM-treesopen access
- Authors
- Kim, Jongbin; Ahn, Jaechan; Lee, Kitaek; Ryu, Minsoo; Jung, Hyungsoo
- Issue Date
- Nov-2022
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- Compaction; Databases; Engines; Optimization; Real-time systems; Navigation; Layout; Amplifiers; LSM-tree; key-value store; MVCC; HTAP; I; O amplification
- Citation
- IEEE Access, v.10, pp.117626 - 117637
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE Access
- Volume
- 10
- Start Page
- 117626
- End Page
- 117637
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/185201
- DOI
- 10.1109/ACCESS.2022.3219859
- ISSN
- 2169-3536
- Abstract
- The log-structured merge tree (LSM-tree) has become an essential component in many key-value systems and expanded its scope to full-fledged database engines (e.g., MyRocks). In the database landscape, vendors face growing customer demands for real-time analytic solutions to handle hybrid transactional/analytical processing (HTAP) workloads that pose significant challenges. Among the challenges is IO amplification that drives system designers to rethink write-optimized engines to survive HTAP loads. This paper follows the same philosophy, reexamines LSM-trees used for database systems, and rethinks IO amplification under HTAP loads to shed some light on practical remedies for upcoming challenges. We propose two practical techniques to alleviate IO amplification: 1) <italic>aligned compaction</italic> for reducing write amplification, 2) <italic>snapshot filters</italic> for reducing read amplification. The two techniques are lightweight (i.e., near-zero resource consumption) and are compatible with state-of-the-art methods. We integrated our techniques into RocksDB and demonstrated that the modified RocksDB exhibits reduced IO amplification under HTAP workloads with negligible resource consumption.
- Files in This Item
-
- Appears in
Collections - 서울 공과대학 > 서울 컴퓨터소프트웨어학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/185201)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.