Towards Access Pattern Prediction for Big Data Applications
- Authors
- Kim, C.; Son, Y.; Kim, S.
- Issue Date
- Oct-2022
- Publisher
- IEEE Computer Society
- Citation
- International Conference on ICT Convergence, v.2022-October, pp 1577 - 1580
- Pages
- 4
- Journal Title
- International Conference on ICT Convergence
- Volume
- 2022-October
- Start Page
- 1577
- End Page
- 1580
- URI
- https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/60823
- DOI
- 10.1109/ICTC55196.2022.9952775
- ISSN
- 2162-1233
- Abstract
- The importance of data is becoming more and more prominent as modern applications produce a large amount of data. It is becoming common for applications to produce and process gigabytes or even terabytes of data. To improve the performance of data-intensive applications, the underlying storage systems utilize the I/O characteristics of applications such as access patterns to improve the storage performance. For example, existing storage schemes store frequently accessed data in high performance storage devices such as NVMe SSDs for low latency and stores rarely access data in low performance but high capacity storage devices such as tape storage for cost-efficiency. Thus, as the importance of data arises, it is important to understand the I/O characteristics of applications. In this paper, we propose an access pattern prediction scheme to understand the I/O characteristics of applications and utilize the characteristics for fast I/O processing. Our scheme uses the application history and machine learning algorithm to accurately predict the pattern. To do this, we first utilize a system log to collect access pattern data of applications. Then, by using the logs, we set up a machine learning based prediction model using the long short-term memory (LSTM) algorithm. Finally, when the application is executed repeatedly, we use the prediction model to predict the I/O requests of the application which can be used to improve the storage performance. Evaluation result using a real big data application shows that the proposed scheme can accurately predict the access pattern.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Software > School of Computer Science and Engineering > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/60823)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.