ARTÍCULO
TITULO

Predicting I/O Performance in HPC Using Artificial Neural Networks

Jan Fabian Schmid    
Julian M. Kunkel    

Resumen

The prediction of file access times is an important part for the modeling of supercomputer's storage systems. These models can be used to develop analysis tools which support the users to integrate efficient I/O behavior.In this paper, we analyze and predict the access times of a Lustre file system from the client perspective. Therefore, we measure file access times in various test series and developed different models for predicting access times.  The evaluation shows that in models utilizing artificial neural networks the average prediciton error is about 30% smaller than in linear models. A phenomenon in the distribution of file access times is of particular interest: File accesses with identical parameters show several typical access times.The typical access times usually differ by orders of magnitude and can be explained with a different processing of the file accesses in the storage system - an alternative I/O path. We investigate a method to automatically determine the alternative I/O path and quantify the significance of knowledge about the internal processing. It is shown that the prediction error is improved significantly with this approach.

 Artículos similares

       
 
Yunfei Yang, Zhicheng Zhang, Jiapeng Zhao, Bin Zhang, Lei Zhang, Qi Hu and Jianglong Sun    
Resistance serves as a critical performance metric for ships. Swift and accurate resistance prediction can enhance ship design efficiency. Currently, methods for determining ship resistance encompass model tests, estimation techniques, and computational ... ver más

 
Fan Lin, Dengjie Chen, Cheng Liu and Jincheng He    
This study pioneered a non-destructive testing approach to evaluating the physicochemical properties of golden passion fruit by developing a platform to analyze the fruit?s electrical characteristics. By using dielectric properties, the method accurately... ver más
Revista: Applied Sciences

 
Naseer Muhammad Khan, Liqiang Ma, Muhammad Zaka Emad, Tariq Feroze, Qiangqiang Gao, Saad S. Alarifi, Li Sun, Sajjad Hussain and Hui Wang    
The brittleness index is one of the most integral parameters used in assessing rock bursts and catastrophic rock failures resulting from deep underground mining activities. Accurately predicting this parameter is crucial for effectively monitoring rock b... ver más
Revista: Water

 
Feifei He, Qinjuan Wan, Yongqiang Wang, Jiang Wu, Xiaoqi Zhang and Yu Feng    
Accurately predicting hydrological runoff is crucial for water resource allocation and power station scheduling. However, there is no perfect model that can accurately predict future runoff. In this paper, a daily runoff prediction method with a seasonal... ver más
Revista: Water

 
Haibo Chu, Zhuoqi Wang and Chong Nie    
Accurate and reliable monthly streamflow prediction plays a crucial role in the scientific allocation and efficient utilization of water resources. In this paper, we proposed a prediction framework that integrates the input variable selection method and ... ver más
Revista: Water