ARTÍCULO
TITULO

Survey of Storage Systems for High-Performance Computing

Jakob Lüttgau    
Michael Kuhn    
Kira Duwe    
Yevhen Alforov    
Eugen Betke    
Julian Kunkel    
Thomas Ludwig    

Resumen

In current supercomputers, storage is typically provided by parallel distributed file systems for hot data and tape archives for cold data. These file systems are often compatible with local file systems due to their use of the POSIX interface and semantics, which eases development and debugging because applications can easily run both on workstations and supercomputers. There is a wide variety of file systems to choose from, each tuned for different use cases and implementing different optimizations. However, the overall application performance is often held back by I/O bottlenecks due to insufficient performance of file systems or I/O libraries for highly parallel workloads. Performance problems are dealt with using novel storage hardware technologies as well as alternative I/O semantics and interfaces. These approaches have to be integrated into the storage stack seamlessly to make them convenient to use. Upcoming storage systems abandon the traditional POSIX interface and semantics in favor of alternative concepts such as object and key-value storage; moreover, they heavily rely on technologies such as NVM and burst buffers to improve performance. Additional tiers of storage hardware will increase the importance of hierarchical storage management. Many of these changes will be disruptive and require application developers to rethink their approaches to data management and I/O. A thorough understanding of today's storage infrastructures, including their strengths and weaknesses, is crucially important for designing and implementing scalable storage systems suitable for demands of exascale computing.

 Artículos similares

       
 
Tong Jiang, Xun Pei, Wenxue Wang, Longfei Li and Shihao Guo    
The tailwater tunnel of the Wuyue pumped storage power station is located in bedrock and extends to depths between tens and hundreds of meters. It is impossible to analyze and evaluate the whole engineering area from geological exploration data, and the ... ver más
Revista: Applied Sciences

 
Lars Lundberg and Håkan Grahn    
The availability of large amounts of data in combination with Big Data analytics has transformed many application domains. In this paper, we provide insights into how the area has developed in the last decade. First, we identify seven major application a... ver más
Revista: Algorithms

 
Robert Antwi, James Dzisi Gadze, Eric Tutu Tchao, Axel Sikora, Henry Nunoo-Mensah, Andrew Selasi Agbemenu, Kwame Opunie-Boachie Obour Agyekum, Justice Owusu Agyemang, Dominik Welte and Eliel Keelson    
The increase of the Internet of Things (IoT) calls for secure solutions for industrial applications. The security of IoT can be potentially improved by blockchain. However, blockchain technology suffers scalability issues which hinders integration with I... ver más
Revista: Algorithms

 
Kira Duwe,Jakob Lüttgau,Georgiana Mania,Jannek Squar,Anna Fuchs,Michael Kuhn,Eugen Betke,Thomas Ludwig     Pág. 4 - 36
Research into data reduction techniques has gained popularity in recent years as storage capacity and performance become a growing concern. This survey paper provides an overview of leveraging points found in high-performance computing (HPC) systems and ... ver más

 
Laman Hamidova     Pág. 20 - 25
The paper deals with the relationship between ethnobotanical documentation tables and database management system for ethnobotany. Ethnobotany is a scientific investigation of the connection among plants and individuals. The need of right approaching this... ver más