ARTÍCULO
TITULO

State of the Art and Future Trends in Data Reduction for High-Performance Computing

Kira Duwe    
Jakob Lüttgau    
Georgiana Mania    
Jannek Squar    
Anna Fuchs    
Michael Kuhn    
Eugen Betke    
Thomas Ludwig    

Resumen

Research into data reduction techniques has gained popularity in recent years as storage capacity and performance become a growing concern. This survey paper provides an overview of leveraging points found in high-performance computing (HPC) systems and suitable mechanisms to reduce data volumes. We present the underlying theories and their application throughout the HPC stack and also discuss related hardware acceleration and reduction approaches. After introducing relevant use-cases, an overview of modern lossless and lossy compression algorithms and their respective usage at the application and file system layer is given. In anticipation of their increasing relevance for adaptive and in situ approaches, dimensionality reduction techniques are summarized with a focus on non-linear feature extraction. Adaptive approaches and in situ compression algorithms and frameworks follow. The key stages and new opportunities to deduplication are covered next. An unconventional but promising method is recomputation, which is proposed at last. We conclude the survey with an outlook on future developments.

 Artículos similares

       
 
Grazia Leonzio    
Due to the increase of carbon dioxide emissions, a target for their reduction has been defined in the Paris Agreement for 2030. This topic is extremely important, and urgent actions are required so that the attention of the scientific community is mainly... ver más
Revista: Applied Sciences

 
Ahmed Abouelsaad, Greg White and Ali Jamshidi    
Asphalt mixtures age during service in the field, primarily as the result of chemical changes in the bituminous binder phase. The ageing phenomenon changes the properties of the asphalt mixture, including the stiffness modulus, the resistance to deformat... ver más
Revista: Infrastructures

 
Elias Dimitriou, Andreas Efstratiadis, Ioanna Zotou, Anastasios Papadopoulos, Theano Iliopoulou, Georgia-Konstantina Sakki, Katerina Mazi, Evangelos Rozos, Antonios Koukouvinos, Antonis D. Koussis, Nikos Mamassis and Demetris Koutsoyiannis    
Storm Daniel initiated on 3 September 2023, over the Northeastern Aegean Sea, causing extreme rainfall levels for the following four days, reaching an average of about 360 mm over the Peneus basin, in Thessaly, Central Greece. This event led to extensive... ver más
Revista: Water

 
Xiaobing Xu and Yaping Zhang    
Running posture estimation is a specialized task in human pose estimation that has received relatively little research attention due to the lack of appropriate datasets. To address this issue, this paper presents the construction of a new benchmark datas... ver más
Revista: Applied Sciences

 
Zahid Masood, Muhammad Usama, Shahroz Khan, Konstantinos Kostas and Panagiotis D. Kaklis    
Generative models offer design diversity but tend to be computationally expensive, while non-generative models are computationally cost-effective but produce less diverse and often invalid designs. However, the limitations of non-generative models can be... ver más