ARTÍCULO
TITULO

Exploiting the Performance Benefits of Storage Class Memory for HPC and HPDA Workflows

Michele Weiland    
Adrian Jackson    
Nick Johnson    
Mark Parsons    

Resumen

Byte-addressable storage class memory (SCM) is an upcoming technology that will transform the memory and storage hierarchy of HPC systems by dramatically reducing the latency gap between DRAM and persistent storage. In this paper, we discuss general SCM characteristics, including the different hardware configurations and data access mechanisms SCM is likely to provide. We outline the performance challenges I/O requirements place on traditional scientific workflows and present how data access through SCM can have a beneficial impact on the performance of such workflows, in particular those with large scale data dependencies. We describe the system software components that are required to enabled workflow and data aware resource allocation scheduling in order to optimise both system throughput and time to solution for individual applications; these include a data scheduler and data movers. We also present an illustration of the performance improvement potential of the technology, based on initial workflow performance benchmarks with I/O dependencies.

 Artículos similares

       
 
Georgios Chalkiadakis, Ioannis Ziogas, Michail Koutsmanis, Errikos Streviniotis, Costas Panagiotakis and Harris Papadakis    
In this paper, we develop a novel hybrid recommender system for the tourism domain, which combines (a) a Bayesian preferences elicitation component which operates by asking the user to rate generic images (corresponding to generic types of POIs) in order... ver más
Revista: Algorithms

 
Alberto Facchini, Adriana Morana, Luciano Mescia, Cosimo Campanella, Md Mizan Kabir Shuvo, Thierry Robin, Emmanuel Marin, Youcef Ouerdane, Aziz Boukenter and Sylvain Girard    
Research on optical amplifiers has highlighted how ionizing radiation negatively impacts the performance of erbium-doped fiber amplifiers (EDFAs), through the degradation of their gain. The amplitudes and kinetics of this degradation are mainly explained... ver más
Revista: Applied Sciences

 
Roopdeep Kaur, Gour Karmakar and Muhammad Imran    
In digital image processing, filtering noise is an important step for reconstructing a high-quality image for further processing such as object segmentation, object detection, and object recognition. Various image-denoising approaches, including median, ... ver más
Revista: Applied Sciences

 
Naoki Nishimura, Noriyoshi Sukegawa, Yuichi Takano and Jiro Iwanaga    
This paper examines the relationship between user pageview (PV) histories and their itemchoice behavior on an e-commerce website. We focus on PV sequences, which represent time series of the number of PVs for each user?item pair. We propose a shape-restr... ver más
Revista: Algorithms

 
Hew Cameron Merrett and Jao-Jia Horng    
In drinking water catchments, exploiting ecosystem services provided by stream buffers has the potential to complement conventional engineering solutions such as water treatment and reduce the overall public health risks to consumers. These stream buffer... ver más
Revista: Water