ARTÍCULO
TITULO

Evaluating Task-Level CPU Efficiency for Distributed Stream Processing Systems

Johannes Rank    
Jonas Herget    
Andreas Hein and Helmut Krcmar    

Resumen

Big Data and primarily distributed stream processing systems (DSPSs) are growing in complexity and scale. As a result, effective performance management to ensure that these systems meet the required service level objectives (SLOs) is becoming increasingly difficult. A key factor to consider when evaluating the performance of a DSPS is CPU efficiency, which is the ratio of the workload processed by the system to the CPU resources invested. In this paper, we argue that developing new performance tools for creating DSPSs that can fulfill SLOs while using minimal resources is crucial. This is especially significant in edge computing situations where resources are limited and in large cloud deployments where conserving power and reducing computing expenses are essential. To address this challenge, we present a novel task-level approach for measuring CPU efficiency in DSPSs. Our approach supports various streaming frameworks, is adaptable, and comes with minimal overheads. This enables developers to understand the efficiency of different DSPSs at a granular level and provides insights that were not previously possible.

 Artículos similares

       
 
Somdip Dey, Samuel Isuwa, Suman Saha, Amit Kumar Singh and Klaus McDonald-Maier    
Most modern mobile cyber-physical systems such as smartphones come equipped with multi-processor systems-on-chip (MPSoCs) with variant computing capacity both to cater to performance requirements and reduce power consumption when executing an application... ver más
Revista: Future Internet

 
Hui Yan and Chaoyuan Cui    
Cache side channel attacks, as a type of cryptanalysis, seriously threaten the security of the cryptosystem. These attacks continuously monitor the memory addresses associated with the victim?s secret information, which cause frequent memory access on th... ver más
Revista: Future Internet

 
Evangelos Rozos, Panayiotis Dimitriadis and Vasilis Bellos    
Machine learning has been employed successfully as a tool virtually in every scientific and technological field. In hydrology, machine learning models first appeared as simple feed-forward networks that were used for short-term forecasting, and have evol... ver más
Revista: Hydrology

 
Mohammad Naser Lessani, Jiqiu Deng and Zhiyong Guo    
Multiple geographical feature label placement (MGFLP) is an NP-hard problem that can negatively influence label position accuracy and the computational time of the algorithm. The complexity of such a problem is compounded as the number of features for la... ver más

 
Chao Zhou and Tao Zhang    
In real applications, massive data with graph structures are often incomplete due to various restrictions. Therefore, graph data imputation algorithms have been widely used in the fields of social networks, sensor networks, and MRI to solve the graph dat... ver más
Revista: Future Internet