Inicio  /  Algorithms  /  Vol: 16 Par: 11 (2023)  /  Artículo
ARTÍCULO
TITULO

Finding Bottlenecks in Message Passing Interface Programs by Scalable Critical Path Analysis

Vladimir Korkhov    
Ivan Gankevich    
Anton Gavrikov    
Maria Mingazova    
Ivan Petriakov    
Dmitrii Tereshchenko    
Artem Shatalin and Vitaly Slobodskoy    

Resumen

Bottlenecks and imbalance in parallel programs can significantly affect performance of parallel execution. Finding these bottlenecks is a key issue in performance analysis of MPI programs especially on a large scale. One of the ways to discover bottlenecks is to analyze the critical path of the parallel program: the longest execution path in the program activity graph. There are a number of methods of finding the critical path; however, most of them suffer a performance drop when scaled. In this paper, we analyze several methods of critical path finding based on classical Dijkstra and Delta-stepping algorithms along with the proposed algorithm based on topological sorting. Corresponding algorithms for each approach are presented including additional enhancements for increasing performance. The implementation of the algorithms and resulting performance for several benchmark applications (NAS Parallel Benchmarks, CP2K, OpenFOAM, LAMMPS, and MiniFE) are analyzed and discussed.

 Artículos similares

       
 
Yu-Ting Tsai and Ching-Piao Tsai    
Deep learning techniques have revolutionized the field of artificial intelligence by enabling accurate predictions of complex natural scenarios. This paper proposes a novel convolutional neural network (CNN) model that involves deep learning technologies... ver más

 
Mohamed Chetoui and Moulay A. Akhloufi    
The simultaneous advances in deep learning and the Internet of Things (IoT) have benefited distributed deep learning paradigms. Federated learning is one of the most promising frameworks, where a server works with local learners to train a global model. ... ver más
Revista: Computers

 
Achintya Kumar Sarkar and Zheng-Hua Tan    
Deep representation learning has gained significant momentum in advancing text-dependent speaker verification (TD-SV) systems. When designing deep neural networks (DNN) for extracting bottleneck (BN) features, the key considerations include training targ... ver más
Revista: Acoustics

 
Sichao Zhuo, Xiaoming Zhang, Ziyi Chen, Wei Wei, Fang Wang, Quanlong Li and Yufan Guan    
With the development of Industry 4.0, although some smart meters have appeared on the market, traditional mechanical meters are still widely used due to their long-standing presence and the difficulty of modifying or replacing them in large quantities. M... ver más
Revista: Applied Sciences

 
Qinge Wu, Zhichao Song, Hu Chen, Yingbo Lu and Lintao Zhou    
Crack identification plays a vital role in preventive maintenance strategies during highway pavement maintenance. Therefore, accurate identification of cracks in highway pavement images is the key to highway maintenance work. In this paper, an improved U... ver más
Revista: Applied Sciences