ARTÍCULO
TITULO

The Optimization Strategies on Clarification of the Misconceptions of Big Data Processing in Dynamic and Opportunistic Environments

Wei Li and Maolin Tang    

Resumen

This paper identifies four common misconceptions about the scalability of volunteer computing on big data problems. The misconceptions are then clarified by analyzing the relationship between scalability and the impact factors including the problem size of big data, the heterogeneity and dynamics of volunteers, and the overlay structure. This paper proposes optimization strategies to find the optimal overlay for the given big data problem. This paper forms multiple overlays to optimize the performance of individual steps in terms of MapReduce paradigm. The optimization is to achieve the maximum overall performance by using a minimum number of volunteers, not overusing resources. This paper has demonstrated that the simulations on the concerned factors can fast find the optimization points. This paper concludes that always welcoming more volunteers is an overuse of available resources because they do not always bring benefit to the overall performance. Finding optimal use of volunteers are possible for the given big data problems even on the dynamics and opportunism of volunteers.

 Artículos similares

       
 
Lin Ma, Fuheng Ma, Wenhan Cao, Benxing Lou, Xiang Luo, Qiang Li and Xiaoniao Hao    
A original strategy for optimizing the inversion of concrete dam parameters based on the multi-strategy improved Sooty Tern Optimization algorithm (MSSTOA) is proposed to address the issues of low efficiency, low accuracy, and poor optimizing performance... ver más
Revista: Water

 
Jun Li, Javed Iqbal Tanoli, Miao Zhou and Filip Gurkalo    
Based on an improved genetic algorithm and debris flow disaster monitoring network, this study examines the monitoring and early warning method of debris flow expansion behavior, divides the risk of debris flow disaster, and provides a scientific basis f... ver más
Revista: Water

 
Mo Fan, Massoomeh Hedayati Marzbali, Aldrin Abdullah and Mohammad Javad Maghsoodi Tilaki    
Contemporary urban development places a critical emphasis on pedestrian environments, especially in historic cities like George Town, which is a UNESCO World Heritage Site in Malaysia. Although survey questionnaires effectively captured public perception... ver más
Revista: Urban Science

 
Sherin M. Omran, Wessam H. El-Behaidy and Aliaa A. A. Youssif    
A cryptocurrency is a non-centralized form of money that facilitates financial transactions using cryptographic processes. It can be thought of as a virtual currency or a payment mechanism for sending and receiving money online. Cryptocurrencies have gai... ver más

 
Andreja Jonoski, Tanvir Ahmed, Mohammad N. Almasri and Muath Abu-Saadah    
Groundwater is a crucial resource for water supply and irrigation in many parts of the world, especially in the Middle East. The Eocene aquifer, located in the northern part of the West Bank, Palestine, is threatened by unsustainable groundwater abstract... ver más
Revista: Water