Inicio  /  Future Internet  /  Vol: 15 Par: 8 (2023)  /  Artículo
ARTÍCULO
TITULO

Towards Efficient Resource Allocation for Federated Learning in Virtualized Managed Environments

Fotis Nikolaidis    
Moysis Symeonides and Demetris Trihinas    

Resumen

Federated learning (FL) is a transformative approach to Machine Learning that enables the training of a shared model without transferring private data to a central location. This decentralized training paradigm has found particular applicability in edge computing, where IoT devices and edge nodes often possess limited computational power, network bandwidth, and energy resources. While various techniques have been developed to optimize the FL training process, an important question remains unanswered: how should resources be allocated in the training workflow? To address this question, it is crucial to understand the nature of these resources. In physical environments, the allocation is typically performed at the node level, with the entire node dedicated to executing a single workload. In contrast, virtualized environments allow for the dynamic partitioning of a node into containerized units that can adapt to changing workloads. Consequently, the new question that arises is: how can a physical node be partitioned into virtual resources to maximize the efficiency of the FL process? To answer this, we investigate various resource allocation methods that consider factors such as computational and network capabilities, the complexity of datasets, as well as the specific characteristics of the FL workflow and ML backend. We explore two scenarios: (i) running FL over a finite number of testbed nodes and (ii) hosting multiple parallel FL workflows on the same set of testbed nodes. Our findings reveal that the default configurations of state-of-the-art cloud orchestrators are sub-optimal when orchestrating FL workflows. Additionally, we demonstrate that different libraries and ML models exhibit diverse computational footprints. Building upon these insights, we discuss methods to mitigate computational interferences and enhance the overall performance of the FL pipeline execution.

 Artículos similares

       
 
Abtin Baghdadi, Mahmoud Heristchian, Lukas Ledderose and Harald Kloft    
The efficient utilization of robotic construction of structures requires a review of structural material, elements and details, while traditional construction methods face difficulties in producing some dry concrete joints, robotic methods can manufactur... ver más
Revista: Buildings

 
Vaia I. Kontopoulou, Athanasios D. Panagopoulos, Ioannis Kakkos and George K. Matsopoulos    
In the broad scientific field of time series forecasting, the ARIMA models and their variants have been widely applied for half a century now due to their mathematical simplicity and flexibility in application. However, with the recent advances in the de... ver más
Revista: Future Internet

 
Alexander Rolwes and Klaus Böhm    
Geospatial factors, because of their spatio-temporal correlations with demand-driven limited service, offer to improve urban planning decisions and expand the knowledge base in cities. Spatio-temporal analyses require an efficient and comprehensible visu... ver más

 
Soumya Prakash Otta, Subhrakanta Panda, Maanak Gupta and Chittaranjan Hota    
The unauthorized usage of various services and resources in cloud computing is something that must be protected against. Authentication and access control are the most significant concerns in cloud computing. Several researchers in this field suggest num... ver más
Revista: Future Internet

 
Panagiotis Gkonis, Anastasios Giannopoulos, Panagiotis Trakadas, Xavi Masip-Bruin and Francesco D?Andria    
The rapid growth in the number of interconnected devices on the Internet (referred to as the Internet of Things?IoT), along with the huge volume of data that are exchanged and processed, has created a new landscape in network design and operation. Due to... ver más
Revista: Future Internet