Inicio  /  Future Internet  /  Vol: 15 Par: 8 (2023)  /  Artículo
ARTÍCULO
TITULO

Towards Efficient Resource Allocation for Federated Learning in Virtualized Managed Environments

Fotis Nikolaidis    
Moysis Symeonides and Demetris Trihinas    

Resumen

Federated learning (FL) is a transformative approach to Machine Learning that enables the training of a shared model without transferring private data to a central location. This decentralized training paradigm has found particular applicability in edge computing, where IoT devices and edge nodes often possess limited computational power, network bandwidth, and energy resources. While various techniques have been developed to optimize the FL training process, an important question remains unanswered: how should resources be allocated in the training workflow? To address this question, it is crucial to understand the nature of these resources. In physical environments, the allocation is typically performed at the node level, with the entire node dedicated to executing a single workload. In contrast, virtualized environments allow for the dynamic partitioning of a node into containerized units that can adapt to changing workloads. Consequently, the new question that arises is: how can a physical node be partitioned into virtual resources to maximize the efficiency of the FL process? To answer this, we investigate various resource allocation methods that consider factors such as computational and network capabilities, the complexity of datasets, as well as the specific characteristics of the FL workflow and ML backend. We explore two scenarios: (i) running FL over a finite number of testbed nodes and (ii) hosting multiple parallel FL workflows on the same set of testbed nodes. Our findings reveal that the default configurations of state-of-the-art cloud orchestrators are sub-optimal when orchestrating FL workflows. Additionally, we demonstrate that different libraries and ML models exhibit diverse computational footprints. Building upon these insights, we discuss methods to mitigate computational interferences and enhance the overall performance of the FL pipeline execution.

 Artículos similares

       
 
Vaia I. Kontopoulou, Athanasios D. Panagopoulos, Ioannis Kakkos and George K. Matsopoulos    
In the broad scientific field of time series forecasting, the ARIMA models and their variants have been widely applied for half a century now due to their mathematical simplicity and flexibility in application. However, with the recent advances in the de... ver más
Revista: Future Internet

 
Alexander Rolwes and Klaus Böhm    
Geospatial factors, because of their spatio-temporal correlations with demand-driven limited service, offer to improve urban planning decisions and expand the knowledge base in cities. Spatio-temporal analyses require an efficient and comprehensible visu... ver más

 
Abtin Baghdadi, Mahmoud Heristchian, Lukas Ledderose and Harald Kloft    
The efficient utilization of robotic construction of structures requires a review of structural material, elements and details, while traditional construction methods face difficulties in producing some dry concrete joints, robotic methods can manufactur... ver más
Revista: Buildings

 
Mengyue Ding, Yan Song and Yike Hu    
The COVID-19 pandemic has led to a surge in the use of self-service facilities (SSFs) in residential areas worldwide. Previous studies on SSFs mainly focused on their application in commercial or other scenarios. However, SSFs in residential areas have n... ver más
Revista: Buildings

 
Rana Abdollahi Rizi, Hamed Sangin, Kiana Haghighatnejad Chobari, Ahmad Eltaweel and Robyn Phipps    
The future of building envelope design lies in smart adaptation. The current literature overlooks the crucial integration of airflow, ventilation and daylighting in adaptive façade design. Moreover, it neglects the occupants? locations, activities and in... ver más
Revista: Buildings