ARTÍCULO
TITULO

Quality of Experience in Cyber-Physical Social Systems Based on Reinforcement Learning and Game Theory

Eirini Eleni Tsiropoulou    
George Kousis    
Athina Thanou    
Ioanna Lykourentzou and Symeon Papavassiliou    

Resumen

This paper addresses the problem of museum visitors’ Quality of Experience (QoE) optimization by viewing and treating the museum environment as a cyber-physical social system. To achieve this goal, we harness visitors’ internal ability to intelligently sense their environment and make choices that improve their QoE in terms of which the museum touring option is the best for them and how much time to spend on their visit. We model the museum setting as a distributed non-cooperative game where visitors selfishly maximize their own QoE. In this setting, we formulate the problem of Recommendation Selection and Visiting Time Management (RSVTM) and propose a two-stage distributed algorithm based on game theory and reinforcement learning, which learns from visitor behavior to make on-the-fly recommendation selections that maximize visitor QoE. The proposed framework enables autonomic visitor-centric management in a personalized manner and enables visitors themselves to decide on the best visiting strategies. Experimental results evaluating the performance of the proposed RSVTM algorithm under realistic simulation conditions indicate the high operational effectiveness and superior performance when compared to other recommendation approaches. Our results constitute a practical alternative for museums and exhibition spaces meant to enhance visitor QoE in a flexible, efficient, and cost-effective manner.

 Artículos similares

       
 
?tefica Mrvelj and Marko Matulin    
In the quest to optimize user experience, network, and service, providers continually seek to deliver high-quality content tailored to individual preferences. However, predicting user perception of quality remains a challenging task, given the subjective... ver más
Revista: Future Internet

 
Eirini Liotou, Dionysis Xenakis, Vasiliki Georgara, Georgios Kourouniotis and Lazaros Merakos    
Dynamic Adaptive Streaming over HTTP (DASH) has prevailed as the dominant way of video transmission over the Internet. This technology is based on receiving small sequential video segments from a server. However, one challenge that has not been adequatel... ver más
Revista: Future Internet

 
Nafi Ahmad, Abdul Wahab, John Schormans and Ali Adib Arnab    
In this paper, utilising real-internet traffic data, we modified a popular network emulator to better imitate real network traffic and studied its subjective and objective implications on QoE for cloud-gaming apps. Subjective QoE evaluation was then used... ver más
Revista: Future Internet

 
Agbotiname Lucky Imoize, Friday Udeji, Joseph Isabona and Cheng-Chi Lee    
Mobile broadband (MBB) services in Lagos, Nigeria are marred with poor signal quality and inconsistent user experience, which can result in frustrated end-users and lost revenue for service providers. With the introduction of 5G, it is becoming more nece... ver más
Revista: Future Internet

 
Adrian Sfichi, Eduard Zadobrischi, Narcisa Sfichi, Marian Badeli?a and Mihai Medrihan    
This research aims to highlight the importance and notoriety that an application based on heuristic algorithms can have in the field of e-commerce in the construction niche, guiding us on participatory economy principles. The expansion of e-commerce has ... ver más
Revista: Future Internet