A Reinforcement Learning-based Approach for Spontaneous Service Emergence in Pervasive Computing Environments

Abstract: In this paper, a reinforcement learning approach based on the creation of affinity relationships between users having similar preferences and interests is presented. This approach suits pervasive environments to promote computer-based human interactions for spontaneous service emergence. By mimicking the human immune system behavior for the implementation of pervasive applications, services or user interests are represented by agents that can establish relationships based on affinities. Affinity corresponds to the adequacy with which two services could bind to share common interest attributes. These affinities are adjusted or reinforced by users ’ satisfaction regarding their interaction and dynamic network condition changes