Reinforcement learning based autonomic virtual machine management in clouds

This conference paper was published in the IEEE Xplore [ © 2016 IEEE] and the definite version is available at : http://doi.org/10.1109/ICIEV.2016.7760166 The Journal's website is at: http://ieeexplore.ieee.org/document/7760166/Cloud computing is a rapidly emerging field, services and applications are more or less 24/7. Resource dimensioning in this field is a great issue. Research is already going on to imply reinforcement learning to automate decision making process in case of addition, reduction, migration and maintenance of the Virtual Machines (VM) to balance the service level performance and VM management cost. Models have been proposed in this case based on Q-learning, a very popular reinforcement learning technique that is used to find optimal action selection policy for any finite Markov Decision Process (MDP). In this paper we propose to work with the challenges like proper initialization of the early stages, designing the states, actions, transitions using Markov Decision Process (MDP) and solving the MDP with two popular reinforcement learning techniques, Q-learning and SARSA(Λ).Publishe