Distributed MPC for large scale systems using agent-based reinforcement learning

Presentado al 12th IFAC Symposium on Large-Scale Systems: Theory and Applications celebrado en Francia en 2010.In the present work, distributed control and artificial intelligence are combined in a control architecture for Large Scale Systems (LSS). The aim of this architecture is to provide a general structure and methodology to perform optimal control in networked distributed environments where multiple dependencies between sub-systems are found. Often these dependencies or connections represent control variables so the distributed control has to be consistent for both subsystems and the optimal value of these variables has to accomplish a common goal. The aim of the research described in this paper is to exploit the attractive features of MPC (meaningful objective functions and constraints) in a distributed implementation combining learning techniques to perform the negotiation of these variables in a cooperative Multi Agent environment and over a Multi Agent platform to provide speed, scalability, and computational effort reduction. This approach is based on negotiation, cooperation and learning. Results of the application of this architecture to a small drinking water network show that the resulting trajectories of the levels in tanks (control variables) can be acceptable compared to the centralized solution. The application to a real network (the Barcelona case) is currently under development.This work was supported by the project 'Analysis and Design of distributed optimal control strategies applied to large-scale WATer systems MANagement' (4808). The authors wish to thank the support received by WIDE-224168-FP7-ICT-2007-2 project and WATMAN ref. DPI2009-13744 of Spanish Ministry of Education. First author is supported by CONACYT and partially supported by ITESCA.Peer Reviewe