Coordinating Agents ’ Meta-Level Control

Embedded systems consisting of collaborating agents capable of interacting with their environment are be-coming ubiquitous. It is crucial for these systems to be able to adapt to the dynamic and uncertain characteris-tics of an open environment. The question of when this adaptation process should be done and how much effort should be invested in the adaptation becomes especially challenging in the context of multi-agent systems. We present a generalized agent framework for meta-level control called GeMEC. We describe GEMEC’s decen-tralized Markov Decision Process (DEC-MDP)-based model for decision making in Netrads, a tornado track-ing application. This model will capture interactions where meta-level decisions made in one agent’s MDP can affect meta-level MDPs of other agents. The cost of meta-level control can be controlled by constructing and evaluating the DEC-MDPs offline