A P2P approach to resource discovery in on-line monitoring of Grid workflows

On-line monitoring of Grid workflows is challenging since workflows are loosely coupled and highly dynamic. An efficient mechanism of automatic resource discovery is needed in order to discover new producers of workflow monitoring data fast. However, currently used Grid information systems are not suitable for this due to insufficient performance characteristics. We propose to associate the monitoring infrastructure with a P2P DHT infrastructure in order to achieve the automatic resource discovery wherein consumers of monitoring data can be notified fast about new producers. In our solution, the consumer of monitoring data can subscribe to any monitoring endpoint and the automatic resource discovery is handled transparently. We evaluate performance of the presented solution, and demonstrated a case study scenario of monitoring of a traffic management workflow