Integration of Compute-Intensive Tasks into Scientific Workflows in BeesyCluster

Abstract. The paper presents design, implementation details and simulations of scientic workows involving compute-intensive tasks on clusters and PCs. The author has incorporated support for scientic workows into previously devel-oped J2EE-based BeesyCluster, deployed at Academic Computer Center Gdansk Poland on large HPC resources including a large 288-processor Itanium2 clus-ter. BeesyCluster allows users to manage various accounts on clusters/PCs via WWW/Web Services, run shell interactively, compile, queue, run tasks, publish services for other users, work in teams. A frequent scenario in HPC computing is analyzed, in which a workow is combined from tasks offered by different users for data preparation and following simulations run in parallel on clusters, with and without queuing systems. 1 Introduction and Related Work In today’s distributed networks, services are combined into scientic workows en-abling convenient execution of frequent scenarios in various disciplines like molecular biology, bioinformatics, ecology, chemistry, often using HPC resources