Abstract—Cloud computing infrastructure offers the com-puting resources as a homogeneous collection of virtual ma-chine instances by different hardware configurations, which is transparent to end users. In fact, the computational powers of these virtual machine instances are different and behaves as a heterogeneous environment. Thus, scheduling and load balancing for high performance computations become challeng-ing on such systems. In this paper, we propose a hierarchical distributed scheduling scheme suitable for parallel loops with independent iterations on a cloud computing system. We also evaluate various performance aspects associated with our distributed scheduling scheme