Parallel disk systems provide opportunities for exploiting I/O parallelism in two possible waves, namely via inter-request and intra-request parallelism. In this paper we discuss the main issues in performance tuning of such systems, namely striping and load balancing, and show their relationship to response time and throughput. We outline the main components of an intelligent, self-reliant file system that aims to optimize striping by taking into account the requirements of the applications and performs load balancing by judicious file allocation and dynamic redistributions of the data when access patterns change. Our system uses simple but effective heuristics that incur only little overhead. We present performance experiments based on sy...
Recently, parallel disk systems have emerged as a potential solution for achieving ultra-high capaci...
This is the published version, made available with the permission of the publisher. Copyright © 200...
As disk capacities continue to rise more rapidly than transfer rates, adaptive, redundant striping s...
In this thesis, we propose a self-tuning approach for automatically selecting and refining the file ...
Several algorithms for parallel disk systems have appeared in the literature recently, and they are ...
We address the problem of assigning non-partitioned files in a parallel I/O system where the file ac...
Components in parallel systems are heterogeneous, and over time, the degree of heterogeneity often i...
Parallel systems leverage parallel file systems to efficiently perform I/O to shared files. These pa...
As parallel computers are increasingly used to run scientific applications with large data sets, and...
In this thesis, we propose a self-tuning approach for automatically select-ing and refining the file...
As we move towards the Exactable era of supercomputing, node-level failures are becoming more common...
The distributed file system, HDFS, is widely deployed as the bedrock for many parallel big data anal...
Current I/O stack for high-performance computing is composed of multiple software layers in order to...
Phenomenal improvements in the computational performance of multiprocessors have not been matched by...
High performance applications involving large data sets require the efficient and flexible use of mu...
Recently, parallel disk systems have emerged as a potential solution for achieving ultra-high capaci...
This is the published version, made available with the permission of the publisher. Copyright © 200...
As disk capacities continue to rise more rapidly than transfer rates, adaptive, redundant striping s...
In this thesis, we propose a self-tuning approach for automatically selecting and refining the file ...
Several algorithms for parallel disk systems have appeared in the literature recently, and they are ...
We address the problem of assigning non-partitioned files in a parallel I/O system where the file ac...
Components in parallel systems are heterogeneous, and over time, the degree of heterogeneity often i...
Parallel systems leverage parallel file systems to efficiently perform I/O to shared files. These pa...
As parallel computers are increasingly used to run scientific applications with large data sets, and...
In this thesis, we propose a self-tuning approach for automatically select-ing and refining the file...
As we move towards the Exactable era of supercomputing, node-level failures are becoming more common...
The distributed file system, HDFS, is widely deployed as the bedrock for many parallel big data anal...
Current I/O stack for high-performance computing is composed of multiple software layers in order to...
Phenomenal improvements in the computational performance of multiprocessors have not been matched by...
High performance applications involving large data sets require the efficient and flexible use of mu...
Recently, parallel disk systems have emerged as a potential solution for achieving ultra-high capaci...
This is the published version, made available with the permission of the publisher. Copyright © 200...
As disk capacities continue to rise more rapidly than transfer rates, adaptive, redundant striping s...