Large distributed systems such as Computational/Data Grids require large amounts of data to be co-located with the computing facilities for processing. Ensuring that the data is there in time for the computation in today's Internet is a massive problem. From our work developing a scalable distributed network cache, we have gained experience with techniques necessary to achieve high data throughput over high bandwidth Wide Area Networks (WAN). In this paper, we discuss several hardware and software design techniques and issues, and then describe their application to an implementation of an enhanced FTP protocol called GridFTP. We also describe results from two applications using these techniques, which were obtained at the Supercomputing 200...
The ability of transferring very large files in the shortest amount of time is crucial for data-inte...
In this dissertation, we present several techniques to achieve the high-performance processing in ne...
Data sets are collected daily in large amounts (Big Data) and they are increasing rapidly due to var...
Large distributed systems such as Computational/Data Grids require large amounts of data to be co-l...
Large distributed systems such as Computational/Data Grids require large amounts of data to be co-lo...
Hadoop distributed file system (HDFS) is becoming more popular in recent years as a key building blo...
Hadoop distributed file system (HDFS) is becoming more popular in recent years as a key building blo...
Bulk data transfer in wide area networks (WAN) requires scalable and high network bandwidth. In this...
Abstract. Grid applications often require large data transfers along heterogeneous networks having d...
Over the last decades Internet traffic has grown dramatically. Besides the number of transfers, data...
Abstract—FTP has been the most popular method to transfer large files for data-staging, replication,...
In this paper, we describe FOBS: a simple user-level communication protocol designed to take advanta...
The ability of transferring very large files in the shortest amount of time is crucial for data-inte...
Recent advances in Grid technology have made it possible to build so-called computational Grids, or ...
In Grid computing, a data transfer protocol called GridFTP has been widely used for efficiently tran...
The ability of transferring very large files in the shortest amount of time is crucial for data-inte...
In this dissertation, we present several techniques to achieve the high-performance processing in ne...
Data sets are collected daily in large amounts (Big Data) and they are increasing rapidly due to var...
Large distributed systems such as Computational/Data Grids require large amounts of data to be co-l...
Large distributed systems such as Computational/Data Grids require large amounts of data to be co-lo...
Hadoop distributed file system (HDFS) is becoming more popular in recent years as a key building blo...
Hadoop distributed file system (HDFS) is becoming more popular in recent years as a key building blo...
Bulk data transfer in wide area networks (WAN) requires scalable and high network bandwidth. In this...
Abstract. Grid applications often require large data transfers along heterogeneous networks having d...
Over the last decades Internet traffic has grown dramatically. Besides the number of transfers, data...
Abstract—FTP has been the most popular method to transfer large files for data-staging, replication,...
In this paper, we describe FOBS: a simple user-level communication protocol designed to take advanta...
The ability of transferring very large files in the shortest amount of time is crucial for data-inte...
Recent advances in Grid technology have made it possible to build so-called computational Grids, or ...
In Grid computing, a data transfer protocol called GridFTP has been widely used for efficiently tran...
The ability of transferring very large files in the shortest amount of time is crucial for data-inte...
In this dissertation, we present several techniques to achieve the high-performance processing in ne...
Data sets are collected daily in large amounts (Big Data) and they are increasing rapidly due to var...