USITS '03 Abstract
FastReplica: Efficient Large File Distribution Within Content Delivery Networks
Ludmila Cherkasova, Hewlett-Packard Laboratories, and Jangwon Lee, University of Texas at Austin
In this work, we consider a large-scale
distributed network of servers and a problem of content distribution
across it. We propose a novel algorithm, called FastReplica,
for an efficient and reliable replication of large files in the
Internet environment. There are a few basic ideas exploited in
FastReplica. In order to replicate a large file among nodes (
is in the range of 10-30 nodes), the original file is partitioned into
subfiles of equal size and each subfile is transferred to a
different node in the group. After that, each node propagates its
subfile to the remaining nodes in the group. Thus instead of the typical
replication of an entire file to nodes by using Internet
paths, connecting the original node to the replication group,
FastReplica exploits Internet paths within the
replication group where each path is used for transferring -th of the file. We design a scalable and reliable
FastReplica algorithm which can be used for replication of large
files to a large group of nodes. The new method is simple and
inexpensive. It does not require any changes or modifications to the
existing Internet infrastructure, and at the same time, it
significantly reduces the file replication time as we demonstrate
through experiments on a prototype implementation of FastReplica
in a wide-area testbed.
- View the full text of this paper in HTML or PDF.
Until March 2004, you will need your USENIX membership identification in order to access the full papers. The Proceedings are published as a collective work, © 2003 by the USENIX Association. All Rights Reserved. Rights to individual papers remain with the author or the author's employer. Permission is granted for the noncommercial reproduction of the complete work for educational or research purposes. USENIX acknowledges all trademarks within this paper.
- If you need the latest Adobe Acrobat Reader, you can download it from Adobe's site.