4th USENIX Conference on File and Storage TechnologiesAbstract
Pp. 4558 of the Proceedings
Adaptive Data Placement for Wide-Area Sensing Services
Suman Nath, Microsoft Research; Phillip B. Gibbons, Intel Research Pittsburgh; Srinivasan Seshan, Carnegie Mellon University
Wide-area sensing services enable users to query data
collected from multitudes of widely distributed sensors.
In this paper, we consider the novel distributed database
workload characteristics of these services, and present
IDP, an online, adaptive data placement and replication
system tailored to this workload. Given a hierarchical
database, IDP automatically partitions it among a set
of networked hosts, and replicates portions of it. IDP
makes decisions based on measurements of access locality
within the database, read and write load for individual
objects within the database, proximity between queriers
and potential replicas, and total load on hosts participating
in the database. Our evaluation of IDP under real and
synthetic workloads, including flash crowds of queriers,
demonstrates that in comparison with previously-studied
replica placement techniques, IDP reduces average response
times for user queries by up to a factor of 3 and reduces
network traffic for queries, updates, and data movements
by up to an order of magnitude.
- View the full text of this paper in HTML and PDF.
Until December 2006, you will need your USENIX membership identification in order to access the full papers. The Proceedings are published as a collective work, © 2005 by the USENIX Association. All Rights Reserved. Rights to individual papers remain with the author or the author's employer. Permission is granted for the noncommercial reproduction of the complete work for educational or research purposes. USENIX acknowledges all trademarks within this paper.
- If you need the latest Adobe Acrobat Reader, you can download it from Adobe's site.