usenix conference policies
Experiences with Large Storage Environments
I have worked with various aspects of the recording and billing systems for a large telecommunications company for the last several years. We process feeds from various UNIX, MVS (Cobol and PL/1), and AS/400 systems, to the tune of 4000 files comprising 300–700GB of new data per day. This data streams into several PC clusters, where it is chewed on, compressed, added to databases, and copied onto tape. This is not trivial to do. Sure, we have about 50TB of disk, but that doesn't go as far as it used to. Managing the space is harder than it ought to be; annually managing 2–3 million files and their life cycles is awkward, as is controlling the processing of these files. This talk will discuss these and other challenges in both hardware and operating system choices and will discuss solutions we've found.
author = {Andrew Hume},
title = {Experiences with Large Storage Environments},
booktitle = {2004 USENIX Annual Technical Conference (USENIX ATC 04)},
year = {2004},
address = {Boston, MA},
url = {https://www.usenix.org/conference/2004-usenix-annual-technical-conference/experiences-large-storage-environments},
publisher = {USENIX Association},
month = jun
}
connect with us