Spider Codes: Practical erasure codes for distributed storage systems

Distributed storage systems use erasure codes to reliably store data with a small storage overhead. To further improve system performance, some novel erasure codes introduce new features such as the regenerating property or symbol locality, enabling these codes to have optimal repair times and optim...

Full description

Saved in:
Bibliographic Details
Main Authors: Pamies-Juarez, Lluis, Guyot, Cyril, Mateescu, Robert
Format: Conference Proceeding
Language:English
Subjects:
Data storage
Encoding
Fault tolerance
Fault tolerant systems
Information theory
Maintenance engineering
Measurement
Optimization
Performance measurement
Repair time
Spiders
Storage systems
Throughput
Tradeoffs
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Distributed storage systems use erasure codes to reliably store data with a small storage overhead. To further improve system performance, some novel erasure codes introduce new features such as the regenerating property or symbol locality, enabling these codes to have optimal repair times and optimal degraded read performance. Unfortunately, the introduction of these new features often exacerbates the performance of other system metrics such as encoding throughput, data reliability, and storage overhead, among others. In this paper we describe the intricate relationships between erasure code properties and system-level performance metrics, showing the different tradeoffs distributed storage designers need to face. We also present Spider Codes, a new erasure code achieving a practical trade-off between the different system-level performance metrics.
ISSN:2157-8117
DOI:10.1109/ISIT.2016.7541490