The sqlLoader Data-Loading Pipeline

Using a database management system (DBMS) is essential to ensure the data integrity and reliability of large, multidimensional data sets. However, loading multiterabyte data into a DBMS is a time-consuming and error-prone task that the authors have tried to automate by developing the sqlLoader pipel...

Full description

Saved in:

Bibliographic Details
Published in:	Computing in science & engineering 2008-01, Vol.10 (1), p.38-48
Main Authors:	Szalay, Alex, Thakar, Ani R., Gray, Jim
Format:	Article
Language:	eng
Subjects:	astronomy Automation Computation Data base management systems Data mining database management systems Database systems Image converters Image databases Information retrieval Integrity large-scale databases Multidimensional data Multidimensional systems Observatories Pipelines Publishing SDSS Sloan Digital Sky Survey Science Archive Tasks Warehousing Workflow
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	Using a database management system (DBMS) is essential to ensure the data integrity and reliability of large, multidimensional data sets. However, loading multiterabyte data into a DBMS is a time-consuming and error-prone task that the authors have tried to automate by developing the sqlLoader pipeline-a distributed workflow system for data loading.
ISSN:	1521-9615 1558-366X