On the architecture of a big data classification tool based on a map reduce approach for hyperspectral image analysis

Advances in remote sensors are providing exceptional quantities of large-scale data with increasing spatial, spectral and temporal resolutions, raising new challenges in its analysis, e.g. those presents in classification processes. This work presents the architecture of the InterIMAGE Cloud Platfor...

Full description

Saved in:
Bibliographic Details
Main Authors: Ayma, V. A., Ferreira, R. S., Happ, P. N., Oliveira, D. A. B., Costa, G. A. O. P., Feitosa, R. Q., Plaza, A., Gamba, P.
Format: Conference Proceeding
Language:English
Subjects:
Big data
Classification algorithms
Cloud computing
Computer architecture
Data mining
Iterative closest point algorithm
MapReduce
Training
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Advances in remote sensors are providing exceptional quantities of large-scale data with increasing spatial, spectral and temporal resolutions, raising new challenges in its analysis, e.g. those presents in classification processes. This work presents the architecture of the InterIMAGE Cloud Platform (ICP): Data Mining Package; a tool able to perform supervised classification procedures on huge amounts of data, on a distributed infrastructure. The architecture is implemented on top of the MapReduce framework. The tool has four classification algorithms implemented taken from WEKA's machine learning library, namely: Decision Trees, Naïve Bayes, Random Forest and Support Vector Machines. The SVM classifier was applied on datasets of different sizes (2 GB, 4 GB and 10 GB) for different cluster configurations (5, 10, 20, 50 nodes). The results show the tool as a potential approach to parallelize classification processes on big data.
ISSN:2153-6996
2153-7003
DOI:10.1109/IGARSS.2015.7326066