Outlier-robust extreme learning machine for regression problems

Extreme learning machine (ELM), as one of the most useful techniques in machine learning, has attracted extensive attentions due to its unique ability for extremely fast learning. In particular, it is widely recognized that ELM has speed advantage while performing satisfying results. However, the pr...

Full description

Saved in:
Bibliographic Details
Published in:Neurocomputing (Amsterdam) 2015-03, Vol.151, p.1519-1527
Main Authors: Zhang, Kai, Luo, Minxia
Format: Article
Language:English
Subjects:
Approximation
Augmented Lagrange multipliers method
Extreme learning machine
Learning
Mathematical analysis
Mathematical models
Neural networks
Outlier robustness
Recognition
Regression
Robustness
ℓ1-norm
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Extreme learning machine (ELM), as one of the most useful techniques in machine learning, has attracted extensive attentions due to its unique ability for extremely fast learning. In particular, it is widely recognized that ELM has speed advantage while performing satisfying results. However, the presence of outliers may give rise to unreliable ELM model. In this paper, our study addresses the outlier robustness of ELM in regression problems. Based on the sparsity characteristic of outliers, this work proposes an outlier-robust ELM where the ℓ1-norm loss function is used to enhance the robustness. Specially, the fast and accurate augmented Lagrangian multiplier method is applied to guarantee the effectiveness and efficiency. According to the experiments on function approximation and some real-world applications, the proposed approach not only maintains the advantages from original ELM, but also shows notable and stable accuracy in handling data with outliers.
ISSN:0925-2312
1872-8286
DOI:10.1016/j.neucom.2014.09.022