The Reproduction Angular Error for Evaluating the Performance of Illuminant Estimation Algorithms

The angle between the RGBs of the measured illuminant and estimated illuminant colors-the recovery angular error-has been used to evaluate the performance of the illuminant estimation algorithms. However we noticed that this metric is not in line with how the illuminant estimates are used. Normally,...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on pattern analysis and machine intelligence 2017-07, Vol.39 (7), p.1482-1488
Main Authors: Finlayson, Graham D., Zakizadeh, Roshanak, Gijsenij, Arjan
Format: Article
Language:English
Subjects:
Algorithm design and analysis
Algorithms
Color
color constancy
Error analysis
error metric
Estimates
Estimation error
Illuminant estimation
Image color analysis
Light
Lighting
Measurement uncertainty
Optimization
Performance evaluation
Recovery
Reproduction
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The angle between the RGBs of the measured illuminant and estimated illuminant colors-the recovery angular error-has been used to evaluate the performance of the illuminant estimation algorithms. However we noticed that this metric is not in line with how the illuminant estimates are used. Normally, the illuminant estimates are `divided out' from the image to, hopefully, provide image colors that are not confounded by the color of the light. However, even though the same reproduction results the same scene might have a large range of recovery errors. In this work the scale of the problem with the recovery error is quantified. Next we propose a new metric for evaluating illuminant estimation algorithms, called the reproduction angular error, which is defined as the angle between the RGB of a white surface when the actual and estimated illuminations are `divided out'. Our new metric ties algorithm performance to how the illuminant estimates are used. For a given algorithm, adopting the new reproduction angular error leads to different optimal parameters. Further the ranked list of best to worst algorithms changes when the reproduction angular is used. The importance of using an appropriate performance metric is established.
ISSN:0162-8828
1939-3539
2160-9292
DOI:10.1109/TPAMI.2016.2582171