Benchmarking optimization software with performance profiles

We propose performance profiles -- distribution functions for a performance metric -- as a tool for benchmarking and comparing optimization software. We show that performance profiles combine the best features of other tools for performance evaluation.

Saved in:
Bibliographic Details
Published in:Mathematical programming 2002, Vol.91 (2), p.201-213
Main Authors: DOLAN, Elizabeth D, MORE, Jorge J
Format: Article
Language:English
Subjects:
ALGORITHMS
Applied sciences
BENCHMARKS
Business metrics
Competition
COMPUTER CODES
Computer science
DATA
DATA ANALYSIS
DISTRIBUTION FUNCTIONS
EVALUATION
Exact sciences and technology
GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE
Laboratories
Linear programming
MATHEMATICS AND COMPUTING
METRICS
Operational research and scientific management
Operational research. Management science
OPTIMIZATION
Optimization. Search problems
Performance evaluation
Software
Trends
Citations: Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We propose performance profiles -- distribution functions for a performance metric -- as a tool for benchmarking and comparing optimization software. We show that performance profiles combine the best features of other tools for performance evaluation.
ISSN:0025-5610
1436-4646
DOI:10.1007/s101070100263