Lior Rokach

Senior Academic

Classifier evaluation under limited resources

Reuven Arbel, Lior Rokach

Existing evaluations measures are insufficient when probabilistic classifiers are used for choosing objects to be included in a limited quota. This paper reviews performance measures that suit probabilistic classification and introduce two novel performance measures that can be used effectively for this task. It then investigates when to use each of the measures and what purpose each one of them serves. The use of these measures is demonstrated on a real life dataset obtained from the human resource field and is validated on set of benchmark datasets.

Publication language English
Pages 1619-1631
Journal Pattern Recognition Letters
Volume 27
Issue number 14
Publication status Published - 15.10.2006

Keywords

Classification
Evaluation measures
Hit-rate
Recall
Receiver operating characteristic

ASJC Scopus subject areas

Software
Signal Processing
Computer Vision and Pattern Recognition
Artificial Intelligence