A Review of Performance Evaluation Measures for Hierarchical Classifiers

Eduardo P. Costa, Ana C. Lorena, Andre C. P. L. F. Carvalho, Alex A. Freitas

Criteria for evaluating the performance of a classifier are an important part in its design. They allow to estimate the behavior of the generated classifier on unseen data and can be also used to compare its performance against the performance of classifiers generated by other classification algorithms. There are currently several performance measures for binary and flat classification problems. For hierarchical classification problems, where there are multiple classes which are hierarchically related, the evaluation step is more complex. This paper reviews the main evaluation metrics proposed in the literature to evaluate hierarchical classification models.

Subjects: 12. Machine Learning and Discovery; 1.6 Engineering And Science

Submitted: May 15, 2007

This page is copyrighted by AAAI. All rights reserved. Your use of this site constitutes acceptance of all of AAAI's terms and conditions and privacy policy.