Demonstrating the Equivalence of List Based and Aggregate Metrics to Measure the Diversity of Recommendations (Student Abstract)

No. 18: AAAI-21 Student Papers and Demonstrations

Volume

Proceedings of the AAAI Conference on Artificial Intelligence, 35

AAAI Student Abstract and Poster Program

The evaluation of recommender systems is frequently focused on accuracy metrics, but this is only part of the picture. The diversity of recommendations is another important dimension that has received renewed interest in recent years. It is known that accuracy and diversity can be conflicting goals and finding appropriate ways to combine them is still an open research question. Several ways have been proposed to measure the diversity of recommendations and to include its optimization in the loss function used to train the model. Methods optimizing list based diversity suffer from two drawbacks: the high computational cost of the loss function and the lack of an efficient way to optimize them. In this paper we show the equivalence of the list based diversity metrics Hamming and Mean Inter-List diversity to the aggregate diversity metric measured with the Herfindahl index, providing a formulation that allows to compute and optimize them easily.

10.1609/aaai.v35i18.17886