Darel13712 / compare_metrics

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Comparison of Metric Implementations

This is a companion repository for the paper Quality Metrics in Recommender Systems: Do We Calculate Consistently? Presented as a LBR poster at RecSys'21.

Files Description

  • pred.csv – EASE model predictions
  • test.csv — test data
  • res.csv — metric values for different libraries
  • res_auc.csv — extra table with different versions of AUC

Metrics

All metrics are calculated at depth cut-off k=20, except for roc-auc

  • hitrate
  • precision
  • recall
  • map
  • mrr
  • ndcg
  • roc-auc

Libraries

About


Languages

Language:Jupyter Notebook 100.0%