Beyond Optimizing for Clicks: Incorporating Editorial Values in News Recommendation
Table 1. Offline evaluation performance.
['[EMPTY]', 'NDCG', 'R@5', 'P@5', 'R@10', 'P@10']
The NDCG score (0.71) tells us that users’ clicked articles ranked relatively high in our recommendations. Recall scores (0.55, 0.74) show us that over half of the clicked articles rank among the top 10 recommendations. Overall, without having a baseline to compare against, we believe the metrics point to an adequate ability of the recommender system to rank read articles highly.